Apr 16 15:00:30 devstack cinder-volume[73000]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 16 15:00:30 devstack cinder-volume[73000]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 16 15:00:30 devstack cinder-volume[73000]: we strongly recommend against using it for new projects. Apr 16 15:00:30 devstack cinder-volume[73000]: If you are already using Eventlet, we recommend migrating to a different Apr 16 15:00:30 devstack cinder-volume[73000]: framework. For more detail see Apr 16 15:00:30 devstack cinder-volume[73000]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 16 15:00:30 devstack cinder-volume[73000]: import eventlet # noqa Apr 16 15:00:32 devstack cinder-volume[73000]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=73000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 16 15:00:32 devstack cinder-volume[73000]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=73000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 16 15:00:32 devstack cinder-volume[73000]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=73000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 16 15:00:32 devstack cinder-volume[73000]: INFO dbcounter [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] Registered counter for database cinder Apr 16 15:00:32 devstack cinder-volume[73000]: DEBUG oslo_db.sqlalchemy.engines [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73000) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 16 15:00:32 devstack cinder-volume[73000]: DEBUG dbcounter [-] [73000] Writer thread running {{(pid=73000) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 16 15:00:32 devstack cinder-volume[73000]: INFO cinder.rpc [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 16 15:00:32 devstack cinder-volume[73000]: INFO cinder.rpc [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 16 15:00:32 devstack cinder-volume[73000]: DEBUG oslo_db.sqlalchemy.engines [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73000) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 16 15:00:32 devstack cinder-volume[73000]: INFO cinder.volume.manager [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] Determined volume DB was empty at startup. Apr 16 15:00:32 devstack cinder-volume[73000]: DEBUG cinder.volume.manager [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=73000) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 16 15:00:32 devstack cinder-volume[73000]: INFO cinder.volume.manager [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 16 15:00:32 devstack cinder-volume[73000]: WARNING stevedore.named [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 16 15:00:32 devstack cinder-volume[73000]: WARNING castellan.key_manager [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 16 15:00:32 devstack cinder-volume[73000]: WARNING cinder.keymgr.conf_key_mgr [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 16 15:00:32 devstack cinder-volume[73000]: DEBUG cinder.volume.drivers.lvm [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=73000) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Apr 16 15:00:32 devstack cinder-volume[73000]: DEBUG oslo_concurrency.processutils [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=73000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_concurrency.processutils [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] CMD "cinder-rtstool verify" returned: 0 in 0.246s {{(pid=73000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_db.sqlalchemy.engines [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73000) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 16 15:00:33 devstack cinder-volume[73000]: INFO cinder.rpc [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Apr 16 15:00:33 devstack cinder-volume[73000]: INFO cinder.rpc [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Apr 16 15:00:33 devstack cinder-volume[73000]: WARNING stevedore.named [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 16 15:00:33 devstack cinder-volume[73000]: WARNING castellan.key_manager [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 16 15:00:33 devstack cinder-volume[73000]: INFO cinder.volume.manager [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_db.sqlalchemy.engines [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73000) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 16 15:00:33 devstack cinder-volume[73000]: INFO oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] Starting 1 workers Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] Started child 73104 {{(pid=73000) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] Full set of CONF: {{(pid=73000) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] ******************************************************************************** {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] Configuration options gathered from: {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] ================================================================================ {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] allow_availability_zone_fallback = False {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73104]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] allow_compression_on_image_upload = False {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] allowed_direct_url_schemes = [] {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] api_rate_limit = True {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] auth_strategy = keystone {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] az_cache_duration = 3600 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] backend_availability_zone = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] backend_host = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] backend_name = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] backend_stats_polling_interval = 60 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] backup_api_class = cinder.backup.api.API {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] backup_name_template = backup-%s {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] backup_use_same_host = False {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] backup_use_temp_snapshot = False {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] chap_password = **** {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] chap_username = {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] cinder_internal_tenant_project_id = ca6c1a1bfa094a99859ccde648f759c8 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] cinder_internal_tenant_user_id = 5cd06a2a2ec1478bb3a7de15d57ee19c {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] cloned_volume_same_az = True {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] cluster = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] compression_format = gzip {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] compute_api_class = cinder.compute.nova.API {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] config_dir = [] {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] config_source = [] {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] control_exchange = openstack {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] debug = True {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] default_availability_zone = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] default_group_type = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] default_volume_type = lvmdriver-1 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] disk_geometry = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] driver_client_cert = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] driver_client_cert_key = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] driver_data_namespace = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] driver_ssl_cert_path = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] driver_ssl_cert_verify = False {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] driver_use_ssl = False {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] enable_force_upload = False {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] enable_new_services = True {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] enable_unsupported_driver = False {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] enabled_backends = ['lvmdriver-1'] {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] enforce_multipath_for_image_xfer = False {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] filter_function = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] glance_api_insecure = False {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] glance_api_servers = ['http://192.168.122.229/image'] {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] glance_api_ssl_compression = False {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] glance_ca_certificates_file = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] glance_catalog_info = image:glance:publicURL {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] glance_certfile = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] glance_keyfile = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] glance_num_retries = 3 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] glance_request_timeout = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] goodness_function = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] graceful_shutdown_timeout = 5 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] group_api_class = cinder.group.api.API {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] host = devstack {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] image_compress_on_upload = True {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] image_conversion_address_space_limit = 1 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] image_conversion_cpu_limit = 60 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] image_conversion_disable = False {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] image_upload_use_cinder_backend = False {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] image_upload_use_internal_tenant = False {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] image_volume_cache_enabled = False {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] image_volume_cache_max_count = 0 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] image_volume_cache_max_size_gb = 0 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] init_host_max_objects_retrieval = 0 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] instance_format = [instance: %(uuid)s] {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] iscsi_target_flags = {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] iscsi_write_cache = on {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] iser_helper = tgtadm {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] iser_ip_address = 192.168.122.229 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] iser_port = 3260 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] log_color = False {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] log_config_append = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] log_dir = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] log_file = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] log_options = True {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] log_rotate_interval = 1 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] log_rotate_interval_type = days {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] log_rotation_type = none {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73104]: INFO cinder.volume.manager [None req-b484f23d-f133-47fc-85b9-255dbe633fdf None None] Starting volume driver LVMVolumeDriver (3.0.0) Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] max_age = 0 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73104]: DEBUG oslo_concurrency.processutils [None req-b484f23d-f133-47fc-85b9-255dbe633fdf None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] max_logfile_count = 30 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] max_logfile_size_mb = 200 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] max_over_subscription_ratio = 20.0 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] message_reap_interval = 86400 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] message_ttl = 2592000 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] migration_create_volume_timeout_secs = 300 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] monkey_patch = False {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] monkey_patch_modules = [] {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] my_ip = 192.168.122.229 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] no_snapshot_gb_quota = False {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] num_iser_scan_tries = 3 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] num_shell_tries = 3 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] num_volume_device_scan_tries = 3 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] nvmeof_conn_info_version = 1 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] nvmet_ns_id = 10 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] nvmet_port_id = 1 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] osapi_max_limit = 1000 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] osapi_volume_ext_list = [] {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] osapi_volume_listen = 0.0.0.0 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] osapi_volume_listen_port = 8776 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] osapi_volume_use_ssl = False {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] osapi_volume_workers = 2 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] per_volume_size_limit = -1 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] periodic_fuzzy_delay = 60 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] periodic_interval = 60 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] project_id_regex = [0-9a-f\-]+ {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] public_endpoint = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] publish_errors = False {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] quota_backup_gigabytes = 1000 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] quota_backups = 10 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] quota_gigabytes = 1000 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] quota_groups = 10 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] quota_snapshots = 10 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] quota_volumes = 10 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] rate_limit_burst = 0 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] rate_limit_except_level = CRITICAL {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] rate_limit_interval = 0 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] reinit_driver_count = 3 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] replication_device = **** {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] report_discard_supported = False {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] report_interval = 120 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] reservation_clean_interval = 86400 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] reservation_expire = 86400 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] reserved_image_namespaces = [] {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] reserved_percentage = 0 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] rpc_response_timeout = 120 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] run_external_periodic_tasks = True {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] scst_target_driver = iscsi {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] scst_target_iqn_name = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] service_down_time = 720 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] shell_completion = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] snapshot_name_template = snapshot-%s {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] snapshot_same_host = True {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] split_loggers = False {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] state_path = /opt/stack/data/cinder {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] storage_availability_zone = nova {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] storage_protocol = iSCSI {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] syslog_log_facility = LOG_USER {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] target_helper = lioadm {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] target_ip_address = 192.168.122.229 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] target_port = 3260 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] target_protocol = iscsi {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] target_secondary_ip_addresses = [] {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] trace_flags = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] transfer_api_class = cinder.transfer.api.API {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] transport_url = **** {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] until_refresh = 0 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] use_chap_auth = False {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] use_default_quota_class = True {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] use_journal = False {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] use_json = False {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] use_multipath_for_image_xfer = False {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] use_stderr = False {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] use_syslog = False {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] verify_glance_signatures = enabled {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] volume_api_class = cinder.volume.api.API {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] volume_backend_name = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] volume_clear = zero {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] volume_clear_ionice = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] volume_clear_size = 0 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] volume_copy_bps_limit = 0 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] volume_dd_blocksize = 1M {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] volume_name_template = volume-%s {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] volume_service_inithost_offload = False {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] volume_usage_audit_period = month {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] zoning_mode = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] oslo_concurrency.disable_process_locking = False {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] keystone_authtoken.admin_password = **** {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] keystone_authtoken.admin_token = **** {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] keystone_authtoken.admin_user = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] keystone_authtoken.auth_admin_prefix = {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] keystone_authtoken.auth_port = 35357 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] keystone_authtoken.auth_protocol = https {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] keystone_authtoken.auth_section = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] keystone_authtoken.auth_type = password {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] keystone_authtoken.auth_uri = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] keystone_authtoken.auth_version = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] keystone_authtoken.cache = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] keystone_authtoken.certfile = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] keystone_authtoken.delay_auth_decision = False {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] keystone_authtoken.http_connect_timeout = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] keystone_authtoken.identity_uri = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] keystone_authtoken.include_service_catalog = True {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] keystone_authtoken.insecure = False {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] keystone_authtoken.interface = public {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] keystone_authtoken.keyfile = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] keystone_authtoken.memcache_password = {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] keystone_authtoken.memcache_username = {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] keystone_authtoken.region_name = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] keystone_authtoken.service_token_roles_required = False {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] keystone_authtoken.service_type = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] keystone_authtoken.token_cache_time = 300 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.229/identity {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73104]: DEBUG oslo_concurrency.processutils [None req-b484f23d-f133-47fc-85b9-255dbe633fdf None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.052s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] cache.backend = dogpile.cache.null {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] cache.backend_argument = **** {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] cache.backend_expiration_time = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] cache.config_prefix = cache.oslo {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] cache.debug_cache_backend = False {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] cache.enable_retry_client = False {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] cache.enable_socket_keepalive = False {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] cache.enabled = False {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73104]: DEBUG oslo_concurrency.processutils [None req-b484f23d-f133-47fc-85b9-255dbe633fdf None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] cache.enforce_fips_mode = False {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] cache.expiration_time = 600 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] cache.hashclient_retry_attempts = 2 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] cache.memcache_dead_retry = 300 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] cache.memcache_pool_maxsize = 10 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] cache.memcache_sasl_enabled = False {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] cache.password = **** {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] cache.proxies = [] {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] cache.redis_db = 0 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] cache.redis_sentinel_service_name = mymaster {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] cache.redis_server = localhost:6379 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] cache.retry_attempts = 2 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] cache.retry_delay = 0.0 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] cache.socket_keepalive_count = 1 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] cache.socket_keepalive_idle = 1 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] cache.socket_keepalive_interval = 1 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] cache.socket_timeout = 1.0 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] cache.tls_allowed_ciphers = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] cache.tls_cafile = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] cache.tls_certfile = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] cache.tls_enabled = False {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] cache.tls_keyfile = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] cache.username = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] coordination.backend_url = **** {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] database.asyncio_connection = **** {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] database.asyncio_slave_connection = **** {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] database.backend = sqlalchemy {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] database.connection = **** {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] database.connection_debug = 0 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] database.connection_parameters = {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] database.connection_recycle_time = 3600 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] database.connection_trace = False {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] database.db_inc_retry_interval = True {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] database.db_max_retries = 20 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] database.db_max_retry_interval = 10 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] database.db_retry_interval = 1 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] database.max_overflow = 50 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] database.max_pool_size = 5 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] database.max_retries = 10 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] database.mysql_wsrep_sync_wait = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] database.pool_timeout = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] database.retry_interval = 10 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] database.slave_connection = **** {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] database.sqlite_synchronous = True {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] database.synchronous_reader = True {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] database.use_db_reconnect = False {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] profiler.connection_string = messaging:// {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] profiler.enabled = False {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] profiler.es_doc_type = notification {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] profiler.es_scroll_size = 10000 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] profiler.es_scroll_time = 2m {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] profiler.filter_error_trace = False {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] profiler.hmac_keys = **** {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] profiler.sentinel_service_name = mymaster {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] profiler.socket_timeout = 0.1 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] profiler.trace_requests = False {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] profiler.trace_sqlalchemy = False {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] profiler_jaeger.process_tags = {} {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] profiler_jaeger.service_name_prefix = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] profiler_otlp.service_name_prefix = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] oslo_policy.enforce_new_defaults = False {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: WARNING oslo_config.cfg [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] oslo_policy.enforce_scope = False {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] oslo_policy.policy_default_rule = default {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] oslo_policy.policy_file = policy.yaml {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] oslo_policy.remote_timeout = 60.0 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] privsep_osbrick.group = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] privsep_osbrick.helper_command = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] privsep_osbrick.user = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] cinder_sys_admin.group = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] cinder_sys_admin.helper_command = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] cinder_sys_admin.user = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] service_user.auth_section = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] service_user.auth_type = password {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] service_user.cafile = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] service_user.certfile = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73104]: DEBUG oslo_concurrency.processutils [None req-b484f23d-f133-47fc-85b9-255dbe633fdf None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.036s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] service_user.collect_timing = False {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] service_user.insecure = False {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] service_user.keyfile = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73104]: DEBUG oslo_concurrency.processutils [None req-b484f23d-f133-47fc-85b9-255dbe633fdf None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] service_user.send_service_user_token = True {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] service_user.split_loggers = False {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] service_user.timeout = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] glance.auth_section = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] glance.auth_type = password {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] glance.certfile = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] glance.collect_timing = False {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] glance.insecure = False {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] glance.keyfile = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] glance.region_name = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] glance.split_loggers = False {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] glance.timeout = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] backend_defaults.backend_availability_zone = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] backend_defaults.chap_password = **** {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] backend_defaults.chap_username = {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] backend_defaults.disk_geometry = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] backend_defaults.driver_client_cert = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] backend_defaults.driver_client_cert_key = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] backend_defaults.driver_data_namespace = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] backend_defaults.driver_use_ssl = False {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] backend_defaults.enable_unsupported_driver = False {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] backend_defaults.extra_capabilities = {} {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] backend_defaults.filter_function = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] backend_defaults.goodness_function = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] backend_defaults.iscsi_target_flags = {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] backend_defaults.iscsi_write_cache = on {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] backend_defaults.iser_helper = tgtadm {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] backend_defaults.iser_ip_address = 192.168.122.229 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] backend_defaults.iser_port = 3260 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] backend_defaults.lvm_mirrors = 0 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] backend_defaults.lvm_share_target = False {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] backend_defaults.lvm_type = auto {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] backend_defaults.num_shell_tries = 3 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] backend_defaults.nvmet_port_id = 1 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] backend_defaults.replication_device = **** {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] backend_defaults.report_discard_supported = False {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] backend_defaults.reserved_percentage = 0 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] backend_defaults.scst_target_driver = iscsi {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] backend_defaults.scst_target_iqn_name = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] backend_defaults.storage_protocol = iSCSI {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] backend_defaults.target_helper = tgtadm {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] backend_defaults.target_ip_address = 192.168.122.229 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] backend_defaults.target_port = 3260 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] backend_defaults.target_protocol = iscsi {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] backend_defaults.trace_flags = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] backend_defaults.unique_fqdn_network = True {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] backend_defaults.use_chap_auth = False {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] backend_defaults.volume_backend_name = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] backend_defaults.volume_clear = zero {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] backend_defaults.volume_clear_ionice = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] backend_defaults.volume_clear_size = 0 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] backend_defaults.volume_group = cinder-volumes {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] oslo_reports.file_event_handler = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] oslo_reports.log_dir = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] lvmdriver-1.backend_availability_zone = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] lvmdriver-1.backend_host = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] lvmdriver-1.chap_password = **** {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] lvmdriver-1.chap_username = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] lvmdriver-1.chiscsi_conf = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] lvmdriver-1.disk_geometry = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] lvmdriver-1.driver_client_cert = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73104]: DEBUG oslo_concurrency.processutils [None req-b484f23d-f133-47fc-85b9-255dbe633fdf None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.030s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] lvmdriver-1.driver_data_namespace = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73104]: DEBUG oslo_concurrency.processutils [None req-b484f23d-f133-47fc-85b9-255dbe633fdf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] lvmdriver-1.driver_use_ssl = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] lvmdriver-1.extra_capabilities = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] lvmdriver-1.filter_function = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] lvmdriver-1.goodness_function = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] lvmdriver-1.iser_helper = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] lvmdriver-1.iser_ip_address = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] lvmdriver-1.iser_port = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] lvmdriver-1.iser_target_prefix = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] lvmdriver-1.lvm_conf_file = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] lvmdriver-1.lvm_mirrors = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] lvmdriver-1.lvm_share_target = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] lvmdriver-1.lvm_type = auto {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] lvmdriver-1.num_shell_tries = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] lvmdriver-1.nvmet_port_id = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] lvmdriver-1.replication_device = **** {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] lvmdriver-1.report_discard_supported = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] lvmdriver-1.reserved_percentage = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] lvmdriver-1.scst_target_driver = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] lvmdriver-1.storage_protocol = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] lvmdriver-1.target_helper = lioadm {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] lvmdriver-1.target_ip_address = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] lvmdriver-1.target_port = 3260 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] lvmdriver-1.target_protocol = iscsi {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] lvmdriver-1.trace_flags = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] lvmdriver-1.use_chap_auth = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] lvmdriver-1.volume_clear = zero {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] lvmdriver-1.volume_clear_size = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] lvmdriver-1.volumes_dir = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] oslo_messaging_rabbit.ssl = False {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] oslo_messaging_rabbit.ssl_version = {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] oslo_messaging_notifications.driver = [] {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] oslo_messaging_notifications.retry = -1 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] oslo_messaging_notifications.transport_url = **** {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] key_manager.fixed_key = **** {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack sudo[73110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] barbican.barbican_api_version = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] barbican.barbican_endpoint = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] barbican.barbican_endpoint_type = public {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] barbican.barbican_region_name = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack sudo[73110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] barbican.cafile = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] barbican.certfile = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] barbican.collect_timing = False {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] barbican.insecure = False {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] barbican.keyfile = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] barbican.number_of_retries = 60 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] barbican.retry_delay = 1 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] barbican.send_service_user_token = False {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] barbican.split_loggers = False {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] barbican.timeout = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] barbican.verify_ssl = True {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] barbican.verify_ssl_path = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] barbican_service_user.auth_section = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] barbican_service_user.auth_type = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] barbican_service_user.cafile = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] barbican_service_user.certfile = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] barbican_service_user.collect_timing = False {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] barbican_service_user.insecure = False {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] barbican_service_user.keyfile = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] barbican_service_user.split_loggers = False {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] barbican_service_user.timeout = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] vault.approle_role_id = **** {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] vault.approle_secret_id = **** {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] vault.kv_mountpoint = secret {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] vault.kv_path = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] vault.kv_version = 2 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] vault.namespace = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] vault.root_token_id = **** {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] vault.ssl_ca_crt_file = None {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] vault.timeout = 60.0 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] vault.use_ssl = False {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:00:33 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] ******************************************************************************** {{(pid=73000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 16 15:00:33 devstack sudo[73110]: pam_unix(sudo:session): session closed for user root Apr 16 15:00:33 devstack cinder-volume[73104]: DEBUG oslo_concurrency.processutils [None req-b484f23d-f133-47fc-85b9-255dbe633fdf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.522s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:00:33 devstack cinder-volume[73104]: DEBUG oslo_concurrency.processutils [None req-b484f23d-f133-47fc-85b9-255dbe633fdf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:00:33 devstack sudo[73113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 16 15:00:33 devstack sudo[73113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:00:34 devstack sudo[73113]: pam_unix(sudo:session): session closed for user root Apr 16 15:00:34 devstack cinder-volume[73104]: DEBUG oslo_concurrency.processutils [None req-b484f23d-f133-47fc-85b9-255dbe633fdf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.528s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:00:34 devstack cinder-volume[73104]: DEBUG oslo_concurrency.processutils [None req-b484f23d-f133-47fc-85b9-255dbe633fdf None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 16 15:00:34 devstack cinder-volume[73104]: INFO cinder.brick.local_dev.lvm [None req-b484f23d-f133-47fc-85b9-255dbe633fdf None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Apr 16 15:00:34 devstack cinder-volume[73104]: DEBUG oslo_concurrency.processutils [None req-b484f23d-f133-47fc-85b9-255dbe633fdf None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:00:34 devstack cinder-volume[73104]: DEBUG oslo_concurrency.processutils [None req-b484f23d-f133-47fc-85b9-255dbe633fdf None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.014s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:00:34 devstack cinder-volume[73104]: DEBUG oslo_concurrency.processutils [None req-b484f23d-f133-47fc-85b9-255dbe633fdf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:00:34 devstack sudo[73224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 16 15:00:34 devstack sudo[73224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:00:34 devstack sudo[73224]: pam_unix(sudo:session): session closed for user root Apr 16 15:00:34 devstack cinder-volume[73104]: DEBUG oslo_concurrency.processutils [None req-b484f23d-f133-47fc-85b9-255dbe633fdf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.629s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:00:34 devstack cinder-volume[73104]: DEBUG cinder.brick.local_dev.lvm [None req-b484f23d-f133-47fc-85b9-255dbe633fdf None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=73104) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Apr 16 15:00:34 devstack cinder-volume[73104]: DEBUG oslo_concurrency.processutils [None req-b484f23d-f133-47fc-85b9-255dbe633fdf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:00:34 devstack sudo[73450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 16 15:00:34 devstack sudo[73450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:00:35 devstack sudo[73450]: pam_unix(sudo:session): session closed for user root Apr 16 15:00:35 devstack cinder-volume[73104]: DEBUG oslo_concurrency.processutils [None req-b484f23d-f133-47fc-85b9-255dbe633fdf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.918s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:00:35 devstack cinder-volume[73104]: DEBUG oslo_concurrency.processutils [None req-b484f23d-f133-47fc-85b9-255dbe633fdf None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:00:35 devstack cinder-volume[73104]: DEBUG oslo_concurrency.processutils [None req-b484f23d-f133-47fc-85b9-255dbe633fdf None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:00:35 devstack cinder-volume[73104]: DEBUG oslo_concurrency.processutils [None req-b484f23d-f133-47fc-85b9-255dbe633fdf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:00:35 devstack sudo[73713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 16 15:00:35 devstack sudo[73713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:00:36 devstack sudo[73713]: pam_unix(sudo:session): session closed for user root Apr 16 15:00:36 devstack cinder-volume[73104]: DEBUG oslo_concurrency.processutils [None req-b484f23d-f133-47fc-85b9-255dbe633fdf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.528s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:00:36 devstack cinder-volume[73104]: DEBUG oslo_concurrency.processutils [None req-b484f23d-f133-47fc-85b9-255dbe633fdf None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:00:36 devstack cinder-volume[73104]: DEBUG oslo_concurrency.processutils [None req-b484f23d-f133-47fc-85b9-255dbe633fdf None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:00:36 devstack cinder-volume[73104]: DEBUG oslo_concurrency.processutils [None req-b484f23d-f133-47fc-85b9-255dbe633fdf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:00:36 devstack sudo[73805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Apr 16 15:00:36 devstack sudo[73805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:00:36 devstack sudo[73805]: pam_unix(sudo:session): session closed for user root Apr 16 15:00:36 devstack cinder-volume[73104]: DEBUG oslo_concurrency.processutils [None req-b484f23d-f133-47fc-85b9-255dbe633fdf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.463s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:00:36 devstack cinder-volume[73104]: DEBUG oslo_concurrency.processutils [None req-b484f23d-f133-47fc-85b9-255dbe633fdf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:00:36 devstack sudo[73808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 16 15:00:36 devstack sudo[73808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:00:37 devstack sudo[73808]: pam_unix(sudo:session): session closed for user root Apr 16 15:00:37 devstack cinder-volume[73104]: DEBUG oslo_concurrency.processutils [None req-b484f23d-f133-47fc-85b9-255dbe633fdf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.459s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:00:37 devstack cinder-volume[73104]: DEBUG oslo_concurrency.processutils [None req-b484f23d-f133-47fc-85b9-255dbe633fdf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:00:37 devstack sudo[73812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 16 15:00:37 devstack sudo[73812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:00:37 devstack sudo[73812]: pam_unix(sudo:session): session closed for user root Apr 16 15:00:37 devstack cinder-volume[73104]: DEBUG oslo_concurrency.processutils [None req-b484f23d-f133-47fc-85b9-255dbe633fdf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.520s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:00:37 devstack cinder-volume[73104]: DEBUG oslo_concurrency.processutils [None req-b484f23d-f133-47fc-85b9-255dbe633fdf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:00:37 devstack sudo[73817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 16 15:00:37 devstack sudo[73817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:00:38 devstack sudo[73817]: pam_unix(sudo:session): session closed for user root Apr 16 15:00:38 devstack cinder-volume[73104]: DEBUG oslo_concurrency.processutils [None req-b484f23d-f133-47fc-85b9-255dbe633fdf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.469s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:00:38 devstack cinder-volume[73104]: DEBUG oslo_concurrency.processutils [None req-b484f23d-f133-47fc-85b9-255dbe633fdf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:00:38 devstack sudo[73821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 16 15:00:38 devstack sudo[73821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:00:38 devstack sudo[73821]: pam_unix(sudo:session): session closed for user root Apr 16 15:00:38 devstack cinder-volume[73104]: DEBUG oslo_concurrency.processutils [None req-b484f23d-f133-47fc-85b9-255dbe633fdf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.453s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:00:38 devstack cinder-volume[73104]: DEBUG oslo_concurrency.processutils [None req-b484f23d-f133-47fc-85b9-255dbe633fdf None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:00:38 devstack cinder-volume[73104]: DEBUG oslo_concurrency.processutils [None req-b484f23d-f133-47fc-85b9-255dbe633fdf None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:00:38 devstack cinder-volume[73104]: DEBUG oslo_concurrency.processutils [None req-b484f23d-f133-47fc-85b9-255dbe633fdf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:00:38 devstack sudo[73829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 16 15:00:38 devstack sudo[73829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:00:39 devstack sudo[73829]: pam_unix(sudo:session): session closed for user root Apr 16 15:00:39 devstack cinder-volume[73104]: DEBUG oslo_concurrency.processutils [None req-b484f23d-f133-47fc-85b9-255dbe633fdf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.440s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:00:39 devstack cinder-volume[73104]: INFO cinder.volume.drivers.lvm [None req-b484f23d-f133-47fc-85b9-255dbe633fdf None None] Enabling LVM thin provisioning by default because a thin pool exists. Apr 16 15:00:39 devstack cinder-volume[73104]: DEBUG oslo_concurrency.processutils [None req-b484f23d-f133-47fc-85b9-255dbe633fdf None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:00:39 devstack cinder-volume[73104]: DEBUG oslo_concurrency.processutils [None req-b484f23d-f133-47fc-85b9-255dbe633fdf None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:00:39 devstack cinder-volume[73104]: DEBUG oslo_concurrency.processutils [None req-b484f23d-f133-47fc-85b9-255dbe633fdf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:00:39 devstack sudo[73835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 16 15:00:39 devstack sudo[73835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:00:39 devstack sudo[73835]: pam_unix(sudo:session): session closed for user root Apr 16 15:00:39 devstack cinder-volume[73104]: DEBUG oslo_concurrency.processutils [None req-b484f23d-f133-47fc-85b9-255dbe633fdf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.511s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:00:39 devstack cinder-volume[73104]: DEBUG cinder.volume.drivers.lvm [None req-b484f23d-f133-47fc-85b9-255dbe633fdf None None] Updating volume stats {{(pid=73104) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 16 15:00:39 devstack cinder-volume[73104]: DEBUG oslo_concurrency.processutils [None req-b484f23d-f133-47fc-85b9-255dbe633fdf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:00:39 devstack sudo[73844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 16 15:00:39 devstack sudo[73844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:00:40 devstack sudo[73844]: pam_unix(sudo:session): session closed for user root Apr 16 15:00:40 devstack cinder-volume[73104]: DEBUG oslo_concurrency.processutils [None req-b484f23d-f133-47fc-85b9-255dbe633fdf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.468s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:00:40 devstack cinder-volume[73104]: DEBUG oslo_concurrency.processutils [None req-b484f23d-f133-47fc-85b9-255dbe633fdf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:00:40 devstack sudo[73956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 16 15:00:40 devstack sudo[73956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:00:40 devstack sudo[73956]: pam_unix(sudo:session): session closed for user root Apr 16 15:00:40 devstack cinder-volume[73104]: DEBUG oslo_concurrency.processutils [None req-b484f23d-f133-47fc-85b9-255dbe633fdf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.461s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:00:40 devstack cinder-volume[73104]: DEBUG oslo_concurrency.processutils [None req-b484f23d-f133-47fc-85b9-255dbe633fdf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:00:40 devstack sudo[74098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 16 15:00:40 devstack sudo[74098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:00:41 devstack sudo[74098]: pam_unix(sudo:session): session closed for user root Apr 16 15:00:41 devstack cinder-volume[73104]: DEBUG oslo_concurrency.processutils [None req-b484f23d-f133-47fc-85b9-255dbe633fdf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.442s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:00:41 devstack cinder-volume[73104]: DEBUG oslo_concurrency.processutils [None req-b484f23d-f133-47fc-85b9-255dbe633fdf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:00:41 devstack sudo[74101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 16 15:00:41 devstack sudo[74101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:00:41 devstack sudo[74101]: pam_unix(sudo:session): session closed for user root Apr 16 15:00:41 devstack cinder-volume[73104]: DEBUG oslo_concurrency.processutils [None req-b484f23d-f133-47fc-85b9-255dbe633fdf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.470s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:00:41 devstack cinder-volume[73104]: INFO cinder.volume.driver [None req-b484f23d-f133-47fc-85b9-255dbe633fdf None None] Driver hasn't implemented _init_vendor_properties() Apr 16 15:00:41 devstack cinder-volume[73104]: DEBUG cinder.volume.driver [None req-b484f23d-f133-47fc-85b9-255dbe633fdf None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=73104) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 16 15:00:41 devstack cinder-volume[73104]: DEBUG oslo_db.sqlalchemy.engines [None req-b484f23d-f133-47fc-85b9-255dbe633fdf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73104) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 16 15:00:41 devstack cinder-volume[73104]: DEBUG dbcounter [-] [73104] Writer thread running {{(pid=73104) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 16 15:00:41 devstack cinder-volume[73104]: DEBUG cinder.db.sqlalchemy.api [None req-b484f23d-f133-47fc-85b9-255dbe633fdf None None] Building query based on filter {{(pid=73104) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 16 15:00:41 devstack cinder-volume[73104]: DEBUG cinder.image.image_utils [None req-b484f23d-f133-47fc-85b9-255dbe633fdf None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=73104) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 16 15:00:41 devstack cinder-volume[73104]: INFO cinder.keymgr.migration [None req-7924bcdc-8ca2-45ca-8542-8b0ce2bed238 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 16 15:00:41 devstack cinder-volume[73104]: DEBUG cinder.volume.drivers.lvm [None req-b484f23d-f133-47fc-85b9-255dbe633fdf None None] Updating volume stats {{(pid=73104) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 16 15:00:41 devstack cinder-volume[73104]: DEBUG oslo_concurrency.processutils [None req-b484f23d-f133-47fc-85b9-255dbe633fdf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:00:41 devstack sudo[74106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 16 15:00:41 devstack sudo[74106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:00:42 devstack sudo[74106]: pam_unix(sudo:session): session closed for user root Apr 16 15:00:42 devstack cinder-volume[73104]: DEBUG oslo_concurrency.processutils [None req-b484f23d-f133-47fc-85b9-255dbe633fdf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.465s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:00:42 devstack cinder-volume[73104]: DEBUG oslo_concurrency.processutils [None req-b484f23d-f133-47fc-85b9-255dbe633fdf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:00:42 devstack sudo[74109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 16 15:00:42 devstack sudo[74109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:00:42 devstack sudo[74109]: pam_unix(sudo:session): session closed for user root Apr 16 15:00:42 devstack cinder-volume[73104]: DEBUG oslo_concurrency.processutils [None req-b484f23d-f133-47fc-85b9-255dbe633fdf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.530s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:00:42 devstack cinder-volume[73104]: DEBUG oslo_concurrency.processutils [None req-b484f23d-f133-47fc-85b9-255dbe633fdf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:00:42 devstack sudo[74115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 16 15:00:42 devstack sudo[74115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:00:43 devstack cinder-volume[73000]: DEBUG dbcounter [-] [73000] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=73000) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 15:00:43 devstack sudo[74115]: pam_unix(sudo:session): session closed for user root Apr 16 15:00:43 devstack cinder-volume[73104]: DEBUG oslo_concurrency.processutils [None req-b484f23d-f133-47fc-85b9-255dbe633fdf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.464s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:00:43 devstack cinder-volume[73104]: DEBUG oslo_concurrency.processutils [None req-b484f23d-f133-47fc-85b9-255dbe633fdf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:00:43 devstack sudo[74122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 16 15:00:43 devstack sudo[74122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:00:43 devstack sudo[74122]: pam_unix(sudo:session): session closed for user root Apr 16 15:00:43 devstack cinder-volume[73104]: DEBUG oslo_concurrency.processutils [None req-b484f23d-f133-47fc-85b9-255dbe633fdf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.530s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:00:43 devstack cinder-volume[73104]: DEBUG cinder.manager [None req-b484f23d-f133-47fc-85b9-255dbe633fdf None None] Notifying Schedulers of capabilities ... {{(pid=73104) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:00:43 devstack cinder-volume[73104]: INFO cinder.volume.manager [None req-b484f23d-f133-47fc-85b9-255dbe633fdf None None] Driver initialization completed successfully. Apr 16 15:00:43 devstack cinder-volume[73104]: INFO cinder.manager [None req-b484f23d-f133-47fc-85b9-255dbe633fdf None None] Initiating service 2 cleanup Apr 16 15:00:43 devstack cinder-volume[73104]: INFO cinder.manager [None req-b484f23d-f133-47fc-85b9-255dbe633fdf None None] Service 2 cleanup completed. Apr 16 15:00:43 devstack cinder-volume[73104]: DEBUG cinder.service [None req-b484f23d-f133-47fc-85b9-255dbe633fdf None None] Creating RPC server for service cinder-volume {{(pid=73104) start /opt/stack/cinder/cinder/service.py:231}} Apr 16 15:00:43 devstack cinder-volume[73104]: DEBUG cinder.service [None req-b484f23d-f133-47fc-85b9-255dbe633fdf None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=73104) start /opt/stack/cinder/cinder/service.py:237}} Apr 16 15:00:43 devstack cinder-volume[73104]: INFO cinder.volume.manager [None req-b484f23d-f133-47fc-85b9-255dbe633fdf None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Apr 16 15:00:43 devstack cinder-volume[73104]: DEBUG cinder.volume.drivers.lvm [None req-b484f23d-f133-47fc-85b9-255dbe633fdf None None] Updating volume stats {{(pid=73104) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 16 15:00:43 devstack cinder-volume[73104]: DEBUG oslo_concurrency.processutils [None req-b484f23d-f133-47fc-85b9-255dbe633fdf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:00:43 devstack sudo[74127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 16 15:00:43 devstack sudo[74127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:00:44 devstack sudo[74127]: pam_unix(sudo:session): session closed for user root Apr 16 15:00:44 devstack cinder-volume[73104]: DEBUG oslo_concurrency.processutils [None req-b484f23d-f133-47fc-85b9-255dbe633fdf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.488s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:00:44 devstack cinder-volume[73104]: DEBUG oslo_concurrency.processutils [None req-b484f23d-f133-47fc-85b9-255dbe633fdf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:00:44 devstack sudo[74130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 16 15:00:44 devstack sudo[74130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:00:44 devstack sudo[74130]: pam_unix(sudo:session): session closed for user root Apr 16 15:00:44 devstack cinder-volume[73104]: DEBUG oslo_concurrency.processutils [None req-b484f23d-f133-47fc-85b9-255dbe633fdf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.475s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:00:44 devstack cinder-volume[73104]: DEBUG oslo_concurrency.processutils [None req-b484f23d-f133-47fc-85b9-255dbe633fdf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:00:44 devstack sudo[74136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 16 15:00:44 devstack sudo[74136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:00:45 devstack sudo[74136]: pam_unix(sudo:session): session closed for user root Apr 16 15:00:45 devstack cinder-volume[73104]: DEBUG oslo_concurrency.processutils [None req-b484f23d-f133-47fc-85b9-255dbe633fdf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.438s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:00:45 devstack cinder-volume[73104]: DEBUG oslo_concurrency.processutils [None req-b484f23d-f133-47fc-85b9-255dbe633fdf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:00:45 devstack sudo[74193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 16 15:00:45 devstack sudo[74193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:00:45 devstack sudo[74193]: pam_unix(sudo:session): session closed for user root Apr 16 15:00:45 devstack cinder-volume[73104]: DEBUG oslo_concurrency.processutils [None req-b484f23d-f133-47fc-85b9-255dbe633fdf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.441s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:00:45 devstack cinder-volume[73104]: INFO cinder.volume.manager [None req-b484f23d-f133-47fc-85b9-255dbe633fdf None None] Driver post RPC initialization completed successfully. Apr 16 15:00:55 devstack cinder-volume[73104]: DEBUG dbcounter [-] [73104] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=73104) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 15:00:55 devstack cinder-volume[73104]: DEBUG dbcounter [-] [73104] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=73104) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 15:02:09 devstack cinder-volume[73104]: DEBUG oslo_service.periodic_task [None req-cadc7e94-4306-4790-98ba-90d0ab3dbe3c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 16 15:02:09 devstack cinder-volume[73104]: DEBUG cinder.volume.drivers.lvm [None req-cadc7e94-4306-4790-98ba-90d0ab3dbe3c None None] Updating volume stats {{(pid=73104) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 16 15:02:09 devstack cinder-volume[73104]: DEBUG oslo_concurrency.processutils [None req-cadc7e94-4306-4790-98ba-90d0ab3dbe3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:02:09 devstack sudo[79102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 16 15:02:09 devstack sudo[79102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:02:10 devstack sudo[79102]: pam_unix(sudo:session): session closed for user root Apr 16 15:02:10 devstack cinder-volume[73104]: DEBUG oslo_concurrency.processutils [None req-cadc7e94-4306-4790-98ba-90d0ab3dbe3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.453s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:02:10 devstack cinder-volume[73104]: DEBUG oslo_concurrency.processutils [None req-cadc7e94-4306-4790-98ba-90d0ab3dbe3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:02:10 devstack sudo[79113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 16 15:02:10 devstack sudo[79113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:02:10 devstack sudo[79113]: pam_unix(sudo:session): session closed for user root Apr 16 15:02:10 devstack cinder-volume[73104]: DEBUG oslo_concurrency.processutils [None req-cadc7e94-4306-4790-98ba-90d0ab3dbe3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.452s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:02:10 devstack cinder-volume[73104]: DEBUG oslo_concurrency.processutils [None req-cadc7e94-4306-4790-98ba-90d0ab3dbe3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:02:10 devstack sudo[79121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 16 15:02:10 devstack sudo[79121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:02:11 devstack sudo[79121]: pam_unix(sudo:session): session closed for user root Apr 16 15:02:11 devstack cinder-volume[73104]: DEBUG oslo_concurrency.processutils [None req-cadc7e94-4306-4790-98ba-90d0ab3dbe3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.434s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:02:11 devstack cinder-volume[73104]: DEBUG oslo_concurrency.processutils [None req-cadc7e94-4306-4790-98ba-90d0ab3dbe3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:02:11 devstack sudo[79132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 16 15:02:11 devstack sudo[79132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:02:11 devstack sudo[79132]: pam_unix(sudo:session): session closed for user root Apr 16 15:02:11 devstack cinder-volume[73104]: DEBUG oslo_concurrency.processutils [None req-cadc7e94-4306-4790-98ba-90d0ab3dbe3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.435s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:02:11 devstack cinder-volume[73104]: DEBUG cinder.manager [None req-cadc7e94-4306-4790-98ba-90d0ab3dbe3c None None] Notifying Schedulers of capabilities ... {{(pid=73104) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:02:55 devstack cinder-volume[73104]: DEBUG dbcounter [-] [73104] Writing DB stats cinder:SELECT=1 {{(pid=73104) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 15:02:55 devstack cinder-volume[73104]: DEBUG dbcounter [-] [73104] Writing DB stats cinder:UPDATE=1 {{(pid=73104) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 15:03:09 devstack cinder-volume[73104]: DEBUG oslo_service.periodic_task [None req-cadc7e94-4306-4790-98ba-90d0ab3dbe3c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73104) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 16 15:03:09 devstack cinder-volume[73104]: DEBUG cinder.volume.drivers.lvm [None req-cadc7e94-4306-4790-98ba-90d0ab3dbe3c None None] Updating volume stats {{(pid=73104) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 16 15:03:09 devstack cinder-volume[73104]: DEBUG oslo_concurrency.processutils [None req-cadc7e94-4306-4790-98ba-90d0ab3dbe3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:03:09 devstack sudo[81003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 16 15:03:09 devstack sudo[81003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:03:10 devstack sudo[81003]: pam_unix(sudo:session): session closed for user root Apr 16 15:03:10 devstack cinder-volume[73104]: DEBUG oslo_concurrency.processutils [None req-cadc7e94-4306-4790-98ba-90d0ab3dbe3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.414s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:03:10 devstack cinder-volume[73104]: DEBUG oslo_concurrency.processutils [None req-cadc7e94-4306-4790-98ba-90d0ab3dbe3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:03:10 devstack sudo[81017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 16 15:03:10 devstack sudo[81017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:03:10 devstack sudo[81017]: pam_unix(sudo:session): session closed for user root Apr 16 15:03:10 devstack cinder-volume[73104]: DEBUG oslo_concurrency.processutils [None req-cadc7e94-4306-4790-98ba-90d0ab3dbe3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.414s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:03:10 devstack cinder-volume[73104]: DEBUG oslo_concurrency.processutils [None req-cadc7e94-4306-4790-98ba-90d0ab3dbe3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:03:10 devstack sudo[81020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 16 15:03:10 devstack sudo[81020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:03:11 devstack sudo[81020]: pam_unix(sudo:session): session closed for user root Apr 16 15:03:11 devstack cinder-volume[73104]: DEBUG oslo_concurrency.processutils [None req-cadc7e94-4306-4790-98ba-90d0ab3dbe3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.418s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:03:11 devstack cinder-volume[73104]: DEBUG oslo_concurrency.processutils [None req-cadc7e94-4306-4790-98ba-90d0ab3dbe3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:03:11 devstack sudo[81023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 16 15:03:11 devstack sudo[81023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:03:11 devstack sudo[81023]: pam_unix(sudo:session): session closed for user root Apr 16 15:03:11 devstack cinder-volume[73104]: DEBUG oslo_concurrency.processutils [None req-cadc7e94-4306-4790-98ba-90d0ab3dbe3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.447s {{(pid=73104) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:03:11 devstack cinder-volume[73104]: DEBUG cinder.manager [None req-cadc7e94-4306-4790-98ba-90d0ab3dbe3c None None] Notifying Schedulers of capabilities ... {{(pid=73104) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:04:02 devstack cinder-volume[73000]: INFO oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] Caught SIGTERM, stopping children Apr 16 15:04:02 devstack cinder-volume[73000]: DEBUG oslo_concurrency.lockutils [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] Acquiring lock "singleton_lock" {{(pid=73000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 16 15:04:02 devstack cinder-volume[73000]: DEBUG oslo_concurrency.lockutils [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] Acquired lock "singleton_lock" {{(pid=73000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 16 15:04:02 devstack cinder-volume[73000]: DEBUG oslo_concurrency.lockutils [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] Releasing lock "singleton_lock" {{(pid=73000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 16 15:04:02 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] Stop services. {{(pid=73000) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 16 15:04:02 devstack cinder-volume[73000]: DEBUG oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] Killing children. {{(pid=73000) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 16 15:04:02 devstack cinder-volume[73000]: INFO oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] Waiting on 1 children to exit Apr 16 15:04:03 devstack cinder-volume[73104]: DEBUG oslo_concurrency.lockutils [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] Acquiring lock "singleton_lock" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 16 15:04:03 devstack cinder-volume[73104]: DEBUG oslo_concurrency.lockutils [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] Acquired lock "singleton_lock" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 16 15:04:03 devstack cinder-volume[73104]: DEBUG oslo_concurrency.lockutils [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] Releasing lock "singleton_lock" {{(pid=73104) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 16 15:04:03 devstack cinder-volume[73104]: WARNING amqp [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 16 15:04:03 devstack cinder-volume[73104]: WARNING amqp [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 16 15:04:03 devstack cinder-volume[73000]: INFO oslo_service.backend._eventlet.service [None req-f8f964c9-f7c8-454d-910d-572bfe077f73 None None] Child 73104 exited with status 0 Apr 16 15:04:04 devstack cinder-volume[82198]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 16 15:04:04 devstack cinder-volume[82198]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 16 15:04:04 devstack cinder-volume[82198]: we strongly recommend against using it for new projects. Apr 16 15:04:04 devstack cinder-volume[82198]: If you are already using Eventlet, we recommend migrating to a different Apr 16 15:04:04 devstack cinder-volume[82198]: framework. For more detail see Apr 16 15:04:04 devstack cinder-volume[82198]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 16 15:04:04 devstack cinder-volume[82198]: import eventlet # noqa Apr 16 15:04:06 devstack cinder-volume[82198]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82198) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 16 15:04:06 devstack cinder-volume[82198]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82198) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 16 15:04:06 devstack cinder-volume[82198]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82198) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 16 15:04:06 devstack cinder-volume[82198]: INFO dbcounter [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] Registered counter for database cinder Apr 16 15:04:06 devstack cinder-volume[82198]: DEBUG oslo_db.sqlalchemy.engines [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82198) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 16 15:04:06 devstack cinder-volume[82198]: DEBUG dbcounter [-] [82198] Writer thread running {{(pid=82198) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 16 15:04:06 devstack cinder-volume[82198]: INFO cinder.rpc [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 16 15:04:06 devstack cinder-volume[82198]: INFO cinder.rpc [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 16 15:04:06 devstack cinder-volume[82198]: DEBUG oslo_db.sqlalchemy.engines [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82198) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 16 15:04:06 devstack cinder-volume[82198]: INFO cinder.volume.manager [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] Determined volume DB was empty at startup. Apr 16 15:04:06 devstack cinder-volume[82198]: DEBUG cinder.volume.manager [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82198) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 16 15:04:06 devstack cinder-volume[82198]: INFO cinder.volume.manager [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 16 15:04:06 devstack cinder-volume[82198]: WARNING stevedore.named [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 16 15:04:06 devstack cinder-volume[82198]: WARNING castellan.key_manager [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 16 15:04:06 devstack cinder-volume[82198]: WARNING cinder.keymgr.conf_key_mgr [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 16 15:04:06 devstack cinder-volume[82198]: INFO cinder.volume.manager [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_db.sqlalchemy.engines [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82198) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 16 15:04:07 devstack cinder-volume[82198]: INFO oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] Starting 1 workers Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] Started child 82313 {{(pid=82198) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] Full set of CONF: {{(pid=82198) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] ******************************************************************************** {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] Configuration options gathered from: {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] ================================================================================ {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] allow_availability_zone_fallback = False {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] allow_compression_on_image_upload = False {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] allowed_direct_url_schemes = [] {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] api_rate_limit = True {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] auth_strategy = keystone {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] backend_availability_zone = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] backend_host = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] backend_name = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] backend_stats_polling_interval = 60 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] backup_api_class = cinder.backup.api.API {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] backup_name_template = backup-%s {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] backup_use_same_host = False {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] backup_use_temp_snapshot = False {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] chap_password = **** {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] chap_username = {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] cinder_internal_tenant_project_id = ca6c1a1bfa094a99859ccde648f759c8 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] cinder_internal_tenant_user_id = 5cd06a2a2ec1478bb3a7de15d57ee19c {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] cluster = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] compression_format = gzip {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] compute_api_class = cinder.compute.nova.API {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] config_dir = [] {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] config_source = [] {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] control_exchange = openstack {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] debug = True {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] default_availability_zone = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] default_group_type = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] default_volume_type = QuobyteHD {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] disk_geometry = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] driver_client_cert = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] driver_client_cert_key = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82313]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] driver_data_namespace = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] driver_ssl_cert_path = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] driver_ssl_cert_verify = False {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] driver_use_ssl = False {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] enable_new_services = True {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] enable_unsupported_driver = False {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] enabled_backends = ['QuobyteHD'] {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] enforce_multipath_for_image_xfer = False {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] filter_function = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] glance_api_insecure = False {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] glance_api_servers = ['http://192.168.122.229/image'] {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] glance_api_ssl_compression = False {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] glance_ca_certificates_file = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] glance_catalog_info = image:glance:publicURL {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] glance_certfile = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] glance_keyfile = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] glance_num_retries = 3 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] glance_request_timeout = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] goodness_function = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] graceful_shutdown_timeout = 5 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] group_api_class = cinder.group.api.API {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] host = devstack {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] image_compress_on_upload = True {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] image_conversion_address_space_limit = 1 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] image_conversion_cpu_limit = 60 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] image_conversion_disable = False {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] image_upload_use_cinder_backend = False {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] image_upload_use_internal_tenant = False {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] image_volume_cache_enabled = False {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] image_volume_cache_max_count = 0 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] image_volume_cache_max_size_gb = 0 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] init_host_max_objects_retrieval = 0 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] instance_format = [instance: %(uuid)s] {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] iscsi_target_flags = {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] iscsi_write_cache = on {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] iser_helper = tgtadm {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] iser_ip_address = 192.168.122.229 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] iser_port = 3260 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] log_color = False {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] log_config_append = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] log_dir = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] log_file = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] log_options = True {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] log_rotate_interval = 1 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] log_rotate_interval_type = days {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] log_rotation_type = none {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] max_age = 0 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] max_logfile_count = 30 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] max_logfile_size_mb = 200 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] max_over_subscription_ratio = 20.0 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] message_reap_interval = 86400 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] message_ttl = 2592000 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] migration_create_volume_timeout_secs = 300 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] monkey_patch = False {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] monkey_patch_modules = [] {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] my_ip = 192.168.122.229 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] no_snapshot_gb_quota = False {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] num_iser_scan_tries = 3 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] num_shell_tries = 3 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] num_volume_device_scan_tries = 3 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] nvmeof_conn_info_version = 1 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] nvmet_ns_id = 10 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] nvmet_port_id = 1 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] osapi_max_limit = 1000 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] osapi_volume_ext_list = [] {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] osapi_volume_listen = 0.0.0.0 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] osapi_volume_listen_port = 8776 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] osapi_volume_use_ssl = False {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] osapi_volume_workers = 2 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] per_volume_size_limit = -1 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] periodic_fuzzy_delay = 60 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] periodic_interval = 60 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] project_id_regex = [0-9a-f\-]+ {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] public_endpoint = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] publish_errors = False {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] quota_backup_gigabytes = 1000 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82313]: INFO cinder.volume.manager [None req-22a19951-3b8e-4a61-8696-a96a093ecdcb None None] Starting volume driver QuobyteDriver (1.1.14) Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] quota_backups = 10 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82313]: DEBUG cinder.volume.drivers.remotefs [None req-22a19951-3b8e-4a61-8696-a96a093ecdcb None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=82313) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] quota_gigabytes = 1000 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] quota_groups = 10 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] quota_snapshots = 10 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] quota_volumes = 10 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] rate_limit_burst = 0 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] rate_limit_except_level = CRITICAL {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] rate_limit_interval = 0 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] reinit_driver_count = 3 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] replication_device = **** {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] report_discard_supported = False {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] report_interval = 120 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] reservation_clean_interval = 86400 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] reservation_expire = 86400 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] reserved_image_namespaces = [] {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] reserved_percentage = 0 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] rpc_response_timeout = 120 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] run_external_periodic_tasks = True {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] scst_target_driver = iscsi {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] scst_target_iqn_name = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] service_down_time = 720 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] shell_completion = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] snapshot_name_template = snapshot-%s {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] split_loggers = False {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] state_path = /opt/stack/data/cinder {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] storage_availability_zone = nova {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] storage_protocol = iSCSI {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] syslog_log_facility = LOG_USER {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] target_helper = lioadm {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] target_ip_address = 192.168.122.229 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] target_port = 3260 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] target_protocol = iscsi {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] target_secondary_ip_addresses = [] {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] trace_flags = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] transfer_api_class = cinder.transfer.api.API {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] transport_url = **** {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] until_refresh = 0 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] use_chap_auth = False {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] use_default_quota_class = True {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] use_journal = False {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] use_json = False {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] use_multipath_for_image_xfer = False {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] use_stderr = False {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] use_syslog = False {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] verify_glance_signatures = enabled {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] volume_api_class = cinder.volume.api.API {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] volume_backend_name = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] volume_clear = zero {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] volume_clear_ionice = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] volume_clear_size = 0 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] volume_copy_bps_limit = 0 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] volume_dd_blocksize = 1M {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] volume_name_template = volume-%s {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] volume_service_inithost_offload = False {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] volume_usage_audit_period = month {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] zoning_mode = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] oslo_concurrency.disable_process_locking = False {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] keystone_authtoken.admin_password = **** {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] keystone_authtoken.admin_token = **** {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] keystone_authtoken.admin_user = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] keystone_authtoken.auth_admin_prefix = {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] keystone_authtoken.auth_port = 35357 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] keystone_authtoken.auth_protocol = https {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] keystone_authtoken.auth_section = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] keystone_authtoken.auth_type = password {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] keystone_authtoken.auth_uri = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] keystone_authtoken.auth_version = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] keystone_authtoken.cache = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] keystone_authtoken.certfile = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] keystone_authtoken.delay_auth_decision = False {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] keystone_authtoken.http_connect_timeout = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] keystone_authtoken.identity_uri = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] keystone_authtoken.include_service_catalog = True {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] keystone_authtoken.insecure = False {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] keystone_authtoken.interface = public {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] keystone_authtoken.keyfile = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] keystone_authtoken.memcache_password = {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] keystone_authtoken.memcache_username = {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] keystone_authtoken.region_name = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] keystone_authtoken.service_token_roles_required = False {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] keystone_authtoken.service_type = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] keystone_authtoken.token_cache_time = 300 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.229/identity {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] cache.backend = dogpile.cache.null {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] cache.backend_argument = **** {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] cache.backend_expiration_time = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] cache.config_prefix = cache.oslo {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] cache.debug_cache_backend = False {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] cache.enable_retry_client = False {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] cache.enable_socket_keepalive = False {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] cache.enabled = False {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] cache.enforce_fips_mode = False {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] cache.expiration_time = 600 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] cache.hashclient_retry_attempts = 2 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] cache.memcache_dead_retry = 300 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] cache.memcache_pool_maxsize = 10 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] cache.memcache_sasl_enabled = False {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] cache.password = **** {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] cache.proxies = [] {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] cache.redis_db = 0 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] cache.redis_sentinel_service_name = mymaster {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] cache.redis_server = localhost:6379 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] cache.retry_attempts = 2 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] cache.retry_delay = 0.0 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] cache.socket_keepalive_count = 1 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] cache.socket_keepalive_idle = 1 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] cache.socket_keepalive_interval = 1 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] cache.socket_timeout = 1.0 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] cache.tls_allowed_ciphers = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] cache.tls_cafile = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] cache.tls_certfile = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] cache.tls_enabled = False {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] cache.tls_keyfile = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] cache.username = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] coordination.backend_url = **** {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] database.asyncio_connection = **** {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] database.asyncio_slave_connection = **** {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] database.backend = sqlalchemy {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] database.connection = **** {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] database.connection_debug = 0 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] database.connection_parameters = {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] database.connection_recycle_time = 3600 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] database.connection_trace = False {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] database.db_inc_retry_interval = True {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] database.db_max_retries = 20 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] database.db_max_retry_interval = 10 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] database.db_retry_interval = 1 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] database.max_overflow = 50 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] database.max_pool_size = 5 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] database.max_retries = 10 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] database.mysql_wsrep_sync_wait = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] database.pool_timeout = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] database.retry_interval = 10 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] database.slave_connection = **** {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] database.sqlite_synchronous = True {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] database.synchronous_reader = True {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] database.use_db_reconnect = False {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] profiler.connection_string = messaging:// {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] profiler.enabled = False {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82313]: DEBUG cinder.volume.drivers.quobyte [None req-22a19951-3b8e-4a61-8696-a96a093ecdcb None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=82313) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] profiler.es_doc_type = notification {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] profiler.es_scroll_size = 10000 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] profiler.es_scroll_time = 2m {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82313]: WARNING cinder.volume.drivers.quobyte [None req-22a19951-3b8e-4a61-8696-a96a093ecdcb None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] profiler.filter_error_trace = False {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82313]: WARNING cinder.volume.drivers.quobyte [None req-22a19951-3b8e-4a61-8696-a96a093ecdcb None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] profiler.hmac_keys = **** {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] profiler.sentinel_service_name = mymaster {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] profiler.socket_timeout = 0.1 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] profiler.trace_requests = False {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] profiler.trace_sqlalchemy = False {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] profiler_jaeger.process_tags = {} {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] profiler_jaeger.service_name_prefix = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82313]: DEBUG oslo_concurrency.processutils [None req-22a19951-3b8e-4a61-8696-a96a093ecdcb None None] Running cmd (subprocess): mount.quobyte {{(pid=82313) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] profiler_otlp.service_name_prefix = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] oslo_policy.enforce_new_defaults = False {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: WARNING oslo_config.cfg [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] oslo_policy.enforce_scope = False {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] oslo_policy.policy_default_rule = default {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] oslo_policy.policy_file = policy.yaml {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] oslo_policy.remote_timeout = 60.0 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] privsep_osbrick.group = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] privsep_osbrick.helper_command = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] privsep_osbrick.user = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] cinder_sys_admin.group = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] cinder_sys_admin.helper_command = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] cinder_sys_admin.user = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] service_user.auth_section = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] service_user.auth_type = password {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] service_user.cafile = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] service_user.certfile = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] service_user.collect_timing = False {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] service_user.insecure = False {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] service_user.keyfile = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] service_user.send_service_user_token = True {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] service_user.split_loggers = False {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] service_user.timeout = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] glance.auth_section = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] glance.auth_type = password {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] glance.certfile = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] glance.collect_timing = False {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] glance.insecure = False {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] glance.keyfile = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] glance.region_name = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] glance.split_loggers = False {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] glance.timeout = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] backend_defaults.backend_availability_zone = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] backend_defaults.chap_password = **** {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] backend_defaults.chap_username = {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] backend_defaults.disk_geometry = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] backend_defaults.driver_client_cert = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] backend_defaults.driver_client_cert_key = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] backend_defaults.driver_data_namespace = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] backend_defaults.driver_use_ssl = False {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] backend_defaults.enable_unsupported_driver = False {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] backend_defaults.extra_capabilities = {} {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] backend_defaults.filter_function = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] backend_defaults.goodness_function = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] backend_defaults.iscsi_target_flags = {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] backend_defaults.iscsi_write_cache = on {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] backend_defaults.iser_helper = tgtadm {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] backend_defaults.iser_ip_address = 192.168.122.229 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] backend_defaults.iser_port = 3260 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] backend_defaults.nas_host = {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] backend_defaults.nas_login = admin {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] backend_defaults.nas_mount_options = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] backend_defaults.nas_password = **** {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] backend_defaults.nas_private_key = {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] backend_defaults.nas_share_path = {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] backend_defaults.nas_ssh_port = 22 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] backend_defaults.num_shell_tries = 3 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] backend_defaults.nvmet_port_id = 1 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] backend_defaults.quobyte_client_cfg = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] backend_defaults.quobyte_volume_url = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] backend_defaults.replication_device = **** {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] backend_defaults.report_discard_supported = False {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] backend_defaults.reserved_percentage = 0 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] backend_defaults.scst_target_driver = iscsi {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] backend_defaults.scst_target_iqn_name = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] backend_defaults.storage_protocol = iSCSI {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] backend_defaults.target_helper = tgtadm {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] backend_defaults.target_ip_address = 192.168.122.229 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] backend_defaults.target_port = 3260 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] backend_defaults.target_protocol = iscsi {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] backend_defaults.trace_flags = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] backend_defaults.unique_fqdn_network = True {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] backend_defaults.use_chap_auth = False {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] backend_defaults.volume_backend_name = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] backend_defaults.volume_clear = zero {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] backend_defaults.volume_clear_ionice = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] backend_defaults.volume_clear_size = 0 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] oslo_reports.file_event_handler = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] oslo_reports.log_dir = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] QuobyteHD.backend_availability_zone = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] QuobyteHD.backend_host = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] QuobyteHD.chap_password = **** {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] QuobyteHD.chap_username = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] QuobyteHD.chiscsi_conf = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] QuobyteHD.disk_geometry = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] QuobyteHD.driver_client_cert = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] QuobyteHD.driver_client_cert_key = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] QuobyteHD.driver_data_namespace = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] QuobyteHD.driver_use_ssl = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] QuobyteHD.extra_capabilities = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] QuobyteHD.filter_function = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] QuobyteHD.goodness_function = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] QuobyteHD.iscsi_target_flags = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] QuobyteHD.iscsi_write_cache = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] QuobyteHD.iser_helper = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] QuobyteHD.iser_ip_address = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] QuobyteHD.iser_port = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] QuobyteHD.iser_target_prefix = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] QuobyteHD.nas_host = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] QuobyteHD.nas_login = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] QuobyteHD.nas_mount_options = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] QuobyteHD.nas_password = **** {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] QuobyteHD.nas_private_key = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] QuobyteHD.nas_share_path = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] QuobyteHD.nas_ssh_port = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] QuobyteHD.num_shell_tries = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] QuobyteHD.nvmet_ns_id = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] QuobyteHD.nvmet_port_id = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] QuobyteHD.replication_device = **** {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] QuobyteHD.report_discard_supported = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] QuobyteHD.reserved_percentage = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] QuobyteHD.scst_target_driver = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] QuobyteHD.storage_protocol = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] QuobyteHD.target_helper = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] QuobyteHD.target_ip_address = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] QuobyteHD.target_port = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] QuobyteHD.target_prefix = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] QuobyteHD.target_protocol = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] QuobyteHD.trace_flags = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] QuobyteHD.unique_fqdn_network = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] QuobyteHD.use_chap_auth = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] QuobyteHD.volume_clear = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] QuobyteHD.volume_clear_ionice = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] QuobyteHD.volume_clear_size = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack quobyte-client[82316]: Reading configuration file: /etc/quobyte/client.cfg Apr 16 15:04:07 devstack quobyte-client[82316]: Invalid parameters found, error: missing mount point. Apr 16 15:04:07 devstack quobyte-client[82316]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 16 15:04:07 devstack quobyte-client[82316]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] QuobyteHD.volumes_dir = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82313]: DEBUG oslo_concurrency.processutils [None req-22a19951-3b8e-4a61-8696-a96a093ecdcb None None] CMD "mount.quobyte" returned: 1 in 0.077s {{(pid=82313) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82313]: DEBUG oslo_concurrency.lockutils [None req-22a19951-3b8e-4a61-8696-a96a093ecdcb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82313) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82313]: DEBUG oslo_concurrency.lockutils [None req-22a19951-3b8e-4a61-8696-a96a093ecdcb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82313) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:04:07 devstack cinder-volume[82313]: DEBUG cinder.volume.drivers.quobyte [None req-22a19951-3b8e-4a61-8696-a96a093ecdcb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82313]: INFO cinder.volume.drivers.quobyte [None req-22a19951-3b8e-4a61-8696-a96a093ecdcb None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 ... Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82313]: DEBUG oslo_concurrency.processutils [None req-22a19951-3b8e-4a61-8696-a96a093ecdcb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e -c /etc/quobyte/client-cinder.cfg {{(pid=82313) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] oslo_messaging_rabbit.ssl = False {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] oslo_messaging_rabbit.ssl_version = {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] oslo_messaging_notifications.driver = [] {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] oslo_messaging_notifications.retry = -1 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] oslo_messaging_notifications.transport_url = **** {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] key_manager.fixed_key = **** {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] barbican.barbican_api_version = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] barbican.barbican_endpoint = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] barbican.barbican_endpoint_type = public {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] barbican.barbican_region_name = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] barbican.cafile = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] barbican.certfile = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] barbican.collect_timing = False {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] barbican.insecure = False {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] barbican.keyfile = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] barbican.number_of_retries = 60 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] barbican.retry_delay = 1 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] barbican.send_service_user_token = False {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] barbican.split_loggers = False {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack sudo[82317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e -c /etc/quobyte/client-cinder.cfg Apr 16 15:04:07 devstack sudo[82317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] barbican.timeout = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] barbican.verify_ssl = True {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] barbican.verify_ssl_path = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] barbican_service_user.auth_section = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] barbican_service_user.auth_type = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] barbican_service_user.cafile = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] barbican_service_user.certfile = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] barbican_service_user.collect_timing = False {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] barbican_service_user.insecure = False {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] barbican_service_user.keyfile = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] barbican_service_user.split_loggers = False {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] barbican_service_user.timeout = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] vault.approle_role_id = **** {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] vault.approle_secret_id = **** {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] vault.kv_mountpoint = secret {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] vault.kv_path = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] vault.kv_version = 2 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] vault.namespace = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] vault.root_token_id = **** {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] vault.ssl_ca_crt_file = None {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] vault.timeout = 60.0 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] vault.use_ssl = False {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:07 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] ******************************************************************************** {{(pid=82198) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 16 15:04:07 devstack sudo[82317]: pam_unix(sudo:session): session closed for user root Apr 16 15:04:07 devstack cinder-volume[82313]: DEBUG oslo_concurrency.processutils [None req-22a19951-3b8e-4a61-8696-a96a093ecdcb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.503s {{(pid=82313) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:04:07 devstack cinder-volume[82313]: INFO cinder.volume.drivers.quobyte [None req-22a19951-3b8e-4a61-8696-a96a093ecdcb None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 succeeded Apr 16 15:04:07 devstack cinder-volume[82313]: DEBUG cinder.volume.drivers.quobyte [None req-22a19951-3b8e-4a61-8696-a96a093ecdcb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:04:07 devstack cinder-volume[82313]: DEBUG oslo_concurrency.lockutils [None req-22a19951-3b8e-4a61-8696-a96a093ecdcb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.510s {{(pid=82313) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:04:07 devstack cinder-volume[82313]: DEBUG oslo_concurrency.processutils [None req-22a19951-3b8e-4a61-8696-a96a093ecdcb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82313) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:04:07 devstack sudo[82386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:04:07 devstack sudo[82386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:04:08 devstack sudo[82386]: pam_unix(sudo:session): session closed for user root Apr 16 15:04:08 devstack cinder-volume[82313]: DEBUG oslo_concurrency.processutils [None req-22a19951-3b8e-4a61-8696-a96a093ecdcb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.392s {{(pid=82313) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:04:08 devstack cinder-volume[82313]: INFO cinder.volume.driver [None req-22a19951-3b8e-4a61-8696-a96a093ecdcb None None] Driver hasn't implemented _init_vendor_properties() Apr 16 15:04:08 devstack cinder-volume[82313]: DEBUG cinder.volume.driver [None req-22a19951-3b8e-4a61-8696-a96a093ecdcb None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7327880859375, 'free_capacity_gb': 1775.7327880859375, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82313) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 16 15:04:08 devstack cinder-volume[82313]: DEBUG oslo_db.sqlalchemy.engines [None req-22a19951-3b8e-4a61-8696-a96a093ecdcb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82313) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 16 15:04:08 devstack cinder-volume[82313]: DEBUG dbcounter [-] [82313] Writer thread running {{(pid=82313) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 16 15:04:08 devstack cinder-volume[82313]: DEBUG cinder.db.sqlalchemy.api [None req-22a19951-3b8e-4a61-8696-a96a093ecdcb None None] Building query based on filter {{(pid=82313) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 16 15:04:08 devstack cinder-volume[82313]: DEBUG cinder.image.image_utils [None req-22a19951-3b8e-4a61-8696-a96a093ecdcb None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82313) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 16 15:04:08 devstack cinder-volume[82313]: INFO cinder.keymgr.migration [None req-97c15e72-00e3-46eb-b1f3-6e75bde687ef None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 16 15:04:08 devstack cinder-volume[82313]: DEBUG oslo_concurrency.lockutils [None req-22a19951-3b8e-4a61-8696-a96a093ecdcb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82313) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:04:08 devstack cinder-volume[82313]: DEBUG oslo_concurrency.lockutils [None req-22a19951-3b8e-4a61-8696-a96a093ecdcb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82313) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:04:08 devstack cinder-volume[82313]: DEBUG cinder.volume.drivers.quobyte [None req-22a19951-3b8e-4a61-8696-a96a093ecdcb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:04:08 devstack cinder-volume[82313]: DEBUG cinder.volume.drivers.quobyte [None req-22a19951-3b8e-4a61-8696-a96a093ecdcb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:04:08 devstack cinder-volume[82313]: DEBUG oslo_concurrency.lockutils [None req-22a19951-3b8e-4a61-8696-a96a093ecdcb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82313) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:04:08 devstack cinder-volume[82313]: DEBUG oslo_concurrency.processutils [None req-22a19951-3b8e-4a61-8696-a96a093ecdcb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82313) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:04:08 devstack sudo[82389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:04:08 devstack sudo[82389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:04:08 devstack sudo[82389]: pam_unix(sudo:session): session closed for user root Apr 16 15:04:08 devstack cinder-volume[82313]: DEBUG oslo_concurrency.processutils [None req-22a19951-3b8e-4a61-8696-a96a093ecdcb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.372s {{(pid=82313) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:04:08 devstack cinder-volume[82313]: DEBUG cinder.manager [None req-22a19951-3b8e-4a61-8696-a96a093ecdcb None None] Notifying Schedulers of capabilities ... {{(pid=82313) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:04:08 devstack cinder-volume[82313]: INFO cinder.volume.manager [None req-22a19951-3b8e-4a61-8696-a96a093ecdcb None None] Driver initialization completed successfully. Apr 16 15:04:08 devstack cinder-volume[82313]: INFO cinder.manager [None req-22a19951-3b8e-4a61-8696-a96a093ecdcb None None] Initiating service 3 cleanup Apr 16 15:04:08 devstack cinder-volume[82313]: INFO cinder.manager [None req-22a19951-3b8e-4a61-8696-a96a093ecdcb None None] Service 3 cleanup completed. Apr 16 15:04:08 devstack cinder-volume[82313]: DEBUG cinder.service [None req-22a19951-3b8e-4a61-8696-a96a093ecdcb None None] Creating RPC server for service cinder-volume {{(pid=82313) start /opt/stack/cinder/cinder/service.py:231}} Apr 16 15:04:08 devstack cinder-volume[82313]: DEBUG cinder.service [None req-22a19951-3b8e-4a61-8696-a96a093ecdcb None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82313) start /opt/stack/cinder/cinder/service.py:237}} Apr 16 15:04:08 devstack cinder-volume[82313]: INFO cinder.volume.manager [None req-22a19951-3b8e-4a61-8696-a96a093ecdcb None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 16 15:04:08 devstack cinder-volume[82313]: DEBUG oslo_concurrency.lockutils [None req-22a19951-3b8e-4a61-8696-a96a093ecdcb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82313) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:04:08 devstack cinder-volume[82313]: DEBUG oslo_concurrency.lockutils [None req-22a19951-3b8e-4a61-8696-a96a093ecdcb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82313) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:04:08 devstack cinder-volume[82313]: DEBUG cinder.volume.drivers.quobyte [None req-22a19951-3b8e-4a61-8696-a96a093ecdcb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82313) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:04:08 devstack cinder-volume[82313]: DEBUG cinder.volume.drivers.quobyte [None req-22a19951-3b8e-4a61-8696-a96a093ecdcb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82313) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:04:08 devstack cinder-volume[82313]: DEBUG oslo_concurrency.lockutils [None req-22a19951-3b8e-4a61-8696-a96a093ecdcb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82313) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:04:08 devstack cinder-volume[82313]: DEBUG oslo_concurrency.processutils [None req-22a19951-3b8e-4a61-8696-a96a093ecdcb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82313) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:04:08 devstack sudo[82394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:04:08 devstack sudo[82394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:04:09 devstack sudo[82394]: pam_unix(sudo:session): session closed for user root Apr 16 15:04:09 devstack cinder-volume[82313]: DEBUG oslo_concurrency.processutils [None req-22a19951-3b8e-4a61-8696-a96a093ecdcb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.506s {{(pid=82313) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:04:09 devstack cinder-volume[82313]: INFO cinder.volume.manager [None req-22a19951-3b8e-4a61-8696-a96a093ecdcb None None] Driver post RPC initialization completed successfully. Apr 16 15:04:11 devstack cinder-volume[82198]: INFO oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] Caught SIGTERM, stopping children Apr 16 15:04:11 devstack cinder-volume[82198]: DEBUG oslo_concurrency.lockutils [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] Acquiring lock "singleton_lock" {{(pid=82198) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 16 15:04:11 devstack cinder-volume[82198]: DEBUG oslo_concurrency.lockutils [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] Acquired lock "singleton_lock" {{(pid=82198) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 16 15:04:11 devstack cinder-volume[82198]: DEBUG oslo_concurrency.lockutils [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] Releasing lock "singleton_lock" {{(pid=82198) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 16 15:04:11 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] Stop services. {{(pid=82198) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 16 15:04:11 devstack cinder-volume[82198]: DEBUG oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] Killing children. {{(pid=82198) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 16 15:04:11 devstack cinder-volume[82198]: INFO oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] Waiting on 1 children to exit Apr 16 15:04:12 devstack cinder-volume[82313]: DEBUG oslo_concurrency.lockutils [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] Acquiring lock "singleton_lock" {{(pid=82313) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 16 15:04:12 devstack cinder-volume[82313]: DEBUG oslo_concurrency.lockutils [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] Acquired lock "singleton_lock" {{(pid=82313) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 16 15:04:12 devstack cinder-volume[82313]: DEBUG oslo_concurrency.lockutils [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] Releasing lock "singleton_lock" {{(pid=82313) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 16 15:04:12 devstack cinder-volume[82313]: WARNING amqp [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 16 15:04:12 devstack cinder-volume[82313]: WARNING amqp [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 16 15:04:12 devstack cinder-volume[82198]: INFO oslo_service.backend._eventlet.service [None req-a55c00de-ec84-40ae-9157-0af75e009052 None None] Child 82313 exited with status 0 Apr 16 15:04:13 devstack cinder-volume[82535]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 16 15:04:13 devstack cinder-volume[82535]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 16 15:04:13 devstack cinder-volume[82535]: we strongly recommend against using it for new projects. Apr 16 15:04:13 devstack cinder-volume[82535]: If you are already using Eventlet, we recommend migrating to a different Apr 16 15:04:13 devstack cinder-volume[82535]: framework. For more detail see Apr 16 15:04:13 devstack cinder-volume[82535]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 16 15:04:13 devstack cinder-volume[82535]: import eventlet # noqa Apr 16 15:04:14 devstack cinder-volume[82535]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 16 15:04:14 devstack cinder-volume[82535]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 16 15:04:14 devstack cinder-volume[82535]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82535) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 16 15:04:15 devstack cinder-volume[82535]: INFO dbcounter [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] Registered counter for database cinder Apr 16 15:04:15 devstack cinder-volume[82535]: DEBUG oslo_db.sqlalchemy.engines [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82535) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 16 15:04:15 devstack cinder-volume[82535]: DEBUG dbcounter [-] [82535] Writer thread running {{(pid=82535) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 16 15:04:15 devstack cinder-volume[82535]: INFO cinder.rpc [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 16 15:04:15 devstack cinder-volume[82535]: INFO cinder.rpc [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 16 15:04:15 devstack cinder-volume[82535]: DEBUG oslo_db.sqlalchemy.engines [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82535) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 16 15:04:16 devstack cinder-volume[82535]: INFO cinder.volume.manager [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] Determined volume DB was empty at startup. Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG cinder.volume.manager [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82535) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 16 15:04:16 devstack cinder-volume[82535]: WARNING stevedore.named [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 16 15:04:16 devstack cinder-volume[82535]: WARNING castellan.key_manager [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 16 15:04:16 devstack cinder-volume[82535]: WARNING cinder.keymgr.conf_key_mgr [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 16 15:04:16 devstack cinder-volume[82535]: INFO cinder.volume.manager [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_db.sqlalchemy.engines [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82535) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 16 15:04:16 devstack cinder-volume[82535]: INFO oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] Starting 1 workers Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] Started child 82756 {{(pid=82535) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] Full set of CONF: {{(pid=82535) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] ******************************************************************************** {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] Configuration options gathered from: {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] ================================================================================ {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] allow_availability_zone_fallback = False {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] allow_compression_on_image_upload = False {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] allowed_direct_url_schemes = [] {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] api_rate_limit = True {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] auth_strategy = keystone {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] backend_availability_zone = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] backend_host = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] backend_name = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] backend_stats_polling_interval = 60 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] backup_api_class = cinder.backup.api.API {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] backup_name_template = backup-%s {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] backup_use_same_host = False {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] backup_use_temp_snapshot = False {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] chap_password = **** {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] chap_username = {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] cinder_internal_tenant_project_id = ca6c1a1bfa094a99859ccde648f759c8 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] cinder_internal_tenant_user_id = 5cd06a2a2ec1478bb3a7de15d57ee19c {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] cluster = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] compression_format = gzip {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] compute_api_class = cinder.compute.nova.API {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] config_dir = [] {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] config_source = [] {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] control_exchange = openstack {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] debug = True {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] default_availability_zone = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] default_group_type = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82756]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] default_volume_type = QuobyteHD {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] disk_geometry = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] driver_client_cert = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] driver_client_cert_key = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] driver_data_namespace = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] driver_ssl_cert_path = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] driver_ssl_cert_verify = False {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] driver_use_ssl = False {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] enable_new_services = True {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] enable_unsupported_driver = False {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] enabled_backends = ['QuobyteHD'] {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] enforce_multipath_for_image_xfer = False {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] filter_function = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] glance_api_insecure = False {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] glance_api_servers = ['http://192.168.122.229/image'] {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] glance_api_ssl_compression = False {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] glance_ca_certificates_file = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] glance_catalog_info = image:glance:publicURL {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] glance_certfile = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] glance_keyfile = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] glance_num_retries = 3 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] glance_request_timeout = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] goodness_function = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] graceful_shutdown_timeout = 5 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] group_api_class = cinder.group.api.API {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] host = devstack {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] image_compress_on_upload = True {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] image_conversion_address_space_limit = 1 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] image_conversion_cpu_limit = 60 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] image_conversion_disable = False {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] image_upload_use_cinder_backend = False {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] image_upload_use_internal_tenant = False {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] image_volume_cache_enabled = False {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] image_volume_cache_max_count = 0 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] image_volume_cache_max_size_gb = 0 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] init_host_max_objects_retrieval = 0 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] instance_format = [instance: %(uuid)s] {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] iscsi_target_flags = {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] iscsi_write_cache = on {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] iser_helper = tgtadm {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] iser_ip_address = 192.168.122.229 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] iser_port = 3260 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] log_color = False {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] log_config_append = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] log_dir = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] log_file = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] log_options = True {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] log_rotate_interval = 1 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] log_rotate_interval_type = days {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] log_rotation_type = none {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] max_age = 0 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] max_logfile_count = 30 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] max_logfile_size_mb = 200 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] max_over_subscription_ratio = 20.0 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] message_reap_interval = 86400 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] message_ttl = 2592000 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] migration_create_volume_timeout_secs = 300 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] monkey_patch = False {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] monkey_patch_modules = [] {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] my_ip = 192.168.122.229 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] no_snapshot_gb_quota = False {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] num_iser_scan_tries = 3 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] num_shell_tries = 3 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] num_volume_device_scan_tries = 3 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] nvmeof_conn_info_version = 1 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] nvmet_ns_id = 10 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] nvmet_port_id = 1 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] osapi_max_limit = 1000 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] osapi_volume_ext_list = [] {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] osapi_volume_listen = 0.0.0.0 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] osapi_volume_listen_port = 8776 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] osapi_volume_use_ssl = False {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] osapi_volume_workers = 2 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] per_volume_size_limit = -1 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] periodic_fuzzy_delay = 60 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] periodic_interval = 60 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] project_id_regex = [0-9a-f\-]+ {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] public_endpoint = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] publish_errors = False {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] quota_backup_gigabytes = 1000 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] quota_backups = 10 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] quota_gigabytes = 1000 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] quota_groups = 10 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] quota_snapshots = 10 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] quota_volumes = 10 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] rate_limit_burst = 0 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] rate_limit_except_level = CRITICAL {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] rate_limit_interval = 0 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] reinit_driver_count = 3 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] replication_device = **** {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] report_discard_supported = False {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] report_interval = 120 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] reservation_clean_interval = 86400 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] reservation_expire = 86400 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] reserved_image_namespaces = [] {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] reserved_percentage = 0 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] rpc_response_timeout = 120 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] run_external_periodic_tasks = True {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] scst_target_driver = iscsi {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] scst_target_iqn_name = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] service_down_time = 720 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] shell_completion = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] snapshot_name_template = snapshot-%s {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] split_loggers = False {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] state_path = /opt/stack/data/cinder {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] storage_availability_zone = nova {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] storage_protocol = iSCSI {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] syslog_log_facility = LOG_USER {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] target_helper = lioadm {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] target_ip_address = 192.168.122.229 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] target_port = 3260 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] target_protocol = iscsi {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] target_secondary_ip_addresses = [] {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] trace_flags = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] transfer_api_class = cinder.transfer.api.API {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] transport_url = **** {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] until_refresh = 0 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] use_chap_auth = False {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] use_default_quota_class = True {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] use_journal = False {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] use_json = False {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] use_multipath_for_image_xfer = False {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] use_stderr = False {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] use_syslog = False {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-7f334516-6839-4791-9cec-a6b885cb618c None None] Starting volume driver QuobyteDriver (1.1.14) Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] verify_glance_signatures = enabled {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] volume_api_class = cinder.volume.api.API {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] volume_backend_name = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] volume_clear = zero {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] volume_clear_ionice = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] volume_clear_size = 0 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-7f334516-6839-4791-9cec-a6b885cb618c None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=82756) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] volume_copy_bps_limit = 0 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] volume_dd_blocksize = 1M {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] volume_name_template = volume-%s {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] volume_service_inithost_offload = False {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] volume_usage_audit_period = month {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] zoning_mode = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] oslo_concurrency.disable_process_locking = False {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] keystone_authtoken.admin_password = **** {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] keystone_authtoken.admin_token = **** {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] keystone_authtoken.admin_user = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] keystone_authtoken.auth_admin_prefix = {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] keystone_authtoken.auth_port = 35357 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] keystone_authtoken.auth_protocol = https {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] keystone_authtoken.auth_section = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] keystone_authtoken.auth_type = password {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] keystone_authtoken.auth_uri = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] keystone_authtoken.auth_version = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] keystone_authtoken.cache = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] keystone_authtoken.certfile = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] keystone_authtoken.delay_auth_decision = False {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] keystone_authtoken.http_connect_timeout = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] keystone_authtoken.identity_uri = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] keystone_authtoken.include_service_catalog = True {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] keystone_authtoken.insecure = False {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] keystone_authtoken.interface = public {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] keystone_authtoken.keyfile = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] keystone_authtoken.memcache_password = {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] keystone_authtoken.memcache_username = {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] keystone_authtoken.region_name = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] keystone_authtoken.service_token_roles_required = False {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] keystone_authtoken.service_type = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] keystone_authtoken.token_cache_time = 300 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.229/identity {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] cache.backend = dogpile.cache.null {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] cache.backend_argument = **** {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] cache.backend_expiration_time = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] cache.config_prefix = cache.oslo {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] cache.debug_cache_backend = False {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] cache.enable_retry_client = False {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] cache.enable_socket_keepalive = False {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] cache.enabled = False {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] cache.enforce_fips_mode = False {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] cache.expiration_time = 600 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] cache.hashclient_retry_attempts = 2 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] cache.memcache_dead_retry = 300 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] cache.memcache_pool_maxsize = 10 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] cache.memcache_sasl_enabled = False {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] cache.password = **** {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] cache.proxies = [] {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] cache.redis_db = 0 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] cache.redis_sentinel_service_name = mymaster {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] cache.redis_server = localhost:6379 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] cache.retry_attempts = 2 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] cache.retry_delay = 0.0 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] cache.socket_keepalive_count = 1 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] cache.socket_keepalive_idle = 1 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] cache.socket_keepalive_interval = 1 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] cache.socket_timeout = 1.0 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] cache.tls_allowed_ciphers = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] cache.tls_cafile = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] cache.tls_certfile = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] cache.tls_enabled = False {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] cache.tls_keyfile = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] cache.username = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] coordination.backend_url = **** {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] database.asyncio_connection = **** {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] database.asyncio_slave_connection = **** {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] database.backend = sqlalchemy {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] database.connection = **** {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] database.connection_debug = 0 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] database.connection_parameters = {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] database.connection_recycle_time = 3600 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] database.connection_trace = False {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] database.db_inc_retry_interval = True {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] database.db_max_retries = 20 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] database.db_max_retry_interval = 10 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] database.db_retry_interval = 1 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] database.max_overflow = 50 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] database.max_pool_size = 5 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] database.max_retries = 10 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] database.mysql_wsrep_sync_wait = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] database.pool_timeout = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] database.retry_interval = 10 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] database.slave_connection = **** {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] database.sqlite_synchronous = True {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] database.synchronous_reader = True {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] database.use_db_reconnect = False {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] profiler.connection_string = messaging:// {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] profiler.enabled = False {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] profiler.es_doc_type = notification {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] profiler.es_scroll_size = 10000 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] profiler.es_scroll_time = 2m {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] profiler.filter_error_trace = False {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] profiler.hmac_keys = **** {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] profiler.sentinel_service_name = mymaster {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] profiler.socket_timeout = 0.1 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] profiler.trace_requests = False {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] profiler.trace_sqlalchemy = False {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] profiler_jaeger.process_tags = {} {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] profiler_jaeger.service_name_prefix = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] profiler_otlp.service_name_prefix = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] oslo_policy.enforce_new_defaults = False {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: WARNING oslo_config.cfg [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] oslo_policy.enforce_scope = False {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] oslo_policy.policy_default_rule = default {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] oslo_policy.policy_file = policy.yaml {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] oslo_policy.remote_timeout = 60.0 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] privsep_osbrick.group = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] privsep_osbrick.helper_command = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] privsep_osbrick.user = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] cinder_sys_admin.group = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] cinder_sys_admin.helper_command = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] cinder_sys_admin.user = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] service_user.auth_section = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] service_user.auth_type = password {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] service_user.cafile = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] service_user.certfile = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] service_user.collect_timing = False {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] service_user.insecure = False {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] service_user.keyfile = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] service_user.send_service_user_token = True {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] service_user.split_loggers = False {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] service_user.timeout = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] glance.auth_section = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] glance.auth_type = password {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] glance.certfile = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] glance.collect_timing = False {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] glance.insecure = False {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] glance.keyfile = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] glance.region_name = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] glance.split_loggers = False {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] glance.timeout = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] backend_defaults.backend_availability_zone = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] backend_defaults.chap_password = **** {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] backend_defaults.chap_username = {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] backend_defaults.disk_geometry = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] backend_defaults.driver_client_cert = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] backend_defaults.driver_client_cert_key = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] backend_defaults.driver_data_namespace = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] backend_defaults.driver_use_ssl = False {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] backend_defaults.enable_unsupported_driver = False {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] backend_defaults.extra_capabilities = {} {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] backend_defaults.filter_function = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] backend_defaults.goodness_function = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] backend_defaults.iscsi_target_flags = {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] backend_defaults.iscsi_write_cache = on {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] backend_defaults.iser_helper = tgtadm {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] backend_defaults.iser_ip_address = 192.168.122.229 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] backend_defaults.iser_port = 3260 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] backend_defaults.nas_host = {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] backend_defaults.nas_login = admin {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] backend_defaults.nas_mount_options = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] backend_defaults.nas_password = **** {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] backend_defaults.nas_private_key = {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] backend_defaults.nas_share_path = {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] backend_defaults.nas_ssh_port = 22 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] backend_defaults.num_shell_tries = 3 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] backend_defaults.nvmet_port_id = 1 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] backend_defaults.quobyte_client_cfg = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] backend_defaults.quobyte_volume_url = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] backend_defaults.replication_device = **** {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] backend_defaults.report_discard_supported = False {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] backend_defaults.reserved_percentage = 0 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] backend_defaults.scst_target_driver = iscsi {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] backend_defaults.scst_target_iqn_name = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] backend_defaults.storage_protocol = iSCSI {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] backend_defaults.target_helper = tgtadm {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] backend_defaults.target_ip_address = 192.168.122.229 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] backend_defaults.target_port = 3260 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] backend_defaults.target_protocol = iscsi {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-7f334516-6839-4791-9cec-a6b885cb618c None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=82756) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 16 15:04:16 devstack cinder-volume[82756]: WARNING cinder.volume.drivers.quobyte [None req-7f334516-6839-4791-9cec-a6b885cb618c None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 16 15:04:16 devstack cinder-volume[82756]: WARNING cinder.volume.drivers.quobyte [None req-7f334516-6839-4791-9cec-a6b885cb618c None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] backend_defaults.trace_flags = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-7f334516-6839-4791-9cec-a6b885cb618c None None] Running cmd (subprocess): mount.quobyte {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] backend_defaults.unique_fqdn_network = True {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] backend_defaults.use_chap_auth = False {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] backend_defaults.volume_backend_name = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] backend_defaults.volume_clear = zero {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] backend_defaults.volume_clear_ionice = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] backend_defaults.volume_clear_size = 0 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] oslo_reports.file_event_handler = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] oslo_reports.log_dir = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] QuobyteHD.backend_availability_zone = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] QuobyteHD.backend_host = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] QuobyteHD.chap_password = **** {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] QuobyteHD.chap_username = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] QuobyteHD.chiscsi_conf = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] QuobyteHD.disk_geometry = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] QuobyteHD.driver_client_cert = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] QuobyteHD.driver_client_cert_key = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] QuobyteHD.driver_data_namespace = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] QuobyteHD.driver_use_ssl = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] QuobyteHD.extra_capabilities = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] QuobyteHD.filter_function = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] QuobyteHD.goodness_function = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] QuobyteHD.iscsi_target_flags = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] QuobyteHD.iscsi_write_cache = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] QuobyteHD.iser_helper = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] QuobyteHD.iser_ip_address = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] QuobyteHD.iser_port = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] QuobyteHD.iser_target_prefix = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] QuobyteHD.nas_host = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] QuobyteHD.nas_login = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] QuobyteHD.nas_mount_options = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] QuobyteHD.nas_password = **** {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] QuobyteHD.nas_private_key = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] QuobyteHD.nas_share_path = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] QuobyteHD.nas_ssh_port = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] QuobyteHD.num_shell_tries = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] QuobyteHD.nvmet_ns_id = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] QuobyteHD.nvmet_port_id = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] QuobyteHD.replication_device = **** {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] QuobyteHD.report_discard_supported = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] QuobyteHD.reserved_percentage = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] QuobyteHD.scst_target_driver = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] QuobyteHD.storage_protocol = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] QuobyteHD.target_helper = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] QuobyteHD.target_ip_address = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] QuobyteHD.target_port = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] QuobyteHD.target_prefix = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] QuobyteHD.target_protocol = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] QuobyteHD.trace_flags = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] QuobyteHD.unique_fqdn_network = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] QuobyteHD.use_chap_auth = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] QuobyteHD.volume_clear = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] QuobyteHD.volume_clear_ionice = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] QuobyteHD.volume_clear_size = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] QuobyteHD.volumes_dir = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] oslo_messaging_rabbit.ssl = False {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] oslo_messaging_rabbit.ssl_version = {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] oslo_messaging_notifications.driver = [] {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] oslo_messaging_notifications.retry = -1 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] oslo_messaging_notifications.transport_url = **** {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] key_manager.fixed_key = **** {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack quobyte-client[82760]: Reading configuration file: /etc/quobyte/client.cfg Apr 16 15:04:16 devstack quobyte-client[82760]: Invalid parameters found, error: missing mount point. Apr 16 15:04:16 devstack quobyte-client[82760]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 16 15:04:16 devstack quobyte-client[82760]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] barbican.barbican_api_version = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] barbican.barbican_endpoint = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] barbican.barbican_endpoint_type = public {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] barbican.barbican_region_name = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] barbican.cafile = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] barbican.certfile = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-7f334516-6839-4791-9cec-a6b885cb618c None None] CMD "mount.quobyte" returned: 1 in 0.049s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] barbican.collect_timing = False {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] barbican.insecure = False {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-7f334516-6839-4791-9cec-a6b885cb618c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] barbican.keyfile = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-7f334516-6839-4791-9cec-a6b885cb618c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] barbican.number_of_retries = 60 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-7f334516-6839-4791-9cec-a6b885cb618c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] barbican.retry_delay = 1 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] barbican.send_service_user_token = False {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] barbican.split_loggers = False {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] barbican.timeout = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] barbican.verify_ssl = True {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] barbican.verify_ssl_path = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] barbican_service_user.auth_section = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] barbican_service_user.auth_type = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-7f334516-6839-4791-9cec-a6b885cb618c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] barbican_service_user.cafile = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-7f334516-6839-4791-9cec-a6b885cb618c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] barbican_service_user.certfile = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] barbican_service_user.collect_timing = False {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-7f334516-6839-4791-9cec-a6b885cb618c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] barbican_service_user.insecure = False {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] barbican_service_user.keyfile = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] barbican_service_user.split_loggers = False {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] barbican_service_user.timeout = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] vault.approle_role_id = **** {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] vault.approle_secret_id = **** {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] vault.kv_mountpoint = secret {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] vault.kv_path = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] vault.kv_version = 2 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] vault.namespace = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] vault.root_token_id = **** {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] vault.ssl_ca_crt_file = None {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] vault.timeout = 60.0 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] vault.use_ssl = False {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 15:04:16 devstack cinder-volume[82535]: DEBUG oslo_service.backend._eventlet.service [None req-c8e9d782-fdcb-40cf-8a2a-5c77f204d155 None None] ******************************************************************************** {{(pid=82535) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 16 15:04:16 devstack sudo[82762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:04:16 devstack sudo[82762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:04:16 devstack sudo[82762]: pam_unix(sudo:session): session closed for user root Apr 16 15:04:16 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-7f334516-6839-4791-9cec-a6b885cb618c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.416s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:04:16 devstack cinder-volume[82756]: INFO cinder.volume.driver [None req-7f334516-6839-4791-9cec-a6b885cb618c None None] Driver hasn't implemented _init_vendor_properties() Apr 16 15:04:16 devstack cinder-volume[82756]: DEBUG cinder.volume.driver [None req-7f334516-6839-4791-9cec-a6b885cb618c None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7327880859375, 'free_capacity_gb': 1775.7327880859375, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82756) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 16 15:04:16 devstack cinder-volume[82756]: DEBUG oslo_db.sqlalchemy.engines [None req-7f334516-6839-4791-9cec-a6b885cb618c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82756) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 16 15:04:16 devstack cinder-volume[82756]: DEBUG dbcounter [-] [82756] Writer thread running {{(pid=82756) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 16 15:04:16 devstack cinder-volume[82756]: DEBUG cinder.db.sqlalchemy.api [None req-7f334516-6839-4791-9cec-a6b885cb618c None None] Building query based on filter {{(pid=82756) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 16 15:04:16 devstack cinder-volume[82756]: DEBUG cinder.image.image_utils [None req-7f334516-6839-4791-9cec-a6b885cb618c None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82756) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 16 15:04:16 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-7f334516-6839-4791-9cec-a6b885cb618c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:04:16 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-7f334516-6839-4791-9cec-a6b885cb618c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:04:16 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-7f334516-6839-4791-9cec-a6b885cb618c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:04:16 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-7f334516-6839-4791-9cec-a6b885cb618c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:04:16 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-7f334516-6839-4791-9cec-a6b885cb618c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:04:16 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-7f334516-6839-4791-9cec-a6b885cb618c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:04:16 devstack cinder-volume[82756]: INFO cinder.keymgr.migration [None req-8644bce8-3025-4803-bafe-2157f1b878f3 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 16 15:04:16 devstack sudo[82778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:04:16 devstack sudo[82778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:04:17 devstack sudo[82778]: pam_unix(sudo:session): session closed for user root Apr 16 15:04:17 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-7f334516-6839-4791-9cec-a6b885cb618c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.427s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:04:17 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-7f334516-6839-4791-9cec-a6b885cb618c None None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:04:17 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-7f334516-6839-4791-9cec-a6b885cb618c None None] Driver initialization completed successfully. Apr 16 15:04:17 devstack cinder-volume[82756]: INFO cinder.manager [None req-7f334516-6839-4791-9cec-a6b885cb618c None None] Initiating service 3 cleanup Apr 16 15:04:17 devstack cinder-volume[82756]: INFO cinder.manager [None req-7f334516-6839-4791-9cec-a6b885cb618c None None] Service 3 cleanup completed. Apr 16 15:04:17 devstack cinder-volume[82756]: DEBUG cinder.service [None req-7f334516-6839-4791-9cec-a6b885cb618c None None] Creating RPC server for service cinder-volume {{(pid=82756) start /opt/stack/cinder/cinder/service.py:231}} Apr 16 15:04:17 devstack cinder-volume[82756]: DEBUG cinder.service [None req-7f334516-6839-4791-9cec-a6b885cb618c None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82756) start /opt/stack/cinder/cinder/service.py:237}} Apr 16 15:04:17 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-7f334516-6839-4791-9cec-a6b885cb618c None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 16 15:04:17 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-7f334516-6839-4791-9cec-a6b885cb618c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:04:17 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-7f334516-6839-4791-9cec-a6b885cb618c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:04:17 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-7f334516-6839-4791-9cec-a6b885cb618c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:04:17 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-7f334516-6839-4791-9cec-a6b885cb618c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:04:17 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-7f334516-6839-4791-9cec-a6b885cb618c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:04:17 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-7f334516-6839-4791-9cec-a6b885cb618c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:04:17 devstack sudo[82784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:04:17 devstack sudo[82784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:04:17 devstack sudo[82784]: pam_unix(sudo:session): session closed for user root Apr 16 15:04:17 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-7f334516-6839-4791-9cec-a6b885cb618c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.390s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:04:17 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-7f334516-6839-4791-9cec-a6b885cb618c None None] Driver post RPC initialization completed successfully. Apr 16 15:04:26 devstack cinder-volume[82535]: DEBUG dbcounter [-] [82535] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=82535) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 15:04:27 devstack cinder-volume[82756]: DEBUG dbcounter [-] [82756] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=82756) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 15:04:27 devstack cinder-volume[82756]: DEBUG dbcounter [-] [82756] Writing DB stats cinder:SELECT=2 {{(pid=82756) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 15:05:15 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7699a88-b06d-45d3-a77a-4ee2c8d9e468 tempest-DeleteServersTestJSON-859659515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82756) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 15:05:15 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-a7699a88-b06d-45d3-a77a-4ee2c8d9e468 tempest-DeleteServersTestJSON-859659515 None] Flow 'volume_create_manager' (8b9980fe-fd51-43be-ba66-2c31fb7dc989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:05:15 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-a7699a88-b06d-45d3-a77a-4ee2c8d9e468 tempest-DeleteServersTestJSON-859659515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d552450-5af0-47f7-bdb9-8313e29dd50f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:05:15 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-a7699a88-b06d-45d3-a77a-4ee2c8d9e468 tempest-DeleteServersTestJSON-859659515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d552450-5af0-47f7-bdb9-8313e29dd50f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:05:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-720909656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26df0baf-385a-46b3-9f76-b576c201e79d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99d8d4f865874c628838a206bf6b2dad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:05:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:05:16Z,use_quota=True,user_id='16ebbbb30d2c4368a4ae839ec7ade194',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:05:15 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-a7699a88-b06d-45d3-a77a-4ee2c8d9e468 tempest-DeleteServersTestJSON-859659515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10720b11-ad14-4cb3-98b9-4045f9f6f025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:05:15 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-a7699a88-b06d-45d3-a77a-4ee2c8d9e468 tempest-DeleteServersTestJSON-859659515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10720b11-ad14-4cb3-98b9-4045f9f6f025) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:05:15 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-a7699a88-b06d-45d3-a77a-4ee2c8d9e468 tempest-DeleteServersTestJSON-859659515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc1948b2-ef18-4c23-add3-47d6313721d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:05:15 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-a7699a88-b06d-45d3-a77a-4ee2c8d9e468 tempest-DeleteServersTestJSON-859659515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc1948b2-ef18-4c23-add3-47d6313721d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26df0baf-385a-46b3-9f76-b576c201e79d', 'volume_name': 'volume-26df0baf-385a-46b3-9f76-b576c201e79d', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:05:15 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-a7699a88-b06d-45d3-a77a-4ee2c8d9e468 tempest-DeleteServersTestJSON-859659515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5eea85f6-d56f-401f-af83-14c13786ad27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:05:15 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-a7699a88-b06d-45d3-a77a-4ee2c8d9e468 tempest-DeleteServersTestJSON-859659515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5eea85f6-d56f-401f-af83-14c13786ad27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:05:15 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-a7699a88-b06d-45d3-a77a-4ee2c8d9e468 tempest-DeleteServersTestJSON-859659515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8b1a6a9-be6a-4a14-998a-17b324909b4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:05:15 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-a7699a88-b06d-45d3-a77a-4ee2c8d9e468 tempest-DeleteServersTestJSON-859659515 None] Volume 26df0baf-385a-46b3-9f76-b576c201e79d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26df0baf-385a-46b3-9f76-b576c201e79d', 'volume_size': 1} Apr 16 15:05:15 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-a7699a88-b06d-45d3-a77a-4ee2c8d9e468 tempest-DeleteServersTestJSON-859659515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:05:15 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-a7699a88-b06d-45d3-a77a-4ee2c8d9e468 tempest-DeleteServersTestJSON-859659515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:05:15 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-a7699a88-b06d-45d3-a77a-4ee2c8d9e468 tempest-DeleteServersTestJSON-859659515 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:05:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-720909656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26df0baf-385a-46b3-9f76-b576c201e79d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99d8d4f865874c628838a206bf6b2dad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:05:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:05:16Z,use_quota=True,user_id='16ebbbb30d2c4368a4ae839ec7ade194',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)}" {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 15:05:15 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-a7699a88-b06d-45d3-a77a-4ee2c8d9e468 tempest-DeleteServersTestJSON-859659515 None] Creating volume 26df0baf-385a-46b3-9f76-b576c201e79d {{(pid=82756) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 15:05:15 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-a7699a88-b06d-45d3-a77a-4ee2c8d9e468 tempest-DeleteServersTestJSON-859659515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:05:15 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-a7699a88-b06d-45d3-a77a-4ee2c8d9e468 tempest-DeleteServersTestJSON-859659515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:05:15 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-a7699a88-b06d-45d3-a77a-4ee2c8d9e468 tempest-DeleteServersTestJSON-859659515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:05:15 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-a7699a88-b06d-45d3-a77a-4ee2c8d9e468 tempest-DeleteServersTestJSON-859659515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:05:15 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-a7699a88-b06d-45d3-a77a-4ee2c8d9e468 tempest-DeleteServersTestJSON-859659515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:05:15 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-a7699a88-b06d-45d3-a77a-4ee2c8d9e468 tempest-DeleteServersTestJSON-859659515 None] Selected osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 as target Quobyte volume. {{(pid=82756) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 15:05:15 devstack cinder-volume[82756]: INFO cinder.volume.drivers.remotefs [None req-a7699a88-b06d-45d3-a77a-4ee2c8d9e468 tempest-DeleteServersTestJSON-859659515 None] casted to osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 Apr 16 15:05:15 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-a7699a88-b06d-45d3-a77a-4ee2c8d9e468 tempest-DeleteServersTestJSON-859659515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-26df0baf-385a-46b3-9f76-b576c201e79d 1073741824 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:05:15 devstack sudo[83238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-26df0baf-385a-46b3-9f76-b576c201e79d 1073741824 Apr 16 15:05:15 devstack sudo[83238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:05:17 devstack sudo[83238]: pam_unix(sudo:session): session closed for user root Apr 16 15:05:17 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-a7699a88-b06d-45d3-a77a-4ee2c8d9e468 tempest-DeleteServersTestJSON-859659515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-26df0baf-385a-46b3-9f76-b576c201e79d 1073741824" returned: 0 in 1.714s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:05:17 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-a7699a88-b06d-45d3-a77a-4ee2c8d9e468 tempest-DeleteServersTestJSON-859659515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-26df0baf-385a-46b3-9f76-b576c201e79d {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:05:17 devstack sudo[83606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-26df0baf-385a-46b3-9f76-b576c201e79d Apr 16 15:05:17 devstack sudo[83606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:05:18 devstack sudo[83606]: pam_unix(sudo:session): session closed for user root Apr 16 15:05:18 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-a7699a88-b06d-45d3-a77a-4ee2c8d9e468 tempest-DeleteServersTestJSON-859659515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-26df0baf-385a-46b3-9f76-b576c201e79d" returned: 0 in 1.230s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:05:18 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-a7699a88-b06d-45d3-a77a-4ee2c8d9e468 tempest-DeleteServersTestJSON-859659515 None] <== create_volume: return (3079ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'} {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 15:05:18 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-a7699a88-b06d-45d3-a77a-4ee2c8d9e468 tempest-DeleteServersTestJSON-859659515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.081s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:05:18 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-a7699a88-b06d-45d3-a77a-4ee2c8d9e468 tempest-DeleteServersTestJSON-859659515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8b1a6a9-be6a-4a14-998a-17b324909b4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26df0baf-385a-46b3-9f76-b576c201e79d', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:05:18 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-a7699a88-b06d-45d3-a77a-4ee2c8d9e468 tempest-DeleteServersTestJSON-859659515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1b2adae-a433-4415-8429-07e8b09f4128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:05:18 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-a7699a88-b06d-45d3-a77a-4ee2c8d9e468 tempest-DeleteServersTestJSON-859659515 None] Volume volume-26df0baf-385a-46b3-9f76-b576c201e79d (26df0baf-385a-46b3-9f76-b576c201e79d): created successfully Apr 16 15:05:18 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-a7699a88-b06d-45d3-a77a-4ee2c8d9e468 tempest-DeleteServersTestJSON-859659515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1b2adae-a433-4415-8429-07e8b09f4128) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:05:18 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-a7699a88-b06d-45d3-a77a-4ee2c8d9e468 tempest-DeleteServersTestJSON-859659515 None] Flow 'volume_create_manager' (8b9980fe-fd51-43be-ba66-2c31fb7dc989) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:05:19 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-a7699a88-b06d-45d3-a77a-4ee2c8d9e468 tempest-DeleteServersTestJSON-859659515 None] Created volume successfully. Apr 16 15:05:20 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1fe88ef-8756-4166-990d-c39be6138f07 tempest-VolumesAdminNegativeTest-1572515888 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82756) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 15:05:20 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-b1fe88ef-8756-4166-990d-c39be6138f07 tempest-VolumesAdminNegativeTest-1572515888 None] Flow 'volume_create_manager' (79eb4896-d153-4f38-8776-30b7c1a0aebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:05:20 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-b1fe88ef-8756-4166-990d-c39be6138f07 tempest-VolumesAdminNegativeTest-1572515888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e784e42-3e68-4606-9971-3da86e6ddc43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:05:20 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-b1fe88ef-8756-4166-990d-c39be6138f07 tempest-VolumesAdminNegativeTest-1572515888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e784e42-3e68-4606-9971-3da86e6ddc43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:05:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1259128150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f6b40e5-3991-4b75-8ec7-4e1a291ee3cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='093a5e17ebda4483b72a7d6427b391f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:05:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:05:21Z,use_quota=True,user_id='ef0a3661120746c2ba7fdeef2e8fc349',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:05:20 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-b1fe88ef-8756-4166-990d-c39be6138f07 tempest-VolumesAdminNegativeTest-1572515888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24c6281c-0a5b-4ede-987c-f267419cb299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:05:20 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-b1fe88ef-8756-4166-990d-c39be6138f07 tempest-VolumesAdminNegativeTest-1572515888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24c6281c-0a5b-4ede-987c-f267419cb299) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:05:20 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-b1fe88ef-8756-4166-990d-c39be6138f07 tempest-VolumesAdminNegativeTest-1572515888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab4d40b5-dbfe-4438-9d33-079fd760de5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:05:20 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-b1fe88ef-8756-4166-990d-c39be6138f07 tempest-VolumesAdminNegativeTest-1572515888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab4d40b5-dbfe-4438-9d33-079fd760de5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f6b40e5-3991-4b75-8ec7-4e1a291ee3cd', 'volume_name': 'volume-2f6b40e5-3991-4b75-8ec7-4e1a291ee3cd', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:05:20 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-b1fe88ef-8756-4166-990d-c39be6138f07 tempest-VolumesAdminNegativeTest-1572515888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a2203be-1297-4a73-9356-a48110130ab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:05:20 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-b1fe88ef-8756-4166-990d-c39be6138f07 tempest-VolumesAdminNegativeTest-1572515888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a2203be-1297-4a73-9356-a48110130ab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:05:20 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-b1fe88ef-8756-4166-990d-c39be6138f07 tempest-VolumesAdminNegativeTest-1572515888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a6187b4-aa1d-4250-b081-9bbc9d4d93ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:05:20 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-b1fe88ef-8756-4166-990d-c39be6138f07 tempest-VolumesAdminNegativeTest-1572515888 None] Volume 2f6b40e5-3991-4b75-8ec7-4e1a291ee3cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f6b40e5-3991-4b75-8ec7-4e1a291ee3cd', 'volume_size': 1} Apr 16 15:05:20 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-b1fe88ef-8756-4166-990d-c39be6138f07 tempest-VolumesAdminNegativeTest-1572515888 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:05:20 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-b1fe88ef-8756-4166-990d-c39be6138f07 tempest-VolumesAdminNegativeTest-1572515888 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:05:20 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-b1fe88ef-8756-4166-990d-c39be6138f07 tempest-VolumesAdminNegativeTest-1572515888 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:05:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1259128150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f6b40e5-3991-4b75-8ec7-4e1a291ee3cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='093a5e17ebda4483b72a7d6427b391f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:05:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:05:21Z,use_quota=True,user_id='ef0a3661120746c2ba7fdeef2e8fc349',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)}" {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 15:05:20 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-b1fe88ef-8756-4166-990d-c39be6138f07 tempest-VolumesAdminNegativeTest-1572515888 None] Creating volume 2f6b40e5-3991-4b75-8ec7-4e1a291ee3cd {{(pid=82756) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 15:05:20 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-b1fe88ef-8756-4166-990d-c39be6138f07 tempest-VolumesAdminNegativeTest-1572515888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:05:20 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-b1fe88ef-8756-4166-990d-c39be6138f07 tempest-VolumesAdminNegativeTest-1572515888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:05:20 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-b1fe88ef-8756-4166-990d-c39be6138f07 tempest-VolumesAdminNegativeTest-1572515888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:05:20 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-b1fe88ef-8756-4166-990d-c39be6138f07 tempest-VolumesAdminNegativeTest-1572515888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:05:20 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-b1fe88ef-8756-4166-990d-c39be6138f07 tempest-VolumesAdminNegativeTest-1572515888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:05:20 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-b1fe88ef-8756-4166-990d-c39be6138f07 tempest-VolumesAdminNegativeTest-1572515888 None] Selected osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 as target Quobyte volume. {{(pid=82756) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 15:05:20 devstack cinder-volume[82756]: INFO cinder.volume.drivers.remotefs [None req-b1fe88ef-8756-4166-990d-c39be6138f07 tempest-VolumesAdminNegativeTest-1572515888 None] casted to osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 Apr 16 15:05:20 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-b1fe88ef-8756-4166-990d-c39be6138f07 tempest-VolumesAdminNegativeTest-1572515888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2f6b40e5-3991-4b75-8ec7-4e1a291ee3cd 1073741824 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:05:20 devstack sudo[83622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2f6b40e5-3991-4b75-8ec7-4e1a291ee3cd 1073741824 Apr 16 15:05:20 devstack sudo[83622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:05:21 devstack sudo[83622]: pam_unix(sudo:session): session closed for user root Apr 16 15:05:21 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-b1fe88ef-8756-4166-990d-c39be6138f07 tempest-VolumesAdminNegativeTest-1572515888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2f6b40e5-3991-4b75-8ec7-4e1a291ee3cd 1073741824" returned: 0 in 0.968s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:05:21 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-b1fe88ef-8756-4166-990d-c39be6138f07 tempest-VolumesAdminNegativeTest-1572515888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2f6b40e5-3991-4b75-8ec7-4e1a291ee3cd {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:05:21 devstack sudo[83627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2f6b40e5-3991-4b75-8ec7-4e1a291ee3cd Apr 16 15:05:21 devstack sudo[83627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:05:22 devstack sudo[83627]: pam_unix(sudo:session): session closed for user root Apr 16 15:05:22 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-b1fe88ef-8756-4166-990d-c39be6138f07 tempest-VolumesAdminNegativeTest-1572515888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2f6b40e5-3991-4b75-8ec7-4e1a291ee3cd" returned: 0 in 0.949s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:05:22 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-b1fe88ef-8756-4166-990d-c39be6138f07 tempest-VolumesAdminNegativeTest-1572515888 None] <== create_volume: return (1978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'} {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 15:05:22 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-b1fe88ef-8756-4166-990d-c39be6138f07 tempest-VolumesAdminNegativeTest-1572515888 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.983s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:05:22 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-b1fe88ef-8756-4166-990d-c39be6138f07 tempest-VolumesAdminNegativeTest-1572515888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a6187b4-aa1d-4250-b081-9bbc9d4d93ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f6b40e5-3991-4b75-8ec7-4e1a291ee3cd', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:05:22 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-b1fe88ef-8756-4166-990d-c39be6138f07 tempest-VolumesAdminNegativeTest-1572515888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9659fa0e-34a2-415c-a748-5ec6c5d58e5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:05:22 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-b1fe88ef-8756-4166-990d-c39be6138f07 tempest-VolumesAdminNegativeTest-1572515888 None] Volume volume-2f6b40e5-3991-4b75-8ec7-4e1a291ee3cd (2f6b40e5-3991-4b75-8ec7-4e1a291ee3cd): created successfully Apr 16 15:05:22 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-b1fe88ef-8756-4166-990d-c39be6138f07 tempest-VolumesAdminNegativeTest-1572515888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9659fa0e-34a2-415c-a748-5ec6c5d58e5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:05:22 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-b1fe88ef-8756-4166-990d-c39be6138f07 tempest-VolumesAdminNegativeTest-1572515888 None] Flow 'volume_create_manager' (79eb4896-d153-4f38-8776-30b7c1a0aebe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:05:22 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-b1fe88ef-8756-4166-990d-c39be6138f07 tempest-VolumesAdminNegativeTest-1572515888 None] Created volume successfully. Apr 16 15:05:24 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-aa4f9b6a-cbca-4032-9677-4d2fe648843a tempest-VolumesAdminNegativeTest-1572515888 None] Acquiring lock "cinder-2f6b40e5-3991-4b75-8ec7-4e1a291ee3cd-delete_volume" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:05:24 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-aa4f9b6a-cbca-4032-9677-4d2fe648843a tempest-VolumesAdminNegativeTest-1572515888 None] Lock "cinder-2f6b40e5-3991-4b75-8ec7-4e1a291ee3cd-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:05:24 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-aa4f9b6a-cbca-4032-9677-4d2fe648843a tempest-VolumesAdminNegativeTest-1572515888 None] Acquiring lock "cinder-quobyte-2f6b40e5-3991-4b75-8ec7-4e1a291ee3cd" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:05:24 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-aa4f9b6a-cbca-4032-9677-4d2fe648843a tempest-VolumesAdminNegativeTest-1572515888 None] Lock "cinder-quobyte-2f6b40e5-3991-4b75-8ec7-4e1a291ee3cd" acquired by "delete_volume" :: waited 0.040s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:05:24 devstack cinder-volume[82756]: INFO oslo.privsep.daemon [None req-aa4f9b6a-cbca-4032-9677-4d2fe648843a tempest-VolumesAdminNegativeTest-1572515888 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpcpcf043d/privsep.sock'] Apr 16 15:05:24 devstack sudo[83636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpcpcf043d/privsep.sock Apr 16 15:05:24 devstack sudo[83636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:05:25 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcf74e51-f87a-49b3-a8bf-d4f575de6613 tempest-VolumesTestJSON-786410742 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82756) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 15:05:25 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-dcf74e51-f87a-49b3-a8bf-d4f575de6613 tempest-VolumesTestJSON-786410742 None] Flow 'volume_create_manager' (736926f4-42ef-4ce0-8b8c-015597c2ab58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:05:25 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-dcf74e51-f87a-49b3-a8bf-d4f575de6613 tempest-VolumesTestJSON-786410742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a67229d-efda-4c3f-b221-da9635c16747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:05:25 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-dcf74e51-f87a-49b3-a8bf-d4f575de6613 tempest-VolumesTestJSON-786410742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a67229d-efda-4c3f-b221-da9635c16747) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:05:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-239090573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a544285-7f41-448d-b6d0-761b9999d038,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6a24d6d7082f401fba5751d8558a453f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:05:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:05:25Z,use_quota=True,user_id='27ddfe61a246445ab65d4afd97840b23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:05:25 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-dcf74e51-f87a-49b3-a8bf-d4f575de6613 tempest-VolumesTestJSON-786410742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a41f4979-6822-4a8d-b48e-6d2a21c0022b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:05:25 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-dcf74e51-f87a-49b3-a8bf-d4f575de6613 tempest-VolumesTestJSON-786410742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a41f4979-6822-4a8d-b48e-6d2a21c0022b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:05:25 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-dcf74e51-f87a-49b3-a8bf-d4f575de6613 tempest-VolumesTestJSON-786410742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7f99ba1-3f06-4009-9ac6-adfcf583342f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:05:25 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-dcf74e51-f87a-49b3-a8bf-d4f575de6613 tempest-VolumesTestJSON-786410742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7f99ba1-3f06-4009-9ac6-adfcf583342f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a544285-7f41-448d-b6d0-761b9999d038', 'volume_name': 'volume-6a544285-7f41-448d-b6d0-761b9999d038', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:05:25 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-dcf74e51-f87a-49b3-a8bf-d4f575de6613 tempest-VolumesTestJSON-786410742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (276a839c-987c-4f16-a1ee-08cebf9b51b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:05:25 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-dcf74e51-f87a-49b3-a8bf-d4f575de6613 tempest-VolumesTestJSON-786410742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (276a839c-987c-4f16-a1ee-08cebf9b51b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:05:25 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-dcf74e51-f87a-49b3-a8bf-d4f575de6613 tempest-VolumesTestJSON-786410742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c2326fd-8b02-4890-bb2e-994906b477da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:05:25 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-dcf74e51-f87a-49b3-a8bf-d4f575de6613 tempest-VolumesTestJSON-786410742 None] Volume 6a544285-7f41-448d-b6d0-761b9999d038: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a544285-7f41-448d-b6d0-761b9999d038', 'volume_size': 1} Apr 16 15:05:25 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-dcf74e51-f87a-49b3-a8bf-d4f575de6613 tempest-VolumesTestJSON-786410742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:05:25 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-dcf74e51-f87a-49b3-a8bf-d4f575de6613 tempest-VolumesTestJSON-786410742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:05:25 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-dcf74e51-f87a-49b3-a8bf-d4f575de6613 tempest-VolumesTestJSON-786410742 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:05:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-239090573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a544285-7f41-448d-b6d0-761b9999d038,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6a24d6d7082f401fba5751d8558a453f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:05:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:05:25Z,use_quota=True,user_id='27ddfe61a246445ab65d4afd97840b23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)}" {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 15:05:25 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-dcf74e51-f87a-49b3-a8bf-d4f575de6613 tempest-VolumesTestJSON-786410742 None] Creating volume 6a544285-7f41-448d-b6d0-761b9999d038 {{(pid=82756) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 15:05:25 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-dcf74e51-f87a-49b3-a8bf-d4f575de6613 tempest-VolumesTestJSON-786410742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:05:25 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-dcf74e51-f87a-49b3-a8bf-d4f575de6613 tempest-VolumesTestJSON-786410742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:05:25 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-dcf74e51-f87a-49b3-a8bf-d4f575de6613 tempest-VolumesTestJSON-786410742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:05:25 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-dcf74e51-f87a-49b3-a8bf-d4f575de6613 tempest-VolumesTestJSON-786410742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:05:25 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-dcf74e51-f87a-49b3-a8bf-d4f575de6613 tempest-VolumesTestJSON-786410742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:05:25 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-dcf74e51-f87a-49b3-a8bf-d4f575de6613 tempest-VolumesTestJSON-786410742 None] Selected osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 as target Quobyte volume. {{(pid=82756) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 15:05:25 devstack cinder-volume[82756]: INFO cinder.volume.drivers.remotefs [None req-dcf74e51-f87a-49b3-a8bf-d4f575de6613 tempest-VolumesTestJSON-786410742 None] casted to osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 Apr 16 15:05:25 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-dcf74e51-f87a-49b3-a8bf-d4f575de6613 tempest-VolumesTestJSON-786410742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6a544285-7f41-448d-b6d0-761b9999d038 1073741824 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:05:25 devstack cinder-volume[82756]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Apr 16 15:05:25 devstack cinder-volume[82756]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 16 15:05:25 devstack cinder-volume[82756]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Apr 16 15:05:25 devstack cinder-volume[82756]: WARNING oslo.privsep.daemon [-] privsep log: Apr 16 15:05:25 devstack cinder-volume[82756]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Apr 16 15:05:25 devstack cinder-volume[82756]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Apr 16 15:05:25 devstack cinder-volume[82756]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 16 15:05:25 devstack cinder-volume[82756]: WARNING oslo.privsep.daemon [-] privsep log: Apr 16 15:05:25 devstack cinder-volume[82756]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Apr 16 15:05:25 devstack sudo[83647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6a544285-7f41-448d-b6d0-761b9999d038 1073741824 Apr 16 15:05:25 devstack sudo[83647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:05:26 devstack cinder-volume[82756]: WARNING py.warnings [req-faab4ce9-43b4-4435-8202-e78063a5da88 req-b9cdf3fd-d46f-47a2-b92a-bfc3203cc0b8 tempest-DeleteServersTestJSON-859659515 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Apr 16 15:05:26 devstack cinder-volume[82756]: .first() Apr 16 15:05:26 devstack cinder-volume[82756]: Apr 16 15:05:26 devstack cinder-volume[82756]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:66: EventletDeprecationWarning: Apr 16 15:05:26 devstack cinder-volume[82756]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 16 15:05:26 devstack cinder-volume[82756]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Apr 16 15:05:26 devstack cinder-volume[82756]: WARNING oslo.privsep.daemon [-] privsep log: Apr 16 15:05:26 devstack cinder-volume[82756]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Apr 16 15:05:26 devstack cinder-volume[82756]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Apr 16 15:05:26 devstack cinder-volume[82756]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 16 15:05:26 devstack cinder-volume[82756]: WARNING oslo.privsep.daemon [-] privsep log: Apr 16 15:05:26 devstack cinder-volume[82756]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Apr 16 15:05:26 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [req-faab4ce9-43b4-4435-8202-e78063a5da88 req-b9cdf3fd-d46f-47a2-b92a-bfc3203cc0b8 tempest-DeleteServersTestJSON-859659515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:05:26 devstack sudo[83636]: pam_unix(sudo:session): session closed for user root Apr 16 15:05:26 devstack cinder-volume[82756]: INFO oslo.privsep.daemon [None req-aa4f9b6a-cbca-4032-9677-4d2fe648843a tempest-VolumesAdminNegativeTest-1572515888 None] Spawned new privsep daemon via rootwrap Apr 16 15:05:26 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [None req-aa4f9b6a-cbca-4032-9677-4d2fe648843a tempest-VolumesAdminNegativeTest-1572515888 None] Accepted privsep connection to /tmp/tmpcpcf043d/privsep.sock {{(pid=82756) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:418}} Apr 16 15:05:26 devstack cinder-volume[82756]: INFO oslo.privsep.daemon [-] privsep daemon starting Apr 16 15:05:26 devstack cinder-volume[82756]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Apr 16 15:05:26 devstack cinder-volume[82756]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Apr 16 15:05:26 devstack cinder-volume[82756]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83662 Apr 16 15:05:26 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[a65e7742-f6c5-4f94-aef5-0de4c1715238]: (2,) {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:05:26 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[f08fcaee-c4d9-47dd-a18b-4ede18e2b4ea]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:05:26 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-aa4f9b6a-cbca-4032-9677-4d2fe648843a tempest-VolumesAdminNegativeTest-1572515888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2f6b40e5-3991-4b75-8ec7-4e1a291ee3cd {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:05:27 devstack sudo[83647]: pam_unix(sudo:session): session closed for user root Apr 16 15:05:27 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-dcf74e51-f87a-49b3-a8bf-d4f575de6613 tempest-VolumesTestJSON-786410742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6a544285-7f41-448d-b6d0-761b9999d038 1073741824" returned: 0 in 1.443s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:05:27 devstack sudo[83667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2f6b40e5-3991-4b75-8ec7-4e1a291ee3cd Apr 16 15:05:27 devstack sudo[83667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:05:27 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-dcf74e51-f87a-49b3-a8bf-d4f575de6613 tempest-VolumesTestJSON-786410742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6a544285-7f41-448d-b6d0-761b9999d038 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:05:27 devstack sudo[83669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6a544285-7f41-448d-b6d0-761b9999d038 Apr 16 15:05:27 devstack sudo[83669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:05:27 devstack sudo[83669]: pam_unix(sudo:session): session closed for user root Apr 16 15:05:27 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-dcf74e51-f87a-49b3-a8bf-d4f575de6613 tempest-VolumesTestJSON-786410742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6a544285-7f41-448d-b6d0-761b9999d038" returned: 0 in 0.557s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:05:27 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-dcf74e51-f87a-49b3-a8bf-d4f575de6613 tempest-VolumesTestJSON-786410742 None] <== create_volume: return (2075ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'} {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 15:05:27 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-dcf74e51-f87a-49b3-a8bf-d4f575de6613 tempest-VolumesTestJSON-786410742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.081s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:05:27 devstack sudo[83667]: pam_unix(sudo:session): session closed for user root Apr 16 15:05:27 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [req-faab4ce9-43b4-4435-8202-e78063a5da88 req-b9cdf3fd-d46f-47a2-b92a-bfc3203cc0b8 tempest-DeleteServersTestJSON-859659515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.462s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:05:27 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-aa4f9b6a-cbca-4032-9677-4d2fe648843a tempest-VolumesAdminNegativeTest-1572515888 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2f6b40e5-3991-4b75-8ec7-4e1a291ee3cd" returned: 0 in 0.735s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:05:27 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-aa4f9b6a-cbca-4032-9677-4d2fe648843a tempest-VolumesAdminNegativeTest-1572515888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2f6b40e5-3991-4b75-8ec7-4e1a291ee3cd {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:05:27 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebacef3a-0798-42c2-a405-1fb33570700d]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:05:27 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [req-faab4ce9-43b4-4435-8202-e78063a5da88 req-b9cdf3fd-d46f-47a2-b92a-bfc3203cc0b8 tempest-DeleteServersTestJSON-859659515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-26df0baf-385a-46b3-9f76-b576c201e79d {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:05:27 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-dcf74e51-f87a-49b3-a8bf-d4f575de6613 tempest-VolumesTestJSON-786410742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c2326fd-8b02-4890-bb2e-994906b477da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a544285-7f41-448d-b6d0-761b9999d038', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:05:27 devstack sudo[83675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2f6b40e5-3991-4b75-8ec7-4e1a291ee3cd Apr 16 15:05:27 devstack sudo[83675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:05:27 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-dcf74e51-f87a-49b3-a8bf-d4f575de6613 tempest-VolumesTestJSON-786410742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7482f5d4-9019-4c70-bbee-fbcfe4eb6b88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:05:27 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-dcf74e51-f87a-49b3-a8bf-d4f575de6613 tempest-VolumesTestJSON-786410742 None] Volume volume-6a544285-7f41-448d-b6d0-761b9999d038 (6a544285-7f41-448d-b6d0-761b9999d038): created successfully Apr 16 15:05:27 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-dcf74e51-f87a-49b3-a8bf-d4f575de6613 tempest-VolumesTestJSON-786410742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7482f5d4-9019-4c70-bbee-fbcfe4eb6b88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:05:27 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-dcf74e51-f87a-49b3-a8bf-d4f575de6613 tempest-VolumesTestJSON-786410742 None] Flow 'volume_create_manager' (736926f4-42ef-4ce0-8b8c-015597c2ab58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:05:27 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-dcf74e51-f87a-49b3-a8bf-d4f575de6613 tempest-VolumesTestJSON-786410742 None] Created volume successfully. Apr 16 15:05:27 devstack sudo[83676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-26df0baf-385a-46b3-9f76-b576c201e79d Apr 16 15:05:27 devstack sudo[83676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:05:28 devstack sudo[83675]: pam_unix(sudo:session): session closed for user root Apr 16 15:05:28 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-aa4f9b6a-cbca-4032-9677-4d2fe648843a tempest-VolumesAdminNegativeTest-1572515888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2f6b40e5-3991-4b75-8ec7-4e1a291ee3cd" returned: 0 in 0.555s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:05:28 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-aa4f9b6a-cbca-4032-9677-4d2fe648843a tempest-VolumesAdminNegativeTest-1572515888 None] Lock "cinder-quobyte-2f6b40e5-3991-4b75-8ec7-4e1a291ee3cd" released by "delete_volume" :: held 3.572s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:05:28 devstack cinder-volume[82756]: WARNING cinder.quota [None req-aa4f9b6a-cbca-4032-9677-4d2fe648843a tempest-VolumesAdminNegativeTest-1572515888 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 16 15:05:28 devstack cinder-volume[82756]: WARNING cinder.quota [None req-aa4f9b6a-cbca-4032-9677-4d2fe648843a tempest-VolumesAdminNegativeTest-1572515888 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 16 15:05:28 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-aa4f9b6a-cbca-4032-9677-4d2fe648843a tempest-VolumesAdminNegativeTest-1572515888 None] Created reservations ['cb910ace-a632-47b4-a89e-91d7dd970b8a', '9ac6b987-6b95-41ce-b8d2-d793cbebb183', 'cde78c34-a27e-414d-8b25-33a19dc881c9', '3a60a0b1-accd-4ad4-9f60-eea89b2831a7'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:05:28 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-aa4f9b6a-cbca-4032-9677-4d2fe648843a tempest-VolumesAdminNegativeTest-1572515888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:05:28 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-aa4f9b6a-cbca-4032-9677-4d2fe648843a tempest-VolumesAdminNegativeTest-1572515888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:05:28 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-aa4f9b6a-cbca-4032-9677-4d2fe648843a tempest-VolumesAdminNegativeTest-1572515888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:05:28 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-aa4f9b6a-cbca-4032-9677-4d2fe648843a tempest-VolumesAdminNegativeTest-1572515888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:05:28 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-aa4f9b6a-cbca-4032-9677-4d2fe648843a tempest-VolumesAdminNegativeTest-1572515888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:05:28 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-aa4f9b6a-cbca-4032-9677-4d2fe648843a tempest-VolumesAdminNegativeTest-1572515888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:05:28 devstack sudo[83683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:05:28 devstack sudo[83683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:05:28 devstack sudo[83676]: pam_unix(sudo:session): session closed for user root Apr 16 15:05:28 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [req-faab4ce9-43b4-4435-8202-e78063a5da88 req-b9cdf3fd-d46f-47a2-b92a-bfc3203cc0b8 tempest-DeleteServersTestJSON-859659515 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-26df0baf-385a-46b3-9f76-b576c201e79d" returned: 0 in 0.731s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:05:28 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [req-faab4ce9-43b4-4435-8202-e78063a5da88 req-b9cdf3fd-d46f-47a2-b92a-bfc3203cc0b8 tempest-DeleteServersTestJSON-859659515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.747s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:05:28 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [req-faab4ce9-43b4-4435-8202-e78063a5da88 req-b9cdf3fd-d46f-47a2-b92a-bfc3203cc0b8 tempest-DeleteServersTestJSON-859659515 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781', 'name': 'volume-26df0baf-385a-46b3-9f76-b576c201e79d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bc1823c9-2182-4f1a-af45-0a4999f40e92', 'enforce_multipath': True} {{(pid=82756) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 16 15:05:28 devstack cinder-volume[82756]: INFO cinder.volume.manager [req-faab4ce9-43b4-4435-8202-e78063a5da88 req-b9cdf3fd-d46f-47a2-b92a-bfc3203cc0b8 tempest-DeleteServersTestJSON-859659515 None] attachment_update completed successfully. Apr 16 15:05:29 devstack sudo[83683]: pam_unix(sudo:session): session closed for user root Apr 16 15:05:29 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-aa4f9b6a-cbca-4032-9677-4d2fe648843a tempest-VolumesAdminNegativeTest-1572515888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.815s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:05:29 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-aa4f9b6a-cbca-4032-9677-4d2fe648843a tempest-VolumesAdminNegativeTest-1572515888 None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:05:29 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-aa4f9b6a-cbca-4032-9677-4d2fe648843a tempest-VolumesAdminNegativeTest-1572515888 None] Deleted volume successfully. Apr 16 15:05:29 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-aa4f9b6a-cbca-4032-9677-4d2fe648843a tempest-VolumesAdminNegativeTest-1572515888 None] Lock "cinder-2f6b40e5-3991-4b75-8ec7-4e1a291ee3cd-delete_volume" released by "delete_volume" :: held 4.715s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:05:29 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [None req-50faf270-5bc0-4fe5-bb59-b529b7a3c26d tempest-VolumesTestJSON-786410742 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82756) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 15:05:29 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-50faf270-5bc0-4fe5-bb59-b529b7a3c26d tempest-VolumesTestJSON-786410742 None] Flow 'volume_create_manager' (8d138477-a591-4ef2-b20b-15adf5866aec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:05:29 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-50faf270-5bc0-4fe5-bb59-b529b7a3c26d tempest-VolumesTestJSON-786410742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (533afda9-fde3-468b-b07e-b7b8376ba20c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:05:29 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-50faf270-5bc0-4fe5-bb59-b529b7a3c26d tempest-VolumesTestJSON-786410742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (533afda9-fde3-468b-b07e-b7b8376ba20c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:05:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1555841367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b511317a-9b9f-43bb-b8c7-76d083848f88,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6a24d6d7082f401fba5751d8558a453f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:05:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:05:29Z,use_quota=True,user_id='27ddfe61a246445ab65d4afd97840b23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:05:29 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-50faf270-5bc0-4fe5-bb59-b529b7a3c26d tempest-VolumesTestJSON-786410742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9a422df-37f7-42be-9f77-5dcbb6f50853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:05:29 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-50faf270-5bc0-4fe5-bb59-b529b7a3c26d tempest-VolumesTestJSON-786410742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9a422df-37f7-42be-9f77-5dcbb6f50853) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:05:29 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-50faf270-5bc0-4fe5-bb59-b529b7a3c26d tempest-VolumesTestJSON-786410742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cda8b3c-1f6f-439f-961f-19e2bb57a24d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:05:29 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-50faf270-5bc0-4fe5-bb59-b529b7a3c26d tempest-VolumesTestJSON-786410742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cda8b3c-1f6f-439f-961f-19e2bb57a24d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b511317a-9b9f-43bb-b8c7-76d083848f88', 'volume_name': 'volume-b511317a-9b9f-43bb-b8c7-76d083848f88', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:05:29 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-50faf270-5bc0-4fe5-bb59-b529b7a3c26d tempest-VolumesTestJSON-786410742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fba50382-769a-4eb9-8d31-81be29d233de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:05:29 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-50faf270-5bc0-4fe5-bb59-b529b7a3c26d tempest-VolumesTestJSON-786410742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fba50382-769a-4eb9-8d31-81be29d233de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:05:29 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-50faf270-5bc0-4fe5-bb59-b529b7a3c26d tempest-VolumesTestJSON-786410742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4854595e-e5ec-431b-8159-b3c51bc0a466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:05:29 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-50faf270-5bc0-4fe5-bb59-b529b7a3c26d tempest-VolumesTestJSON-786410742 None] Volume b511317a-9b9f-43bb-b8c7-76d083848f88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b511317a-9b9f-43bb-b8c7-76d083848f88', 'volume_size': 1} Apr 16 15:05:29 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-50faf270-5bc0-4fe5-bb59-b529b7a3c26d tempest-VolumesTestJSON-786410742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:05:29 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-50faf270-5bc0-4fe5-bb59-b529b7a3c26d tempest-VolumesTestJSON-786410742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:05:29 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-50faf270-5bc0-4fe5-bb59-b529b7a3c26d tempest-VolumesTestJSON-786410742 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:05:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1555841367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b511317a-9b9f-43bb-b8c7-76d083848f88,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6a24d6d7082f401fba5751d8558a453f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:05:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:05:29Z,use_quota=True,user_id='27ddfe61a246445ab65d4afd97840b23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)}" {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 15:05:29 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-50faf270-5bc0-4fe5-bb59-b529b7a3c26d tempest-VolumesTestJSON-786410742 None] Creating volume b511317a-9b9f-43bb-b8c7-76d083848f88 {{(pid=82756) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 15:05:29 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-50faf270-5bc0-4fe5-bb59-b529b7a3c26d tempest-VolumesTestJSON-786410742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:05:29 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-50faf270-5bc0-4fe5-bb59-b529b7a3c26d tempest-VolumesTestJSON-786410742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:05:29 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-50faf270-5bc0-4fe5-bb59-b529b7a3c26d tempest-VolumesTestJSON-786410742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:05:29 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-50faf270-5bc0-4fe5-bb59-b529b7a3c26d tempest-VolumesTestJSON-786410742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:05:29 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-50faf270-5bc0-4fe5-bb59-b529b7a3c26d tempest-VolumesTestJSON-786410742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:05:29 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-50faf270-5bc0-4fe5-bb59-b529b7a3c26d tempest-VolumesTestJSON-786410742 None] Selected osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 as target Quobyte volume. {{(pid=82756) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 15:05:29 devstack cinder-volume[82756]: INFO cinder.volume.drivers.remotefs [None req-50faf270-5bc0-4fe5-bb59-b529b7a3c26d tempest-VolumesTestJSON-786410742 None] casted to osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 Apr 16 15:05:29 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-50faf270-5bc0-4fe5-bb59-b529b7a3c26d tempest-VolumesTestJSON-786410742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b511317a-9b9f-43bb-b8c7-76d083848f88 1073741824 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:05:29 devstack sudo[83756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b511317a-9b9f-43bb-b8c7-76d083848f88 1073741824 Apr 16 15:05:29 devstack sudo[83756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:05:30 devstack sudo[83756]: pam_unix(sudo:session): session closed for user root Apr 16 15:05:30 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-50faf270-5bc0-4fe5-bb59-b529b7a3c26d tempest-VolumesTestJSON-786410742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b511317a-9b9f-43bb-b8c7-76d083848f88 1073741824" returned: 0 in 0.752s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:05:30 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-50faf270-5bc0-4fe5-bb59-b529b7a3c26d tempest-VolumesTestJSON-786410742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b511317a-9b9f-43bb-b8c7-76d083848f88 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:05:30 devstack sudo[84079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b511317a-9b9f-43bb-b8c7-76d083848f88 Apr 16 15:05:30 devstack sudo[84079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:05:30 devstack sudo[84079]: pam_unix(sudo:session): session closed for user root Apr 16 15:05:31 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-50faf270-5bc0-4fe5-bb59-b529b7a3c26d tempest-VolumesTestJSON-786410742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b511317a-9b9f-43bb-b8c7-76d083848f88" returned: 0 in 0.660s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:05:31 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-50faf270-5bc0-4fe5-bb59-b529b7a3c26d tempest-VolumesTestJSON-786410742 None] <== create_volume: return (1437ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'} {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 15:05:31 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-50faf270-5bc0-4fe5-bb59-b529b7a3c26d tempest-VolumesTestJSON-786410742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.439s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:05:31 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-50faf270-5bc0-4fe5-bb59-b529b7a3c26d tempest-VolumesTestJSON-786410742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4854595e-e5ec-431b-8159-b3c51bc0a466) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b511317a-9b9f-43bb-b8c7-76d083848f88', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:05:31 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-50faf270-5bc0-4fe5-bb59-b529b7a3c26d tempest-VolumesTestJSON-786410742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (248b9ff2-d5ac-49e1-8f2b-4143d21ae304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:05:31 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-50faf270-5bc0-4fe5-bb59-b529b7a3c26d tempest-VolumesTestJSON-786410742 None] Volume volume-b511317a-9b9f-43bb-b8c7-76d083848f88 (b511317a-9b9f-43bb-b8c7-76d083848f88): created successfully Apr 16 15:05:31 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-50faf270-5bc0-4fe5-bb59-b529b7a3c26d tempest-VolumesTestJSON-786410742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (248b9ff2-d5ac-49e1-8f2b-4143d21ae304) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:05:31 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-50faf270-5bc0-4fe5-bb59-b529b7a3c26d tempest-VolumesTestJSON-786410742 None] Flow 'volume_create_manager' (8d138477-a591-4ef2-b20b-15adf5866aec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:05:31 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-50faf270-5bc0-4fe5-bb59-b529b7a3c26d tempest-VolumesTestJSON-786410742 None] Created volume successfully. Apr 16 15:05:32 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [None req-93f6ac5c-71d9-4678-b53c-e4907f63ad61 tempest-VolumesTestJSON-786410742 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82756) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 15:05:32 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-93f6ac5c-71d9-4678-b53c-e4907f63ad61 tempest-VolumesTestJSON-786410742 None] Flow 'volume_create_manager' (c91fbe5b-d43e-4d63-b7dd-6d973e3ad6d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:05:32 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-93f6ac5c-71d9-4678-b53c-e4907f63ad61 tempest-VolumesTestJSON-786410742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcbbdb3e-36ac-4287-ba27-16996a729e4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:05:32 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-93f6ac5c-71d9-4678-b53c-e4907f63ad61 tempest-VolumesTestJSON-786410742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcbbdb3e-36ac-4287-ba27-16996a729e4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:05:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1377236822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef528c63-0cc5-40d8-ae58-7c33b5718189,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6a24d6d7082f401fba5751d8558a453f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:05:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:05:32Z,use_quota=True,user_id='27ddfe61a246445ab65d4afd97840b23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:05:32 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-93f6ac5c-71d9-4678-b53c-e4907f63ad61 tempest-VolumesTestJSON-786410742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82163ae6-2ecc-4149-bf3d-adbffbffba12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:05:32 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-93f6ac5c-71d9-4678-b53c-e4907f63ad61 tempest-VolumesTestJSON-786410742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82163ae6-2ecc-4149-bf3d-adbffbffba12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:05:32 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-93f6ac5c-71d9-4678-b53c-e4907f63ad61 tempest-VolumesTestJSON-786410742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66d3d453-ee5e-409a-ac66-9888de7b5e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:05:32 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-93f6ac5c-71d9-4678-b53c-e4907f63ad61 tempest-VolumesTestJSON-786410742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66d3d453-ee5e-409a-ac66-9888de7b5e6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef528c63-0cc5-40d8-ae58-7c33b5718189', 'volume_name': 'volume-ef528c63-0cc5-40d8-ae58-7c33b5718189', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:05:32 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-93f6ac5c-71d9-4678-b53c-e4907f63ad61 tempest-VolumesTestJSON-786410742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9411109-6282-4152-a01a-ffa7a4671c56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:05:32 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-93f6ac5c-71d9-4678-b53c-e4907f63ad61 tempest-VolumesTestJSON-786410742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9411109-6282-4152-a01a-ffa7a4671c56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:05:32 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-93f6ac5c-71d9-4678-b53c-e4907f63ad61 tempest-VolumesTestJSON-786410742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (badeadcf-de23-4b2c-a7c4-34417dcdd4a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:05:32 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-93f6ac5c-71d9-4678-b53c-e4907f63ad61 tempest-VolumesTestJSON-786410742 None] Volume ef528c63-0cc5-40d8-ae58-7c33b5718189: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef528c63-0cc5-40d8-ae58-7c33b5718189', 'volume_size': 1} Apr 16 15:05:32 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-93f6ac5c-71d9-4678-b53c-e4907f63ad61 tempest-VolumesTestJSON-786410742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:05:32 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-93f6ac5c-71d9-4678-b53c-e4907f63ad61 tempest-VolumesTestJSON-786410742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:05:32 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-93f6ac5c-71d9-4678-b53c-e4907f63ad61 tempest-VolumesTestJSON-786410742 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:05:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1377236822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef528c63-0cc5-40d8-ae58-7c33b5718189,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6a24d6d7082f401fba5751d8558a453f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:05:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:05:32Z,use_quota=True,user_id='27ddfe61a246445ab65d4afd97840b23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)}" {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 15:05:32 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-93f6ac5c-71d9-4678-b53c-e4907f63ad61 tempest-VolumesTestJSON-786410742 None] Creating volume ef528c63-0cc5-40d8-ae58-7c33b5718189 {{(pid=82756) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 15:05:32 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-93f6ac5c-71d9-4678-b53c-e4907f63ad61 tempest-VolumesTestJSON-786410742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:05:32 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-93f6ac5c-71d9-4678-b53c-e4907f63ad61 tempest-VolumesTestJSON-786410742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:05:32 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-93f6ac5c-71d9-4678-b53c-e4907f63ad61 tempest-VolumesTestJSON-786410742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:05:32 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-93f6ac5c-71d9-4678-b53c-e4907f63ad61 tempest-VolumesTestJSON-786410742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:05:32 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-93f6ac5c-71d9-4678-b53c-e4907f63ad61 tempest-VolumesTestJSON-786410742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:05:32 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-93f6ac5c-71d9-4678-b53c-e4907f63ad61 tempest-VolumesTestJSON-786410742 None] Selected osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 as target Quobyte volume. {{(pid=82756) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 15:05:32 devstack cinder-volume[82756]: INFO cinder.volume.drivers.remotefs [None req-93f6ac5c-71d9-4678-b53c-e4907f63ad61 tempest-VolumesTestJSON-786410742 None] casted to osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 Apr 16 15:05:32 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-93f6ac5c-71d9-4678-b53c-e4907f63ad61 tempest-VolumesTestJSON-786410742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-ef528c63-0cc5-40d8-ae58-7c33b5718189 1073741824 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:05:32 devstack sudo[84113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-ef528c63-0cc5-40d8-ae58-7c33b5718189 1073741824 Apr 16 15:05:32 devstack sudo[84113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:05:33 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [req-56095ce1-3780-468e-8ef5-afa12998e788 req-fb4c0e2b-51cd-4c0d-9f2f-5377f5f67ef5 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82756) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 15:05:33 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [req-56095ce1-3780-468e-8ef5-afa12998e788 req-fb4c0e2b-51cd-4c0d-9f2f-5377f5f67ef5 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Flow 'volume_create_manager' (22935b72-679f-4218-8839-4745f259ef58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:05:33 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [req-56095ce1-3780-468e-8ef5-afa12998e788 req-fb4c0e2b-51cd-4c0d-9f2f-5377f5f67ef5 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (314e4380-6082-4353-b34b-da332fad95bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:05:33 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [req-56095ce1-3780-468e-8ef5-afa12998e788 req-fb4c0e2b-51cd-4c0d-9f2f-5377f5f67ef5 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (314e4380-6082-4353-b34b-da332fad95bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:05:33Z,deleted=False,deleted_at=None,display_description='',display_name='f8c9d1ef-7a08-4530-9192-4e1445f4892d-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80e7a5cb-9ef2-4aa9-91a6-6d7d841c82ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42bb5dcbcc07406fa017af1e43b594d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:05:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:05:33Z,use_quota=True,user_id='faeeca99fa814c848e8eba16aa72cb29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:05:33 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [req-56095ce1-3780-468e-8ef5-afa12998e788 req-fb4c0e2b-51cd-4c0d-9f2f-5377f5f67ef5 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (381b086b-e318-48f5-a081-0dca72df1bc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:05:33 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [req-56095ce1-3780-468e-8ef5-afa12998e788 req-fb4c0e2b-51cd-4c0d-9f2f-5377f5f67ef5 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (381b086b-e318-48f5-a081-0dca72df1bc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:05:33 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [req-56095ce1-3780-468e-8ef5-afa12998e788 req-fb4c0e2b-51cd-4c0d-9f2f-5377f5f67ef5 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac7dd7f1-106f-4bab-8ebe-3dfda496ff7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:05:33 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [req-56095ce1-3780-468e-8ef5-afa12998e788 req-fb4c0e2b-51cd-4c0d-9f2f-5377f5f67ef5 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac7dd7f1-106f-4bab-8ebe-3dfda496ff7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80e7a5cb-9ef2-4aa9-91a6-6d7d841c82ae', 'volume_name': 'volume-80e7a5cb-9ef2-4aa9-91a6-6d7d841c82ae', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:05:33 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [req-56095ce1-3780-468e-8ef5-afa12998e788 req-fb4c0e2b-51cd-4c0d-9f2f-5377f5f67ef5 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95d6e984-ff62-4c94-a5a9-444dcf0fc8db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:05:33 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [req-56095ce1-3780-468e-8ef5-afa12998e788 req-fb4c0e2b-51cd-4c0d-9f2f-5377f5f67ef5 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95d6e984-ff62-4c94-a5a9-444dcf0fc8db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:05:33 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [req-56095ce1-3780-468e-8ef5-afa12998e788 req-fb4c0e2b-51cd-4c0d-9f2f-5377f5f67ef5 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3b3050b-ab2e-4e5f-9e8c-6b8b15fce1c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:05:33 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [req-56095ce1-3780-468e-8ef5-afa12998e788 req-fb4c0e2b-51cd-4c0d-9f2f-5377f5f67ef5 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Volume 80e7a5cb-9ef2-4aa9-91a6-6d7d841c82ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80e7a5cb-9ef2-4aa9-91a6-6d7d841c82ae', 'volume_size': 1} Apr 16 15:05:33 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [req-56095ce1-3780-468e-8ef5-afa12998e788 req-fb4c0e2b-51cd-4c0d-9f2f-5377f5f67ef5 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:05:33 devstack sudo[84113]: pam_unix(sudo:session): session closed for user root Apr 16 15:05:33 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-93f6ac5c-71d9-4678-b53c-e4907f63ad61 tempest-VolumesTestJSON-786410742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-ef528c63-0cc5-40d8-ae58-7c33b5718189 1073741824" returned: 0 in 1.243s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:05:33 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-93f6ac5c-71d9-4678-b53c-e4907f63ad61 tempest-VolumesTestJSON-786410742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-ef528c63-0cc5-40d8-ae58-7c33b5718189 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:05:33 devstack sudo[84125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-ef528c63-0cc5-40d8-ae58-7c33b5718189 Apr 16 15:05:33 devstack sudo[84125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:05:34 devstack sudo[84125]: pam_unix(sudo:session): session closed for user root Apr 16 15:05:34 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-93f6ac5c-71d9-4678-b53c-e4907f63ad61 tempest-VolumesTestJSON-786410742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-ef528c63-0cc5-40d8-ae58-7c33b5718189" returned: 0 in 0.570s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:05:34 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-93f6ac5c-71d9-4678-b53c-e4907f63ad61 tempest-VolumesTestJSON-786410742 None] <== create_volume: return (1884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'} {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 15:05:34 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-93f6ac5c-71d9-4678-b53c-e4907f63ad61 tempest-VolumesTestJSON-786410742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.889s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:05:34 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [req-56095ce1-3780-468e-8ef5-afa12998e788 req-fb4c0e2b-51cd-4c0d-9f2f-5377f5f67ef5 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.893s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:05:34 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [req-56095ce1-3780-468e-8ef5-afa12998e788 req-fb4c0e2b-51cd-4c0d-9f2f-5377f5f67ef5 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:05:33Z,deleted=False,deleted_at=None,display_description='',display_name='f8c9d1ef-7a08-4530-9192-4e1445f4892d-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80e7a5cb-9ef2-4aa9-91a6-6d7d841c82ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42bb5dcbcc07406fa017af1e43b594d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:05:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:05:33Z,use_quota=True,user_id='faeeca99fa814c848e8eba16aa72cb29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)}" {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 15:05:34 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [req-56095ce1-3780-468e-8ef5-afa12998e788 req-fb4c0e2b-51cd-4c0d-9f2f-5377f5f67ef5 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Creating volume 80e7a5cb-9ef2-4aa9-91a6-6d7d841c82ae {{(pid=82756) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 15:05:34 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [req-56095ce1-3780-468e-8ef5-afa12998e788 req-fb4c0e2b-51cd-4c0d-9f2f-5377f5f67ef5 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:05:34 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [req-56095ce1-3780-468e-8ef5-afa12998e788 req-fb4c0e2b-51cd-4c0d-9f2f-5377f5f67ef5 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:05:34 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [req-56095ce1-3780-468e-8ef5-afa12998e788 req-fb4c0e2b-51cd-4c0d-9f2f-5377f5f67ef5 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:05:34 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [req-56095ce1-3780-468e-8ef5-afa12998e788 req-fb4c0e2b-51cd-4c0d-9f2f-5377f5f67ef5 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:05:34 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [req-56095ce1-3780-468e-8ef5-afa12998e788 req-fb4c0e2b-51cd-4c0d-9f2f-5377f5f67ef5 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:05:34 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [req-56095ce1-3780-468e-8ef5-afa12998e788 req-fb4c0e2b-51cd-4c0d-9f2f-5377f5f67ef5 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Selected osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 as target Quobyte volume. {{(pid=82756) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 15:05:34 devstack cinder-volume[82756]: INFO cinder.volume.drivers.remotefs [req-56095ce1-3780-468e-8ef5-afa12998e788 req-fb4c0e2b-51cd-4c0d-9f2f-5377f5f67ef5 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] casted to osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 Apr 16 15:05:34 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [req-56095ce1-3780-468e-8ef5-afa12998e788 req-fb4c0e2b-51cd-4c0d-9f2f-5377f5f67ef5 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-80e7a5cb-9ef2-4aa9-91a6-6d7d841c82ae 1073741824 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:05:34 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-93f6ac5c-71d9-4678-b53c-e4907f63ad61 tempest-VolumesTestJSON-786410742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (badeadcf-de23-4b2c-a7c4-34417dcdd4a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef528c63-0cc5-40d8-ae58-7c33b5718189', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:05:34 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-93f6ac5c-71d9-4678-b53c-e4907f63ad61 tempest-VolumesTestJSON-786410742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e7110ea-9f08-4353-9e4d-315801e90bc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:05:34 devstack sudo[84132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-80e7a5cb-9ef2-4aa9-91a6-6d7d841c82ae 1073741824 Apr 16 15:05:34 devstack sudo[84132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:05:34 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-93f6ac5c-71d9-4678-b53c-e4907f63ad61 tempest-VolumesTestJSON-786410742 None] Volume volume-ef528c63-0cc5-40d8-ae58-7c33b5718189 (ef528c63-0cc5-40d8-ae58-7c33b5718189): created successfully Apr 16 15:05:34 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-93f6ac5c-71d9-4678-b53c-e4907f63ad61 tempest-VolumesTestJSON-786410742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e7110ea-9f08-4353-9e4d-315801e90bc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:05:34 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-93f6ac5c-71d9-4678-b53c-e4907f63ad61 tempest-VolumesTestJSON-786410742 None] Flow 'volume_create_manager' (c91fbe5b-d43e-4d63-b7dd-6d973e3ad6d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:05:34 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-93f6ac5c-71d9-4678-b53c-e4907f63ad61 tempest-VolumesTestJSON-786410742 None] Created volume successfully. Apr 16 15:05:34 devstack sudo[84132]: pam_unix(sudo:session): session closed for user root Apr 16 15:05:34 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [req-56095ce1-3780-468e-8ef5-afa12998e788 req-fb4c0e2b-51cd-4c0d-9f2f-5377f5f67ef5 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-80e7a5cb-9ef2-4aa9-91a6-6d7d841c82ae 1073741824" returned: 0 in 0.748s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:05:35 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [req-56095ce1-3780-468e-8ef5-afa12998e788 req-fb4c0e2b-51cd-4c0d-9f2f-5377f5f67ef5 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-80e7a5cb-9ef2-4aa9-91a6-6d7d841c82ae {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:05:35 devstack sudo[84164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-80e7a5cb-9ef2-4aa9-91a6-6d7d841c82ae Apr 16 15:05:35 devstack sudo[84164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:05:35 devstack sudo[84164]: pam_unix(sudo:session): session closed for user root Apr 16 15:05:35 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [req-56095ce1-3780-468e-8ef5-afa12998e788 req-fb4c0e2b-51cd-4c0d-9f2f-5377f5f67ef5 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-80e7a5cb-9ef2-4aa9-91a6-6d7d841c82ae" returned: 0 in 0.658s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:05:35 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [req-56095ce1-3780-468e-8ef5-afa12998e788 req-fb4c0e2b-51cd-4c0d-9f2f-5377f5f67ef5 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] <== create_volume: return (1435ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'} {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 15:05:35 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [req-56095ce1-3780-468e-8ef5-afa12998e788 req-fb4c0e2b-51cd-4c0d-9f2f-5377f5f67ef5 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.438s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:05:35 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [req-56095ce1-3780-468e-8ef5-afa12998e788 req-fb4c0e2b-51cd-4c0d-9f2f-5377f5f67ef5 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3b3050b-ab2e-4e5f-9e8c-6b8b15fce1c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80e7a5cb-9ef2-4aa9-91a6-6d7d841c82ae', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:05:35 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [req-56095ce1-3780-468e-8ef5-afa12998e788 req-fb4c0e2b-51cd-4c0d-9f2f-5377f5f67ef5 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61cc3646-a074-42ff-b148-9dc69880363a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:05:35 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [req-56095ce1-3780-468e-8ef5-afa12998e788 req-fb4c0e2b-51cd-4c0d-9f2f-5377f5f67ef5 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Volume volume-80e7a5cb-9ef2-4aa9-91a6-6d7d841c82ae (80e7a5cb-9ef2-4aa9-91a6-6d7d841c82ae): created successfully Apr 16 15:05:35 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [req-56095ce1-3780-468e-8ef5-afa12998e788 req-fb4c0e2b-51cd-4c0d-9f2f-5377f5f67ef5 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61cc3646-a074-42ff-b148-9dc69880363a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:05:35 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [req-56095ce1-3780-468e-8ef5-afa12998e788 req-fb4c0e2b-51cd-4c0d-9f2f-5377f5f67ef5 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Flow 'volume_create_manager' (22935b72-679f-4218-8839-4745f259ef58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:05:35 devstack cinder-volume[82756]: INFO cinder.volume.manager [req-56095ce1-3780-468e-8ef5-afa12998e788 req-fb4c0e2b-51cd-4c0d-9f2f-5377f5f67ef5 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Created volume successfully. Apr 16 15:05:36 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-1ceeb553-651f-4a67-84dd-6f565c5ae718 tempest-VolumesTestJSON-786410742 None] Acquiring lock "cinder-ef528c63-0cc5-40d8-ae58-7c33b5718189-delete_volume" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:05:36 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-1ceeb553-651f-4a67-84dd-6f565c5ae718 tempest-VolumesTestJSON-786410742 None] Lock "cinder-ef528c63-0cc5-40d8-ae58-7c33b5718189-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:05:36 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-1ceeb553-651f-4a67-84dd-6f565c5ae718 tempest-VolumesTestJSON-786410742 None] Acquiring lock "cinder-quobyte-ef528c63-0cc5-40d8-ae58-7c33b5718189" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:05:36 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-1ceeb553-651f-4a67-84dd-6f565c5ae718 tempest-VolumesTestJSON-786410742 None] Lock "cinder-quobyte-ef528c63-0cc5-40d8-ae58-7c33b5718189" acquired by "delete_volume" :: waited 0.008s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:05:36 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb2fc801-9413-4d6e-9bfb-3a907bb6f427]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:05:36 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-1ceeb553-651f-4a67-84dd-6f565c5ae718 tempest-VolumesTestJSON-786410742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-ef528c63-0cc5-40d8-ae58-7c33b5718189 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:05:36 devstack sudo[84199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-ef528c63-0cc5-40d8-ae58-7c33b5718189 Apr 16 15:05:36 devstack sudo[84199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:05:36 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [req-56095ce1-3780-468e-8ef5-afa12998e788 req-effc1ad9-15f7-405e-9ada-3afd5732d3ae tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:05:36 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [req-56095ce1-3780-468e-8ef5-afa12998e788 req-effc1ad9-15f7-405e-9ada-3afd5732d3ae tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:05:36 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bc20831-9b08-45d2-9651-107d60800344]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:05:36 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [req-56095ce1-3780-468e-8ef5-afa12998e788 req-effc1ad9-15f7-405e-9ada-3afd5732d3ae tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-80e7a5cb-9ef2-4aa9-91a6-6d7d841c82ae {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:05:36 devstack sudo[84211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-80e7a5cb-9ef2-4aa9-91a6-6d7d841c82ae Apr 16 15:05:36 devstack sudo[84211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:05:37 devstack sudo[84199]: pam_unix(sudo:session): session closed for user root Apr 16 15:05:37 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-1ceeb553-651f-4a67-84dd-6f565c5ae718 tempest-VolumesTestJSON-786410742 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-ef528c63-0cc5-40d8-ae58-7c33b5718189" returned: 0 in 0.896s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:05:37 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-1ceeb553-651f-4a67-84dd-6f565c5ae718 tempest-VolumesTestJSON-786410742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-ef528c63-0cc5-40d8-ae58-7c33b5718189 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:05:37 devstack sudo[84216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-ef528c63-0cc5-40d8-ae58-7c33b5718189 Apr 16 15:05:37 devstack sudo[84216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:05:37 devstack sudo[84211]: pam_unix(sudo:session): session closed for user root Apr 16 15:05:37 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [req-56095ce1-3780-468e-8ef5-afa12998e788 req-effc1ad9-15f7-405e-9ada-3afd5732d3ae tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-80e7a5cb-9ef2-4aa9-91a6-6d7d841c82ae" returned: 0 in 0.611s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:05:37 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [req-56095ce1-3780-468e-8ef5-afa12998e788 req-effc1ad9-15f7-405e-9ada-3afd5732d3ae tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.625s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:05:37 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [req-56095ce1-3780-468e-8ef5-afa12998e788 req-effc1ad9-15f7-405e-9ada-3afd5732d3ae tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781', 'name': 'volume-80e7a5cb-9ef2-4aa9-91a6-6d7d841c82ae', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fcef1686-eee6-4560-816c-d5b807e8ba82', 'enforce_multipath': True} {{(pid=82756) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 16 15:05:37 devstack cinder-volume[82756]: INFO cinder.volume.manager [req-56095ce1-3780-468e-8ef5-afa12998e788 req-effc1ad9-15f7-405e-9ada-3afd5732d3ae tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] attachment_update completed successfully. Apr 16 15:05:37 devstack cinder-volume[82756]: INFO cinder.volume.manager [req-04443adb-124a-4e9b-8716-bddb0b0e74bf req-e63a988e-d162-4eb3-a0a5-5275d0f3217a tempest-DeleteServersTestJSON-859659515 None] Terminate volume connection completed successfully. Apr 16 15:05:37 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [req-04443adb-124a-4e9b-8716-bddb0b0e74bf req-e63a988e-d162-4eb3-a0a5-5275d0f3217a tempest-DeleteServersTestJSON-859659515 None] Deleting attachment bc1823c9-2182-4f1a-af45-0a4999f40e92. {{(pid=82756) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 16 15:05:37 devstack sudo[84216]: pam_unix(sudo:session): session closed for user root Apr 16 15:05:37 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-1ceeb553-651f-4a67-84dd-6f565c5ae718 tempest-VolumesTestJSON-786410742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-ef528c63-0cc5-40d8-ae58-7c33b5718189" returned: 0 in 0.756s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:05:37 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-1ceeb553-651f-4a67-84dd-6f565c5ae718 tempest-VolumesTestJSON-786410742 None] Lock "cinder-quobyte-ef528c63-0cc5-40d8-ae58-7c33b5718189" released by "delete_volume" :: held 1.695s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:05:37 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-1ceeb553-651f-4a67-84dd-6f565c5ae718 tempest-VolumesTestJSON-786410742 None] Created reservations ['e32c1b9a-76d4-4bda-b26b-8ea99a368d23', 'c66aaad9-f288-4fe4-a22a-79b16513ab5b', 'cf9e3916-05d0-423c-99b3-7103a0d1b689', '91f3ffbf-d3d7-4c69-99d9-035d393d4204'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:05:37 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-1ceeb553-651f-4a67-84dd-6f565c5ae718 tempest-VolumesTestJSON-786410742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:05:37 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-1ceeb553-651f-4a67-84dd-6f565c5ae718 tempest-VolumesTestJSON-786410742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:05:37 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-1ceeb553-651f-4a67-84dd-6f565c5ae718 tempest-VolumesTestJSON-786410742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:05:37 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-1ceeb553-651f-4a67-84dd-6f565c5ae718 tempest-VolumesTestJSON-786410742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:05:37 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-1ceeb553-651f-4a67-84dd-6f565c5ae718 tempest-VolumesTestJSON-786410742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:05:37 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-1ceeb553-651f-4a67-84dd-6f565c5ae718 tempest-VolumesTestJSON-786410742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:05:37 devstack sudo[84225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:05:37 devstack sudo[84225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:05:38 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-b36a20ef-0f3f-4dad-82c6-a4cf99c2de0d tempest-VolumesTestJSON-786410742 None] Acquiring lock "cinder-b511317a-9b9f-43bb-b8c7-76d083848f88-delete_volume" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:05:38 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-b36a20ef-0f3f-4dad-82c6-a4cf99c2de0d tempest-VolumesTestJSON-786410742 None] Lock "cinder-b511317a-9b9f-43bb-b8c7-76d083848f88-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:05:38 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-b36a20ef-0f3f-4dad-82c6-a4cf99c2de0d tempest-VolumesTestJSON-786410742 None] Acquiring lock "cinder-quobyte-b511317a-9b9f-43bb-b8c7-76d083848f88" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:05:38 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-b36a20ef-0f3f-4dad-82c6-a4cf99c2de0d tempest-VolumesTestJSON-786410742 None] Lock "cinder-quobyte-b511317a-9b9f-43bb-b8c7-76d083848f88" acquired by "delete_volume" :: waited 0.007s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:05:38 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[258e8381-a8f3-4a30-a608-4fd1b6d59db5]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:05:38 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-b36a20ef-0f3f-4dad-82c6-a4cf99c2de0d tempest-VolumesTestJSON-786410742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b511317a-9b9f-43bb-b8c7-76d083848f88 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:05:38 devstack sudo[84228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b511317a-9b9f-43bb-b8c7-76d083848f88 Apr 16 15:05:38 devstack sudo[84228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:05:38 devstack sudo[84225]: pam_unix(sudo:session): session closed for user root Apr 16 15:05:38 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-1ceeb553-651f-4a67-84dd-6f565c5ae718 tempest-VolumesTestJSON-786410742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.596s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:05:38 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-1ceeb553-651f-4a67-84dd-6f565c5ae718 tempest-VolumesTestJSON-786410742 None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:05:38 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-1ceeb553-651f-4a67-84dd-6f565c5ae718 tempest-VolumesTestJSON-786410742 None] Deleted volume successfully. Apr 16 15:05:38 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-1ceeb553-651f-4a67-84dd-6f565c5ae718 tempest-VolumesTestJSON-786410742 None] Lock "cinder-ef528c63-0cc5-40d8-ae58-7c33b5718189-delete_volume" released by "delete_volume" :: held 2.414s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:05:39 devstack sudo[84228]: pam_unix(sudo:session): session closed for user root Apr 16 15:05:39 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-b36a20ef-0f3f-4dad-82c6-a4cf99c2de0d tempest-VolumesTestJSON-786410742 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b511317a-9b9f-43bb-b8c7-76d083848f88" returned: 0 in 0.698s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:05:39 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-b36a20ef-0f3f-4dad-82c6-a4cf99c2de0d tempest-VolumesTestJSON-786410742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b511317a-9b9f-43bb-b8c7-76d083848f88 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:05:39 devstack sudo[84233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b511317a-9b9f-43bb-b8c7-76d083848f88 Apr 16 15:05:39 devstack sudo[84233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:05:39 devstack sudo[84233]: pam_unix(sudo:session): session closed for user root Apr 16 15:05:39 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-b36a20ef-0f3f-4dad-82c6-a4cf99c2de0d tempest-VolumesTestJSON-786410742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b511317a-9b9f-43bb-b8c7-76d083848f88" returned: 0 in 0.575s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:05:39 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-b36a20ef-0f3f-4dad-82c6-a4cf99c2de0d tempest-VolumesTestJSON-786410742 None] Lock "cinder-quobyte-b511317a-9b9f-43bb-b8c7-76d083848f88" released by "delete_volume" :: held 1.314s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:05:39 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-b36a20ef-0f3f-4dad-82c6-a4cf99c2de0d tempest-VolumesTestJSON-786410742 None] Created reservations ['db8c8148-07c4-4767-bcd9-fbfe79175aec', 'ee1b371e-6802-4d08-8b73-3b701fe92e89', '48027baf-0384-48d4-80cb-7c0abdd70409', 'c867dd27-8a1b-48d1-856c-216293f5a929'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:05:39 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-b36a20ef-0f3f-4dad-82c6-a4cf99c2de0d tempest-VolumesTestJSON-786410742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:05:39 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-b36a20ef-0f3f-4dad-82c6-a4cf99c2de0d tempest-VolumesTestJSON-786410742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:05:39 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-b36a20ef-0f3f-4dad-82c6-a4cf99c2de0d tempest-VolumesTestJSON-786410742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:05:39 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-b36a20ef-0f3f-4dad-82c6-a4cf99c2de0d tempest-VolumesTestJSON-786410742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:05:39 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-b36a20ef-0f3f-4dad-82c6-a4cf99c2de0d tempest-VolumesTestJSON-786410742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:05:39 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-b36a20ef-0f3f-4dad-82c6-a4cf99c2de0d tempest-VolumesTestJSON-786410742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:05:39 devstack sudo[84304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:05:39 devstack sudo[84304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:05:40 devstack sudo[84304]: pam_unix(sudo:session): session closed for user root Apr 16 15:05:40 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-b36a20ef-0f3f-4dad-82c6-a4cf99c2de0d tempest-VolumesTestJSON-786410742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.544s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:05:40 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-b36a20ef-0f3f-4dad-82c6-a4cf99c2de0d tempest-VolumesTestJSON-786410742 None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:05:40 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-b36a20ef-0f3f-4dad-82c6-a4cf99c2de0d tempest-VolumesTestJSON-786410742 None] Deleted volume successfully. Apr 16 15:05:40 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-b36a20ef-0f3f-4dad-82c6-a4cf99c2de0d tempest-VolumesTestJSON-786410742 None] Lock "cinder-b511317a-9b9f-43bb-b8c7-76d083848f88-delete_volume" released by "delete_volume" :: held 2.018s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:05:40 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-6af6cbb0-3694-41e6-9454-eb28da9e23b6 tempest-VolumesTestJSON-786410742 None] Acquiring lock "cinder-6a544285-7f41-448d-b6d0-761b9999d038-delete_volume" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:05:40 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-6af6cbb0-3694-41e6-9454-eb28da9e23b6 tempest-VolumesTestJSON-786410742 None] Lock "cinder-6a544285-7f41-448d-b6d0-761b9999d038-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:05:40 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-6af6cbb0-3694-41e6-9454-eb28da9e23b6 tempest-VolumesTestJSON-786410742 None] Acquiring lock "cinder-quobyte-6a544285-7f41-448d-b6d0-761b9999d038" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:05:40 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-6af6cbb0-3694-41e6-9454-eb28da9e23b6 tempest-VolumesTestJSON-786410742 None] Lock "cinder-quobyte-6a544285-7f41-448d-b6d0-761b9999d038" acquired by "delete_volume" :: waited 0.013s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:05:40 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[e48a0958-a1d4-4e29-92c4-ed74e1d9a234]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:05:40 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-6af6cbb0-3694-41e6-9454-eb28da9e23b6 tempest-VolumesTestJSON-786410742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6a544285-7f41-448d-b6d0-761b9999d038 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:05:40 devstack sudo[84310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6a544285-7f41-448d-b6d0-761b9999d038 Apr 16 15:05:40 devstack sudo[84310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:05:41 devstack sudo[84310]: pam_unix(sudo:session): session closed for user root Apr 16 15:05:41 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-6af6cbb0-3694-41e6-9454-eb28da9e23b6 tempest-VolumesTestJSON-786410742 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6a544285-7f41-448d-b6d0-761b9999d038" returned: 0 in 0.544s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:05:41 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-6af6cbb0-3694-41e6-9454-eb28da9e23b6 tempest-VolumesTestJSON-786410742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6a544285-7f41-448d-b6d0-761b9999d038 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:05:41 devstack sudo[84316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6a544285-7f41-448d-b6d0-761b9999d038 Apr 16 15:05:41 devstack sudo[84316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:05:41 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-587cf026-e94a-4f96-9121-e94d74088d5d tempest-DeleteServersTestJSON-859659515 None] Acquiring lock "cinder-26df0baf-385a-46b3-9f76-b576c201e79d-delete_volume" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:05:41 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-587cf026-e94a-4f96-9121-e94d74088d5d tempest-DeleteServersTestJSON-859659515 None] Lock "cinder-26df0baf-385a-46b3-9f76-b576c201e79d-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:05:41 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-587cf026-e94a-4f96-9121-e94d74088d5d tempest-DeleteServersTestJSON-859659515 None] Acquiring lock "cinder-quobyte-26df0baf-385a-46b3-9f76-b576c201e79d" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:05:41 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-587cf026-e94a-4f96-9121-e94d74088d5d tempest-DeleteServersTestJSON-859659515 None] Lock "cinder-quobyte-26df0baf-385a-46b3-9f76-b576c201e79d" acquired by "delete_volume" :: waited 0.025s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:05:41 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[22ebcf5e-e95f-4e90-8aa1-188983d3cfb5]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:05:41 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-587cf026-e94a-4f96-9121-e94d74088d5d tempest-DeleteServersTestJSON-859659515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-26df0baf-385a-46b3-9f76-b576c201e79d {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:05:41 devstack sudo[84318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-26df0baf-385a-46b3-9f76-b576c201e79d Apr 16 15:05:41 devstack sudo[84318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:05:41 devstack sudo[84316]: pam_unix(sudo:session): session closed for user root Apr 16 15:05:41 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-6af6cbb0-3694-41e6-9454-eb28da9e23b6 tempest-VolumesTestJSON-786410742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6a544285-7f41-448d-b6d0-761b9999d038" returned: 0 in 0.555s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:05:41 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-6af6cbb0-3694-41e6-9454-eb28da9e23b6 tempest-VolumesTestJSON-786410742 None] Lock "cinder-quobyte-6a544285-7f41-448d-b6d0-761b9999d038" released by "delete_volume" :: held 1.136s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:05:41 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-6af6cbb0-3694-41e6-9454-eb28da9e23b6 tempest-VolumesTestJSON-786410742 None] Created reservations ['6dd803df-a145-48c0-9c9e-71907ddcf95e', '30058c96-8252-4a74-b93d-61a55ae43c35', 'f3154528-6b7f-445b-b8de-9582f68b018e', 'a6c031f0-03ae-47f9-a5a7-7e56bc390f88'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:05:41 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-6af6cbb0-3694-41e6-9454-eb28da9e23b6 tempest-VolumesTestJSON-786410742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:05:41 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-6af6cbb0-3694-41e6-9454-eb28da9e23b6 tempest-VolumesTestJSON-786410742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:05:41 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-6af6cbb0-3694-41e6-9454-eb28da9e23b6 tempest-VolumesTestJSON-786410742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:05:41 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-6af6cbb0-3694-41e6-9454-eb28da9e23b6 tempest-VolumesTestJSON-786410742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:05:41 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-6af6cbb0-3694-41e6-9454-eb28da9e23b6 tempest-VolumesTestJSON-786410742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:05:41 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-6af6cbb0-3694-41e6-9454-eb28da9e23b6 tempest-VolumesTestJSON-786410742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:05:41 devstack sudo[84321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:05:41 devstack sudo[84321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:05:42 devstack sudo[84318]: pam_unix(sudo:session): session closed for user root Apr 16 15:05:42 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-587cf026-e94a-4f96-9121-e94d74088d5d tempest-DeleteServersTestJSON-859659515 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-26df0baf-385a-46b3-9f76-b576c201e79d" returned: 0 in 0.573s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:05:42 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-587cf026-e94a-4f96-9121-e94d74088d5d tempest-DeleteServersTestJSON-859659515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-26df0baf-385a-46b3-9f76-b576c201e79d {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:05:42 devstack sudo[84326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-26df0baf-385a-46b3-9f76-b576c201e79d Apr 16 15:05:42 devstack sudo[84326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:05:42 devstack sudo[84321]: pam_unix(sudo:session): session closed for user root Apr 16 15:05:42 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-6af6cbb0-3694-41e6-9454-eb28da9e23b6 tempest-VolumesTestJSON-786410742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.643s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:05:42 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-6af6cbb0-3694-41e6-9454-eb28da9e23b6 tempest-VolumesTestJSON-786410742 None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:05:42 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-6af6cbb0-3694-41e6-9454-eb28da9e23b6 tempest-VolumesTestJSON-786410742 None] Deleted volume successfully. Apr 16 15:05:42 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-6af6cbb0-3694-41e6-9454-eb28da9e23b6 tempest-VolumesTestJSON-786410742 None] Lock "cinder-6a544285-7f41-448d-b6d0-761b9999d038-delete_volume" released by "delete_volume" :: held 1.983s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:05:43 devstack sudo[84326]: pam_unix(sudo:session): session closed for user root Apr 16 15:05:43 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-587cf026-e94a-4f96-9121-e94d74088d5d tempest-DeleteServersTestJSON-859659515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-26df0baf-385a-46b3-9f76-b576c201e79d" returned: 0 in 0.953s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:05:43 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-587cf026-e94a-4f96-9121-e94d74088d5d tempest-DeleteServersTestJSON-859659515 None] Lock "cinder-quobyte-26df0baf-385a-46b3-9f76-b576c201e79d" released by "delete_volume" :: held 1.590s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:05:43 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-587cf026-e94a-4f96-9121-e94d74088d5d tempest-DeleteServersTestJSON-859659515 None] Created reservations ['c10a2dda-ee67-408d-813d-9b6763a0fd9a', 'c1a29328-5fe8-4e9e-84f7-8dc4553c790b', '9aa8c31b-0a97-4c40-9dcc-0fbbcf09489f', '3fbbbbda-5a77-4226-8f7e-15f838dd16dc'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:05:43 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-587cf026-e94a-4f96-9121-e94d74088d5d tempest-DeleteServersTestJSON-859659515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:05:43 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-587cf026-e94a-4f96-9121-e94d74088d5d tempest-DeleteServersTestJSON-859659515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:05:43 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-587cf026-e94a-4f96-9121-e94d74088d5d tempest-DeleteServersTestJSON-859659515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:05:43 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-587cf026-e94a-4f96-9121-e94d74088d5d tempest-DeleteServersTestJSON-859659515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:05:43 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-587cf026-e94a-4f96-9121-e94d74088d5d tempest-DeleteServersTestJSON-859659515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:05:43 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-587cf026-e94a-4f96-9121-e94d74088d5d tempest-DeleteServersTestJSON-859659515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:05:43 devstack sudo[84670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:05:43 devstack sudo[84670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:05:44 devstack sudo[84670]: pam_unix(sudo:session): session closed for user root Apr 16 15:05:44 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-587cf026-e94a-4f96-9121-e94d74088d5d tempest-DeleteServersTestJSON-859659515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.752s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:05:44 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-587cf026-e94a-4f96-9121-e94d74088d5d tempest-DeleteServersTestJSON-859659515 None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:05:44 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-587cf026-e94a-4f96-9121-e94d74088d5d tempest-DeleteServersTestJSON-859659515 None] Deleted volume successfully. Apr 16 15:05:44 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-587cf026-e94a-4f96-9121-e94d74088d5d tempest-DeleteServersTestJSON-859659515 None] Lock "cinder-26df0baf-385a-46b3-9f76-b576c201e79d-delete_volume" released by "delete_volume" :: held 2.697s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:05:51 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [req-5afebe8b-a5d8-4733-9799-b7107e467a13 req-31636200-5095-42b0-9678-337690f16857 tempest-VolumesSnapshotsTestJSON-705068246 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82756) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 15:05:51 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [req-5afebe8b-a5d8-4733-9799-b7107e467a13 req-31636200-5095-42b0-9678-337690f16857 tempest-VolumesSnapshotsTestJSON-705068246 None] Flow 'volume_create_manager' (db344ff0-d715-46ad-9d98-1ac87d5f6d71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:05:51 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [req-5afebe8b-a5d8-4733-9799-b7107e467a13 req-31636200-5095-42b0-9678-337690f16857 tempest-VolumesSnapshotsTestJSON-705068246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7e88eb1-eb82-489e-a84b-8106d5ee1d49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:05:51 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [req-5afebe8b-a5d8-4733-9799-b7107e467a13 req-31636200-5095-42b0-9678-337690f16857 tempest-VolumesSnapshotsTestJSON-705068246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7e88eb1-eb82-489e-a84b-8106d5ee1d49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:05:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1032077119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4670c443-e846-4d40-8ea4-242feda9aa3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b05060a1f0f54f318df728dcf0c7a95a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:05:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:05:51Z,use_quota=True,user_id='085a7bf61826427387dea4293b76ab5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:05:51 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [req-5afebe8b-a5d8-4733-9799-b7107e467a13 req-31636200-5095-42b0-9678-337690f16857 tempest-VolumesSnapshotsTestJSON-705068246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af4c9f71-e609-4df9-b028-781d6f605070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:05:51 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [req-5afebe8b-a5d8-4733-9799-b7107e467a13 req-31636200-5095-42b0-9678-337690f16857 tempest-VolumesSnapshotsTestJSON-705068246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af4c9f71-e609-4df9-b028-781d6f605070) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:05:51 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [req-5afebe8b-a5d8-4733-9799-b7107e467a13 req-31636200-5095-42b0-9678-337690f16857 tempest-VolumesSnapshotsTestJSON-705068246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33a5b87d-074e-4151-942b-175ef8d9c555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:05:51 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [req-5afebe8b-a5d8-4733-9799-b7107e467a13 req-31636200-5095-42b0-9678-337690f16857 tempest-VolumesSnapshotsTestJSON-705068246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33a5b87d-074e-4151-942b-175ef8d9c555) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4670c443-e846-4d40-8ea4-242feda9aa3d', 'volume_name': 'volume-4670c443-e846-4d40-8ea4-242feda9aa3d', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:05:51 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [req-5afebe8b-a5d8-4733-9799-b7107e467a13 req-31636200-5095-42b0-9678-337690f16857 tempest-VolumesSnapshotsTestJSON-705068246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b43f5cd-3272-4a43-8361-e298ea78bc57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:05:51 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [req-5afebe8b-a5d8-4733-9799-b7107e467a13 req-31636200-5095-42b0-9678-337690f16857 tempest-VolumesSnapshotsTestJSON-705068246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b43f5cd-3272-4a43-8361-e298ea78bc57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:05:51 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [req-5afebe8b-a5d8-4733-9799-b7107e467a13 req-31636200-5095-42b0-9678-337690f16857 tempest-VolumesSnapshotsTestJSON-705068246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67b5c077-24df-484e-bfbc-aa93e252e2ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:05:51 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [req-5afebe8b-a5d8-4733-9799-b7107e467a13 req-31636200-5095-42b0-9678-337690f16857 tempest-VolumesSnapshotsTestJSON-705068246 None] Volume 4670c443-e846-4d40-8ea4-242feda9aa3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4670c443-e846-4d40-8ea4-242feda9aa3d', 'volume_size': 1} Apr 16 15:05:51 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [req-5afebe8b-a5d8-4733-9799-b7107e467a13 req-31636200-5095-42b0-9678-337690f16857 tempest-VolumesSnapshotsTestJSON-705068246 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:05:51 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [req-5afebe8b-a5d8-4733-9799-b7107e467a13 req-31636200-5095-42b0-9678-337690f16857 tempest-VolumesSnapshotsTestJSON-705068246 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:05:51 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [req-5afebe8b-a5d8-4733-9799-b7107e467a13 req-31636200-5095-42b0-9678-337690f16857 tempest-VolumesSnapshotsTestJSON-705068246 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:05:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1032077119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4670c443-e846-4d40-8ea4-242feda9aa3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b05060a1f0f54f318df728dcf0c7a95a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:05:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:05:51Z,use_quota=True,user_id='085a7bf61826427387dea4293b76ab5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)}" {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 15:05:51 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [req-5afebe8b-a5d8-4733-9799-b7107e467a13 req-31636200-5095-42b0-9678-337690f16857 tempest-VolumesSnapshotsTestJSON-705068246 None] Creating volume 4670c443-e846-4d40-8ea4-242feda9aa3d {{(pid=82756) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 15:05:51 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [req-5afebe8b-a5d8-4733-9799-b7107e467a13 req-31636200-5095-42b0-9678-337690f16857 tempest-VolumesSnapshotsTestJSON-705068246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:05:51 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [req-5afebe8b-a5d8-4733-9799-b7107e467a13 req-31636200-5095-42b0-9678-337690f16857 tempest-VolumesSnapshotsTestJSON-705068246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:05:51 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [req-5afebe8b-a5d8-4733-9799-b7107e467a13 req-31636200-5095-42b0-9678-337690f16857 tempest-VolumesSnapshotsTestJSON-705068246 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:05:51 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [req-5afebe8b-a5d8-4733-9799-b7107e467a13 req-31636200-5095-42b0-9678-337690f16857 tempest-VolumesSnapshotsTestJSON-705068246 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:05:51 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [req-5afebe8b-a5d8-4733-9799-b7107e467a13 req-31636200-5095-42b0-9678-337690f16857 tempest-VolumesSnapshotsTestJSON-705068246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:05:51 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [req-5afebe8b-a5d8-4733-9799-b7107e467a13 req-31636200-5095-42b0-9678-337690f16857 tempest-VolumesSnapshotsTestJSON-705068246 None] Selected osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 as target Quobyte volume. {{(pid=82756) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 15:05:51 devstack cinder-volume[82756]: INFO cinder.volume.drivers.remotefs [req-5afebe8b-a5d8-4733-9799-b7107e467a13 req-31636200-5095-42b0-9678-337690f16857 tempest-VolumesSnapshotsTestJSON-705068246 None] casted to osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 Apr 16 15:05:51 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [req-5afebe8b-a5d8-4733-9799-b7107e467a13 req-31636200-5095-42b0-9678-337690f16857 tempest-VolumesSnapshotsTestJSON-705068246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-4670c443-e846-4d40-8ea4-242feda9aa3d 1073741824 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:05:51 devstack sudo[84683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-4670c443-e846-4d40-8ea4-242feda9aa3d 1073741824 Apr 16 15:05:51 devstack sudo[84683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:05:51 devstack sudo[84683]: pam_unix(sudo:session): session closed for user root Apr 16 15:05:51 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [req-5afebe8b-a5d8-4733-9799-b7107e467a13 req-31636200-5095-42b0-9678-337690f16857 tempest-VolumesSnapshotsTestJSON-705068246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-4670c443-e846-4d40-8ea4-242feda9aa3d 1073741824" returned: 0 in 0.635s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:05:51 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [req-5afebe8b-a5d8-4733-9799-b7107e467a13 req-31636200-5095-42b0-9678-337690f16857 tempest-VolumesSnapshotsTestJSON-705068246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-4670c443-e846-4d40-8ea4-242feda9aa3d {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:05:51 devstack cinder-volume[82756]: DEBUG oslo_service.periodic_task [None req-9570f02d-5ef9-412b-993f-520a9e5bfa81 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82756) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 16 15:05:51 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-9570f02d-5ef9-412b-993f-520a9e5bfa81 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:05:51 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-9570f02d-5ef9-412b-993f-520a9e5bfa81 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:05:51 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-9570f02d-5ef9-412b-993f-520a9e5bfa81 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:05:51 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-9570f02d-5ef9-412b-993f-520a9e5bfa81 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:05:51 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-9570f02d-5ef9-412b-993f-520a9e5bfa81 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:05:51 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-9570f02d-5ef9-412b-993f-520a9e5bfa81 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:05:51 devstack sudo[84688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-4670c443-e846-4d40-8ea4-242feda9aa3d Apr 16 15:05:51 devstack sudo[84688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:05:51 devstack sudo[84689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:05:51 devstack sudo[84689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:05:52 devstack sudo[84689]: pam_unix(sudo:session): session closed for user root Apr 16 15:05:52 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-9570f02d-5ef9-412b-993f-520a9e5bfa81 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.559s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:05:52 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-9570f02d-5ef9-412b-993f-520a9e5bfa81 None None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:05:52 devstack sudo[84688]: pam_unix(sudo:session): session closed for user root Apr 16 15:05:52 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-e08d4c1e-420b-454e-8165-db3dd9d97452 tempest-GroupSnapshotsV319Test-2140345526 None] Group tempest-GroupSnapshotsV319Test-Group-676536876: creating Apr 16 15:05:52 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [req-5afebe8b-a5d8-4733-9799-b7107e467a13 req-31636200-5095-42b0-9678-337690f16857 tempest-VolumesSnapshotsTestJSON-705068246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-4670c443-e846-4d40-8ea4-242feda9aa3d" returned: 0 in 0.634s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:05:52 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [req-5afebe8b-a5d8-4733-9799-b7107e467a13 req-31636200-5095-42b0-9678-337690f16857 tempest-VolumesSnapshotsTestJSON-705068246 None] <== create_volume: return (1303ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'} {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 15:05:52 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [req-5afebe8b-a5d8-4733-9799-b7107e467a13 req-31636200-5095-42b0-9678-337690f16857 tempest-VolumesSnapshotsTestJSON-705068246 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.305s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:05:52 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [req-5afebe8b-a5d8-4733-9799-b7107e467a13 req-31636200-5095-42b0-9678-337690f16857 tempest-VolumesSnapshotsTestJSON-705068246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67b5c077-24df-484e-bfbc-aa93e252e2ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4670c443-e846-4d40-8ea4-242feda9aa3d', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:05:52 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [req-5afebe8b-a5d8-4733-9799-b7107e467a13 req-31636200-5095-42b0-9678-337690f16857 tempest-VolumesSnapshotsTestJSON-705068246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f01847ef-5103-4898-a0f7-a02dff3e0171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:05:52 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-e08d4c1e-420b-454e-8165-db3dd9d97452 tempest-GroupSnapshotsV319Test-2140345526 None] Group tempest-GroupSnapshotsV319Test-Group-676536876: created successfully Apr 16 15:05:52 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [req-5afebe8b-a5d8-4733-9799-b7107e467a13 req-31636200-5095-42b0-9678-337690f16857 tempest-VolumesSnapshotsTestJSON-705068246 None] Volume volume-4670c443-e846-4d40-8ea4-242feda9aa3d (4670c443-e846-4d40-8ea4-242feda9aa3d): created successfully Apr 16 15:05:52 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [req-5afebe8b-a5d8-4733-9799-b7107e467a13 req-31636200-5095-42b0-9678-337690f16857 tempest-VolumesSnapshotsTestJSON-705068246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f01847ef-5103-4898-a0f7-a02dff3e0171) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:05:52 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [req-5afebe8b-a5d8-4733-9799-b7107e467a13 req-31636200-5095-42b0-9678-337690f16857 tempest-VolumesSnapshotsTestJSON-705068246 None] Flow 'volume_create_manager' (db344ff0-d715-46ad-9d98-1ac87d5f6d71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:05:52 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-e08d4c1e-420b-454e-8165-db3dd9d97452 tempest-GroupSnapshotsV319Test-2140345526 None] Create group completed successfully. Apr 16 15:05:52 devstack cinder-volume[82756]: INFO cinder.volume.manager [req-5afebe8b-a5d8-4733-9799-b7107e467a13 req-31636200-5095-42b0-9678-337690f16857 tempest-VolumesSnapshotsTestJSON-705068246 None] Created volume successfully. Apr 16 15:05:53 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [req-ebf00946-548e-447a-92d8-3ed3e5f1f273 req-ca946342-d55a-40e7-a3df-9b1c70870522 tempest-VolumesSnapshotsTestJSON-705068246 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:05:53 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [req-ebf00946-548e-447a-92d8-3ed3e5f1f273 req-ca946342-d55a-40e7-a3df-9b1c70870522 tempest-VolumesSnapshotsTestJSON-705068246 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:05:53 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [req-ebf00946-548e-447a-92d8-3ed3e5f1f273 req-ca946342-d55a-40e7-a3df-9b1c70870522 tempest-VolumesSnapshotsTestJSON-705068246 None] Creating offline snapshot 869e4de1-0d94-4b5d-863c-d41251d0157f of volume 4670c443-e846-4d40-8ea4-242feda9aa3d {{(pid=82756) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 16 15:05:53 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eb66685-bbb5-431b-acbb-ad7a90c640a4]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:05:53 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [req-ebf00946-548e-447a-92d8-3ed3e5f1f273 req-ca946342-d55a-40e7-a3df-9b1c70870522 tempest-VolumesSnapshotsTestJSON-705068246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-4670c443-e846-4d40-8ea4-242feda9aa3d {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:05:53 devstack sudo[84721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-4670c443-e846-4d40-8ea4-242feda9aa3d Apr 16 15:05:53 devstack sudo[84721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:05:54 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [None req-84b19dee-852e-4bcd-a069-a5f5b14a90fa tempest-GroupSnapshotsV319Test-2140345526 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82756) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 15:05:54 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-84b19dee-852e-4bcd-a069-a5f5b14a90fa tempest-GroupSnapshotsV319Test-2140345526 None] Flow 'volume_create_manager' (9f428814-d140-4d59-be7a-474521de4ab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:05:54 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-84b19dee-852e-4bcd-a069-a5f5b14a90fa tempest-GroupSnapshotsV319Test-2140345526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69a4771d-98bf-4a19-a08a-d3cd8f424cd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:05:54 devstack sudo[84721]: pam_unix(sudo:session): session closed for user root Apr 16 15:05:54 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-84b19dee-852e-4bcd-a069-a5f5b14a90fa tempest-GroupSnapshotsV319Test-2140345526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69a4771d-98bf-4a19-a08a-d3cd8f424cd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:05:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1948084980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f41460fc-aafb-4596-9aaa-7d1e84cfbc55,host='devstack@QuobyteHD#QuobyteHD',id=58909726-efe9-45b6-9a97-b544139bc455,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25dda9a475fb4315ada90a55ea2f2e8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:05:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:05:54Z,use_quota=True,user_id='ede3edd2a66143ceb4f3ac2a5fd8de1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a2a0a29-02c5-4c14-adde-a6151a1f8ccb),volume_type_id=2a2a0a29-02c5-4c14-adde-a6151a1f8ccb)' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:05:54 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-84b19dee-852e-4bcd-a069-a5f5b14a90fa tempest-GroupSnapshotsV319Test-2140345526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49353c60-2139-4293-94f3-33273b0527cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:05:54 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-84b19dee-852e-4bcd-a069-a5f5b14a90fa tempest-GroupSnapshotsV319Test-2140345526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49353c60-2139-4293-94f3-33273b0527cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:05:54 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-84b19dee-852e-4bcd-a069-a5f5b14a90fa tempest-GroupSnapshotsV319Test-2140345526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba40bfc9-29b5-4d80-86f3-74ca24d95585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:05:54 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-84b19dee-852e-4bcd-a069-a5f5b14a90fa tempest-GroupSnapshotsV319Test-2140345526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba40bfc9-29b5-4d80-86f3-74ca24d95585) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58909726-efe9-45b6-9a97-b544139bc455', 'volume_name': 'volume-58909726-efe9-45b6-9a97-b544139bc455', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:05:54 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-84b19dee-852e-4bcd-a069-a5f5b14a90fa tempest-GroupSnapshotsV319Test-2140345526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02fa19e5-78cc-48db-8c20-6a76259d7262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:05:54 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-84b19dee-852e-4bcd-a069-a5f5b14a90fa tempest-GroupSnapshotsV319Test-2140345526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02fa19e5-78cc-48db-8c20-6a76259d7262) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:05:54 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-84b19dee-852e-4bcd-a069-a5f5b14a90fa tempest-GroupSnapshotsV319Test-2140345526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04d01061-7f5c-4620-b615-a098655e161c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:05:54 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-84b19dee-852e-4bcd-a069-a5f5b14a90fa tempest-GroupSnapshotsV319Test-2140345526 None] Volume 58909726-efe9-45b6-9a97-b544139bc455: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58909726-efe9-45b6-9a97-b544139bc455', 'volume_size': 1} Apr 16 15:05:54 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-84b19dee-852e-4bcd-a069-a5f5b14a90fa tempest-GroupSnapshotsV319Test-2140345526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:05:54 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [req-ebf00946-548e-447a-92d8-3ed3e5f1f273 req-ca946342-d55a-40e7-a3df-9b1c70870522 tempest-VolumesSnapshotsTestJSON-705068246 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-4670c443-e846-4d40-8ea4-242feda9aa3d" returned: 0 in 0.800s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:05:54 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [req-ebf00946-548e-447a-92d8-3ed3e5f1f273 req-ca946342-d55a-40e7-a3df-9b1c70870522 tempest-VolumesSnapshotsTestJSON-705068246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-4670c443-e846-4d40-8ea4-242feda9aa3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-4670c443-e846-4d40-8ea4-242feda9aa3d.869e4de1-0d94-4b5d-863c-d41251d0157f 1G {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:05:54 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-9cce8660-1b86-46a2-92f3-065df1568357 tempest-GroupsTest-1909532821 None] Group tempest-Group1-418329993: creating Apr 16 15:05:54 devstack sudo[84727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-4670c443-e846-4d40-8ea4-242feda9aa3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-4670c443-e846-4d40-8ea4-242feda9aa3d.869e4de1-0d94-4b5d-863c-d41251d0157f 1G Apr 16 15:05:54 devstack sudo[84727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:05:54 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-9cce8660-1b86-46a2-92f3-065df1568357 tempest-GroupsTest-1909532821 None] Group tempest-Group1-418329993: created successfully Apr 16 15:05:54 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-9cce8660-1b86-46a2-92f3-065df1568357 tempest-GroupsTest-1909532821 None] Create group completed successfully. Apr 16 15:05:54 devstack sudo[84727]: pam_unix(sudo:session): session closed for user root Apr 16 15:05:54 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [req-ebf00946-548e-447a-92d8-3ed3e5f1f273 req-ca946342-d55a-40e7-a3df-9b1c70870522 tempest-VolumesSnapshotsTestJSON-705068246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-4670c443-e846-4d40-8ea4-242feda9aa3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-4670c443-e846-4d40-8ea4-242feda9aa3d.869e4de1-0d94-4b5d-863c-d41251d0157f 1G" returned: 0 in 0.523s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:05:54 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [req-ebf00946-548e-447a-92d8-3ed3e5f1f273 req-ca946342-d55a-40e7-a3df-9b1c70870522 tempest-VolumesSnapshotsTestJSON-705068246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4670c443-e846-4d40-8ea4-242feda9aa3d -F qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-4670c443-e846-4d40-8ea4-242feda9aa3d.869e4de1-0d94-4b5d-863c-d41251d0157f {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:05:54 devstack sudo[84752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4670c443-e846-4d40-8ea4-242feda9aa3d -F qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-4670c443-e846-4d40-8ea4-242feda9aa3d.869e4de1-0d94-4b5d-863c-d41251d0157f Apr 16 15:05:54 devstack sudo[84752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:05:55 devstack sudo[84752]: pam_unix(sudo:session): session closed for user root Apr 16 15:05:55 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [req-ebf00946-548e-447a-92d8-3ed3e5f1f273 req-ca946342-d55a-40e7-a3df-9b1c70870522 tempest-VolumesSnapshotsTestJSON-705068246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4670c443-e846-4d40-8ea4-242feda9aa3d -F qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-4670c443-e846-4d40-8ea4-242feda9aa3d.869e4de1-0d94-4b5d-863c-d41251d0157f" returned: 0 in 0.458s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:05:55 devstack cinder-volume[82756]: WARNING cinder.volume.drivers.remotefs [req-ebf00946-548e-447a-92d8-3ed3e5f1f273 req-ca946342-d55a-40e7-a3df-9b1c70870522 tempest-VolumesSnapshotsTestJSON-705068246 None] /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-4670c443-e846-4d40-8ea4-242feda9aa3d.869e4de1-0d94-4b5d-863c-d41251d0157f is being set with open permissions: ugo+rw Apr 16 15:05:55 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [req-ebf00946-548e-447a-92d8-3ed3e5f1f273 req-ca946342-d55a-40e7-a3df-9b1c70870522 tempest-VolumesSnapshotsTestJSON-705068246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-4670c443-e846-4d40-8ea4-242feda9aa3d.869e4de1-0d94-4b5d-863c-d41251d0157f {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:05:55 devstack sudo[84758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-4670c443-e846-4d40-8ea4-242feda9aa3d.869e4de1-0d94-4b5d-863c-d41251d0157f Apr 16 15:05:55 devstack sudo[84758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:05:55 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-63f58e1c-87ae-4f9c-b956-3044c502486d tempest-GroupsTest-1909532821 None] Group tempest-Group2-230911448: creating Apr 16 15:05:55 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-63f58e1c-87ae-4f9c-b956-3044c502486d tempest-GroupsTest-1909532821 None] Group tempest-Group2-230911448: created successfully Apr 16 15:05:55 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-63f58e1c-87ae-4f9c-b956-3044c502486d tempest-GroupsTest-1909532821 None] Create group completed successfully. Apr 16 15:05:55 devstack sudo[84758]: pam_unix(sudo:session): session closed for user root Apr 16 15:05:55 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [req-ebf00946-548e-447a-92d8-3ed3e5f1f273 req-ca946342-d55a-40e7-a3df-9b1c70870522 tempest-VolumesSnapshotsTestJSON-705068246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-4670c443-e846-4d40-8ea4-242feda9aa3d.869e4de1-0d94-4b5d-863c-d41251d0157f" returned: 0 in 0.450s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:05:55 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [req-ebf00946-548e-447a-92d8-3ed3e5f1f273 req-ca946342-d55a-40e7-a3df-9b1c70870522 tempest-VolumesSnapshotsTestJSON-705068246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-4670c443-e846-4d40-8ea4-242feda9aa3d.info {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:05:55 devstack sudo[84761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-4670c443-e846-4d40-8ea4-242feda9aa3d.info Apr 16 15:05:55 devstack sudo[84761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:05:56 devstack sudo[84761]: pam_unix(sudo:session): session closed for user root Apr 16 15:05:56 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [req-ebf00946-548e-447a-92d8-3ed3e5f1f273 req-ca946342-d55a-40e7-a3df-9b1c70870522 tempest-VolumesSnapshotsTestJSON-705068246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-4670c443-e846-4d40-8ea4-242feda9aa3d.info" returned: 0 in 0.417s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:05:56 devstack cinder-volume[82756]: WARNING cinder.volume.drivers.remotefs [req-ebf00946-548e-447a-92d8-3ed3e5f1f273 req-ca946342-d55a-40e7-a3df-9b1c70870522 tempest-VolumesSnapshotsTestJSON-705068246 None] /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-4670c443-e846-4d40-8ea4-242feda9aa3d.info is being set with open permissions: ugo+rw Apr 16 15:05:56 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [req-ebf00946-548e-447a-92d8-3ed3e5f1f273 req-ca946342-d55a-40e7-a3df-9b1c70870522 tempest-VolumesSnapshotsTestJSON-705068246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-4670c443-e846-4d40-8ea4-242feda9aa3d.info {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:05:56 devstack sudo[84764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-4670c443-e846-4d40-8ea4-242feda9aa3d.info Apr 16 15:05:56 devstack sudo[84764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:05:56 devstack sudo[84764]: pam_unix(sudo:session): session closed for user root Apr 16 15:05:56 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [req-ebf00946-548e-447a-92d8-3ed3e5f1f273 req-ca946342-d55a-40e7-a3df-9b1c70870522 tempest-VolumesSnapshotsTestJSON-705068246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-4670c443-e846-4d40-8ea4-242feda9aa3d.info" returned: 0 in 0.475s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:05:56 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [req-ebf00946-548e-447a-92d8-3ed3e5f1f273 req-ca946342-d55a-40e7-a3df-9b1c70870522 tempest-VolumesSnapshotsTestJSON-705068246 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.223s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:05:56 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-84b19dee-852e-4bcd-a069-a5f5b14a90fa tempest-GroupSnapshotsV319Test-2140345526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.388s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:05:56 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-84b19dee-852e-4bcd-a069-a5f5b14a90fa tempest-GroupSnapshotsV319Test-2140345526 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f41460fc-aafb-4596-9aaa-7d1e84cfbc55,created_at=2026-04-16T13:05:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1948084980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f41460fc-aafb-4596-9aaa-7d1e84cfbc55,host='devstack@QuobyteHD#QuobyteHD',id=58909726-efe9-45b6-9a97-b544139bc455,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25dda9a475fb4315ada90a55ea2f2e8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:05:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:05:54Z,use_quota=True,user_id='ede3edd2a66143ceb4f3ac2a5fd8de1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a2a0a29-02c5-4c14-adde-a6151a1f8ccb),volume_type_id=2a2a0a29-02c5-4c14-adde-a6151a1f8ccb)}" {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 15:05:56 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-84b19dee-852e-4bcd-a069-a5f5b14a90fa tempest-GroupSnapshotsV319Test-2140345526 None] Creating volume 58909726-efe9-45b6-9a97-b544139bc455 {{(pid=82756) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 15:05:56 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-84b19dee-852e-4bcd-a069-a5f5b14a90fa tempest-GroupSnapshotsV319Test-2140345526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:05:56 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-84b19dee-852e-4bcd-a069-a5f5b14a90fa tempest-GroupSnapshotsV319Test-2140345526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:05:56 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-84b19dee-852e-4bcd-a069-a5f5b14a90fa tempest-GroupSnapshotsV319Test-2140345526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:05:56 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-84b19dee-852e-4bcd-a069-a5f5b14a90fa tempest-GroupSnapshotsV319Test-2140345526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:05:56 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-84b19dee-852e-4bcd-a069-a5f5b14a90fa tempest-GroupSnapshotsV319Test-2140345526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:05:56 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-84b19dee-852e-4bcd-a069-a5f5b14a90fa tempest-GroupSnapshotsV319Test-2140345526 None] Selected osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 as target Quobyte volume. {{(pid=82756) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 15:05:56 devstack cinder-volume[82756]: INFO cinder.volume.drivers.remotefs [None req-84b19dee-852e-4bcd-a069-a5f5b14a90fa tempest-GroupSnapshotsV319Test-2140345526 None] casted to osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 Apr 16 15:05:56 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-84b19dee-852e-4bcd-a069-a5f5b14a90fa tempest-GroupSnapshotsV319Test-2140345526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-58909726-efe9-45b6-9a97-b544139bc455 1073741824 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:05:56 devstack sudo[84767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-58909726-efe9-45b6-9a97-b544139bc455 1073741824 Apr 16 15:05:56 devstack sudo[84767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:05:56 devstack cinder-volume[82756]: INFO cinder.volume.manager [req-ebf00946-548e-447a-92d8-3ed3e5f1f273 req-ca946342-d55a-40e7-a3df-9b1c70870522 tempest-VolumesSnapshotsTestJSON-705068246 None] Create snapshot completed successfully Apr 16 15:05:56 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [None req-6dd7ecd6-08a0-41b0-ab6d-6e2573a245ac tempest-GroupsTest-1909532821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82756) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 15:05:56 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-6dd7ecd6-08a0-41b0-ab6d-6e2573a245ac tempest-GroupsTest-1909532821 None] Flow 'volume_create_manager' (75805e7e-1e99-4124-ba42-6ce0c423b8ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:05:56 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-6dd7ecd6-08a0-41b0-ab6d-6e2573a245ac tempest-GroupsTest-1909532821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ba6030c-0978-4348-bc0e-368238e9e8ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:05:56 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-6dd7ecd6-08a0-41b0-ab6d-6e2573a245ac tempest-GroupsTest-1909532821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ba6030c-0978-4348-bc0e-368238e9e8ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:05:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-920525903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=acb2a019-8471-4b0c-9158-e26345de99ae,host='devstack@QuobyteHD#QuobyteHD',id=a10b913b-4236-4fe3-882b-340c12052776,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5099cfd6bb39435499c0988e2c492584',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:05:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:05:57Z,use_quota=True,user_id='84f0f364aa134122861068c6779b0494',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43c1c160-0a92-4342-a936-95995c2d9225),volume_type_id=43c1c160-0a92-4342-a936-95995c2d9225)' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:05:56 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-6dd7ecd6-08a0-41b0-ab6d-6e2573a245ac tempest-GroupsTest-1909532821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ef010b2-2173-4e9f-9f14-a214b5355712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:05:56 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-6dd7ecd6-08a0-41b0-ab6d-6e2573a245ac tempest-GroupsTest-1909532821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ef010b2-2173-4e9f-9f14-a214b5355712) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:05:56 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-6dd7ecd6-08a0-41b0-ab6d-6e2573a245ac tempest-GroupsTest-1909532821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19e4ee8d-215a-4d90-907c-0e5e50d5cd4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:05:56 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-6dd7ecd6-08a0-41b0-ab6d-6e2573a245ac tempest-GroupsTest-1909532821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19e4ee8d-215a-4d90-907c-0e5e50d5cd4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a10b913b-4236-4fe3-882b-340c12052776', 'volume_name': 'volume-a10b913b-4236-4fe3-882b-340c12052776', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:05:56 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-6dd7ecd6-08a0-41b0-ab6d-6e2573a245ac tempest-GroupsTest-1909532821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0773a8d7-667d-46fa-a03d-0a6134b074d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:05:56 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-6dd7ecd6-08a0-41b0-ab6d-6e2573a245ac tempest-GroupsTest-1909532821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0773a8d7-667d-46fa-a03d-0a6134b074d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:05:56 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-6dd7ecd6-08a0-41b0-ab6d-6e2573a245ac tempest-GroupsTest-1909532821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (794c4a98-9510-480e-ad9c-952636cd9334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:05:56 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-6dd7ecd6-08a0-41b0-ab6d-6e2573a245ac tempest-GroupsTest-1909532821 None] Volume a10b913b-4236-4fe3-882b-340c12052776: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a10b913b-4236-4fe3-882b-340c12052776', 'volume_size': 1} Apr 16 15:05:56 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-6dd7ecd6-08a0-41b0-ab6d-6e2573a245ac tempest-GroupsTest-1909532821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:05:57 devstack cinder-volume[82756]: DEBUG cinder.coordination [req-bebc6719-e4b6-4a10-9127-da99c227eba8 req-39581f18-eb86-4708-8e28-6d723d9601cb tempest-VolumesSnapshotsTestJSON-705068246 None] Acquiring lock "cinder-869e4de1-0d94-4b5d-863c-d41251d0157f-delete_snapshot" by "delete_snapshot" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:05:57 devstack sudo[84767]: pam_unix(sudo:session): session closed for user root Apr 16 15:05:57 devstack cinder-volume[82756]: DEBUG cinder.coordination [req-bebc6719-e4b6-4a10-9127-da99c227eba8 req-39581f18-eb86-4708-8e28-6d723d9601cb tempest-VolumesSnapshotsTestJSON-705068246 None] Lock "cinder-869e4de1-0d94-4b5d-863c-d41251d0157f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:05:57 devstack cinder-volume[82756]: DEBUG cinder.coordination [req-bebc6719-e4b6-4a10-9127-da99c227eba8 req-39581f18-eb86-4708-8e28-6d723d9601cb tempest-VolumesSnapshotsTestJSON-705068246 None] Acquiring lock "cinder-quobyte-4670c443-e846-4d40-8ea4-242feda9aa3d" by "delete_snapshot" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:05:57 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-84b19dee-852e-4bcd-a069-a5f5b14a90fa tempest-GroupSnapshotsV319Test-2140345526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-58909726-efe9-45b6-9a97-b544139bc455 1073741824" returned: 0 in 0.540s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:05:57 devstack cinder-volume[82756]: DEBUG cinder.coordination [req-bebc6719-e4b6-4a10-9127-da99c227eba8 req-39581f18-eb86-4708-8e28-6d723d9601cb tempest-VolumesSnapshotsTestJSON-705068246 None] Lock "cinder-quobyte-4670c443-e846-4d40-8ea4-242feda9aa3d" acquired by "delete_snapshot" :: waited 0.017s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:05:57 devstack cinder-volume[82756]: DEBUG cinder.coordination [req-bebc6719-e4b6-4a10-9127-da99c227eba8 req-39581f18-eb86-4708-8e28-6d723d9601cb tempest-VolumesSnapshotsTestJSON-705068246 None] Acquiring lock "cinder-quobyte-869e4de1-0d94-4b5d-863c-d41251d0157f" by "_delete_snapshot" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:05:57 devstack cinder-volume[82756]: DEBUG cinder.coordination [req-bebc6719-e4b6-4a10-9127-da99c227eba8 req-39581f18-eb86-4708-8e28-6d723d9601cb tempest-VolumesSnapshotsTestJSON-705068246 None] Lock "cinder-quobyte-869e4de1-0d94-4b5d-863c-d41251d0157f" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:05:57 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [req-bebc6719-e4b6-4a10-9127-da99c227eba8 req-39581f18-eb86-4708-8e28-6d723d9601cb tempest-VolumesSnapshotsTestJSON-705068246 None] Deleting offline snapshot 869e4de1-0d94-4b5d-863c-d41251d0157f of volume 4670c443-e846-4d40-8ea4-242feda9aa3d {{(pid=82756) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 15:05:57 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [req-bebc6719-e4b6-4a10-9127-da99c227eba8 req-39581f18-eb86-4708-8e28-6d723d9601cb tempest-VolumesSnapshotsTestJSON-705068246 None] snapshot_file for this snap is: volume-4670c443-e846-4d40-8ea4-242feda9aa3d.869e4de1-0d94-4b5d-863c-d41251d0157f {{(pid=82756) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 15:05:57 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d0f557c-15d2-4140-b5b4-41d2b8990809]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:05:57 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [req-bebc6719-e4b6-4a10-9127-da99c227eba8 req-39581f18-eb86-4708-8e28-6d723d9601cb tempest-VolumesSnapshotsTestJSON-705068246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-4670c443-e846-4d40-8ea4-242feda9aa3d.869e4de1-0d94-4b5d-863c-d41251d0157f {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:05:57 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-84b19dee-852e-4bcd-a069-a5f5b14a90fa tempest-GroupSnapshotsV319Test-2140345526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-58909726-efe9-45b6-9a97-b544139bc455 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:05:57 devstack sudo[84774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-58909726-efe9-45b6-9a97-b544139bc455 Apr 16 15:05:57 devstack sudo[84774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:05:57 devstack sudo[84773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-4670c443-e846-4d40-8ea4-242feda9aa3d.869e4de1-0d94-4b5d-863c-d41251d0157f Apr 16 15:05:57 devstack sudo[84773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:05:57 devstack sudo[84774]: pam_unix(sudo:session): session closed for user root Apr 16 15:05:57 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-84b19dee-852e-4bcd-a069-a5f5b14a90fa tempest-GroupSnapshotsV319Test-2140345526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-58909726-efe9-45b6-9a97-b544139bc455" returned: 0 in 0.393s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:05:57 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-84b19dee-852e-4bcd-a069-a5f5b14a90fa tempest-GroupSnapshotsV319Test-2140345526 None] <== create_volume: return (994ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'} {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 15:05:57 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-84b19dee-852e-4bcd-a069-a5f5b14a90fa tempest-GroupSnapshotsV319Test-2140345526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.996s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:05:57 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-6dd7ecd6-08a0-41b0-ab6d-6e2573a245ac tempest-GroupsTest-1909532821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.869s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:05:57 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-6dd7ecd6-08a0-41b0-ab6d-6e2573a245ac tempest-GroupsTest-1909532821 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=acb2a019-8471-4b0c-9158-e26345de99ae,created_at=2026-04-16T13:05:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-920525903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=acb2a019-8471-4b0c-9158-e26345de99ae,host='devstack@QuobyteHD#QuobyteHD',id=a10b913b-4236-4fe3-882b-340c12052776,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5099cfd6bb39435499c0988e2c492584',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:05:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:05:57Z,use_quota=True,user_id='84f0f364aa134122861068c6779b0494',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43c1c160-0a92-4342-a936-95995c2d9225),volume_type_id=43c1c160-0a92-4342-a936-95995c2d9225)}" {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 15:05:57 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-6dd7ecd6-08a0-41b0-ab6d-6e2573a245ac tempest-GroupsTest-1909532821 None] Creating volume a10b913b-4236-4fe3-882b-340c12052776 {{(pid=82756) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 15:05:57 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-6dd7ecd6-08a0-41b0-ab6d-6e2573a245ac tempest-GroupsTest-1909532821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:05:57 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-6dd7ecd6-08a0-41b0-ab6d-6e2573a245ac tempest-GroupsTest-1909532821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:05:57 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-6dd7ecd6-08a0-41b0-ab6d-6e2573a245ac tempest-GroupsTest-1909532821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:05:57 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-6dd7ecd6-08a0-41b0-ab6d-6e2573a245ac tempest-GroupsTest-1909532821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:05:57 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-6dd7ecd6-08a0-41b0-ab6d-6e2573a245ac tempest-GroupsTest-1909532821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:05:57 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-6dd7ecd6-08a0-41b0-ab6d-6e2573a245ac tempest-GroupsTest-1909532821 None] Selected osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 as target Quobyte volume. {{(pid=82756) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 15:05:57 devstack cinder-volume[82756]: INFO cinder.volume.drivers.remotefs [None req-6dd7ecd6-08a0-41b0-ab6d-6e2573a245ac tempest-GroupsTest-1909532821 None] casted to osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 Apr 16 15:05:57 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-6dd7ecd6-08a0-41b0-ab6d-6e2573a245ac tempest-GroupsTest-1909532821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-a10b913b-4236-4fe3-882b-340c12052776 1073741824 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:05:57 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-84b19dee-852e-4bcd-a069-a5f5b14a90fa tempest-GroupSnapshotsV319Test-2140345526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04d01061-7f5c-4620-b615-a098655e161c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58909726-efe9-45b6-9a97-b544139bc455', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:05:57 devstack sudo[84781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-a10b913b-4236-4fe3-882b-340c12052776 1073741824 Apr 16 15:05:57 devstack sudo[84781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:05:57 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-84b19dee-852e-4bcd-a069-a5f5b14a90fa tempest-GroupSnapshotsV319Test-2140345526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be218b72-bbc4-4f83-9664-d1ab2c3fc6c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:05:57 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-84b19dee-852e-4bcd-a069-a5f5b14a90fa tempest-GroupSnapshotsV319Test-2140345526 None] Volume volume-58909726-efe9-45b6-9a97-b544139bc455 (58909726-efe9-45b6-9a97-b544139bc455): created successfully Apr 16 15:05:57 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-84b19dee-852e-4bcd-a069-a5f5b14a90fa tempest-GroupSnapshotsV319Test-2140345526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be218b72-bbc4-4f83-9664-d1ab2c3fc6c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:05:57 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-84b19dee-852e-4bcd-a069-a5f5b14a90fa tempest-GroupSnapshotsV319Test-2140345526 None] Flow 'volume_create_manager' (9f428814-d140-4d59-be7a-474521de4ab1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:05:57 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-84b19dee-852e-4bcd-a069-a5f5b14a90fa tempest-GroupSnapshotsV319Test-2140345526 None] Created volume successfully. Apr 16 15:05:57 devstack sudo[84773]: pam_unix(sudo:session): session closed for user root Apr 16 15:05:57 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [req-bebc6719-e4b6-4a10-9127-da99c227eba8 req-39581f18-eb86-4708-8e28-6d723d9601cb tempest-VolumesSnapshotsTestJSON-705068246 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-4670c443-e846-4d40-8ea4-242feda9aa3d.869e4de1-0d94-4b5d-863c-d41251d0157f" returned: 0 in 0.500s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:05:57 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [req-bebc6719-e4b6-4a10-9127-da99c227eba8 req-39581f18-eb86-4708-8e28-6d723d9601cb tempest-VolumesSnapshotsTestJSON-705068246 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4670c443-e846-4d40-8ea4-242feda9aa3d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82756) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 15:05:57 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d7a13bf-6cea-400e-9ac5-f9543a15d724]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:05:57 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [req-bebc6719-e4b6-4a10-9127-da99c227eba8 req-39581f18-eb86-4708-8e28-6d723d9601cb tempest-VolumesSnapshotsTestJSON-705068246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-4670c443-e846-4d40-8ea4-242feda9aa3d {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:05:57 devstack sudo[84783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-4670c443-e846-4d40-8ea4-242feda9aa3d Apr 16 15:05:57 devstack sudo[84783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:05:58 devstack sudo[84781]: pam_unix(sudo:session): session closed for user root Apr 16 15:05:58 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-6dd7ecd6-08a0-41b0-ab6d-6e2573a245ac tempest-GroupsTest-1909532821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-a10b913b-4236-4fe3-882b-340c12052776 1073741824" returned: 0 in 0.492s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:05:58 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-6dd7ecd6-08a0-41b0-ab6d-6e2573a245ac tempest-GroupsTest-1909532821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-a10b913b-4236-4fe3-882b-340c12052776 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:05:58 devstack sudo[84788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-a10b913b-4236-4fe3-882b-340c12052776 Apr 16 15:05:58 devstack sudo[84788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:05:58 devstack sudo[84783]: pam_unix(sudo:session): session closed for user root Apr 16 15:05:58 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [req-bebc6719-e4b6-4a10-9127-da99c227eba8 req-39581f18-eb86-4708-8e28-6d723d9601cb tempest-VolumesSnapshotsTestJSON-705068246 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-4670c443-e846-4d40-8ea4-242feda9aa3d" returned: 0 in 0.523s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:05:58 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [req-bebc6719-e4b6-4a10-9127-da99c227eba8 req-39581f18-eb86-4708-8e28-6d723d9601cb tempest-VolumesSnapshotsTestJSON-705068246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-4670c443-e846-4d40-8ea4-242feda9aa3d.869e4de1-0d94-4b5d-863c-d41251d0157f {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:05:58 devstack sudo[84793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-4670c443-e846-4d40-8ea4-242feda9aa3d.869e4de1-0d94-4b5d-863c-d41251d0157f Apr 16 15:05:58 devstack sudo[84793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:05:58 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-6e5c8b16-8cb8-44a0-9c53-d3870896d56f tempest-GroupSnapshotsV319Test-2140345526 None] GroupSnapshot 4c81793a-319f-4182-95cd-a96e8df1f145: creating. Apr 16 15:05:58 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-6e5c8b16-8cb8-44a0-9c53-d3870896d56f tempest-GroupSnapshotsV319Test-2140345526 None] Group snapshot 4c81793a-319f-4182-95cd-a96e8df1f145: creating. {{(pid=82756) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 16 15:05:58 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-6e5c8b16-8cb8-44a0-9c53-d3870896d56f tempest-GroupSnapshotsV319Test-2140345526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:05:58 devstack sudo[84788]: pam_unix(sudo:session): session closed for user root Apr 16 15:05:58 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-6dd7ecd6-08a0-41b0-ab6d-6e2573a245ac tempest-GroupsTest-1909532821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-a10b913b-4236-4fe3-882b-340c12052776" returned: 0 in 0.437s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:05:58 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-6dd7ecd6-08a0-41b0-ab6d-6e2573a245ac tempest-GroupsTest-1909532821 None] <== create_volume: return (960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'} {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 15:05:58 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-6dd7ecd6-08a0-41b0-ab6d-6e2573a245ac tempest-GroupsTest-1909532821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.963s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:05:58 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-6e5c8b16-8cb8-44a0-9c53-d3870896d56f tempest-GroupSnapshotsV319Test-2140345526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.052s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:05:58 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-6dd7ecd6-08a0-41b0-ab6d-6e2573a245ac tempest-GroupsTest-1909532821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (794c4a98-9510-480e-ad9c-952636cd9334) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a10b913b-4236-4fe3-882b-340c12052776', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:05:58 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-6dd7ecd6-08a0-41b0-ab6d-6e2573a245ac tempest-GroupsTest-1909532821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76c87e2d-d1c8-4a89-9ee4-194744b3c1a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:05:58 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-6e5c8b16-8cb8-44a0-9c53-d3870896d56f tempest-GroupSnapshotsV319Test-2140345526 None] Creating offline snapshot 82296a38-cf78-499b-932d-4b2b71515096 of volume 58909726-efe9-45b6-9a97-b544139bc455 {{(pid=82756) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 16 15:05:58 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-6dd7ecd6-08a0-41b0-ab6d-6e2573a245ac tempest-GroupsTest-1909532821 None] Volume volume-a10b913b-4236-4fe3-882b-340c12052776 (a10b913b-4236-4fe3-882b-340c12052776): created successfully Apr 16 15:05:58 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-6dd7ecd6-08a0-41b0-ab6d-6e2573a245ac tempest-GroupsTest-1909532821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76c87e2d-d1c8-4a89-9ee4-194744b3c1a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:05:58 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-6dd7ecd6-08a0-41b0-ab6d-6e2573a245ac tempest-GroupsTest-1909532821 None] Flow 'volume_create_manager' (75805e7e-1e99-4124-ba42-6ce0c423b8ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:05:58 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[21c41ab8-95d7-4e10-b167-99cdb0cc3ada]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:05:58 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-6e5c8b16-8cb8-44a0-9c53-d3870896d56f tempest-GroupSnapshotsV319Test-2140345526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-58909726-efe9-45b6-9a97-b544139bc455 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:05:58 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-6dd7ecd6-08a0-41b0-ab6d-6e2573a245ac tempest-GroupsTest-1909532821 None] Created volume successfully. Apr 16 15:05:58 devstack sudo[84796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-58909726-efe9-45b6-9a97-b544139bc455 Apr 16 15:05:58 devstack sudo[84796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:05:59 devstack sudo[84793]: pam_unix(sudo:session): session closed for user root Apr 16 15:05:59 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [req-bebc6719-e4b6-4a10-9127-da99c227eba8 req-39581f18-eb86-4708-8e28-6d723d9601cb tempest-VolumesSnapshotsTestJSON-705068246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-4670c443-e846-4d40-8ea4-242feda9aa3d.869e4de1-0d94-4b5d-863c-d41251d0157f" returned: 0 in 0.687s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:05:59 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [req-bebc6719-e4b6-4a10-9127-da99c227eba8 req-39581f18-eb86-4708-8e28-6d723d9601cb tempest-VolumesSnapshotsTestJSON-705068246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-4670c443-e846-4d40-8ea4-242feda9aa3d.869e4de1-0d94-4b5d-863c-d41251d0157f {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:05:59 devstack sudo[84842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-4670c443-e846-4d40-8ea4-242feda9aa3d.869e4de1-0d94-4b5d-863c-d41251d0157f Apr 16 15:05:59 devstack sudo[84842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:05:59 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-d0ad886c-1a1c-4fc0-a7ec-15dda4f42e18 tempest-GroupsTest-1909532821 None] Acquiring lock "cinder-quobyte-a10b913b-4236-4fe3-882b-340c12052776" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:05:59 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-d0ad886c-1a1c-4fc0-a7ec-15dda4f42e18 tempest-GroupsTest-1909532821 None] Lock "cinder-quobyte-a10b913b-4236-4fe3-882b-340c12052776" acquired by "delete_volume" :: waited 0.018s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:05:59 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f70fa9f-6969-46ed-b708-deabd0c80421]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:05:59 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-d0ad886c-1a1c-4fc0-a7ec-15dda4f42e18 tempest-GroupsTest-1909532821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-a10b913b-4236-4fe3-882b-340c12052776 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:05:59 devstack sudo[84897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-a10b913b-4236-4fe3-882b-340c12052776 Apr 16 15:05:59 devstack sudo[84897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:05:59 devstack sudo[84842]: pam_unix(sudo:session): session closed for user root Apr 16 15:05:59 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [req-bebc6719-e4b6-4a10-9127-da99c227eba8 req-39581f18-eb86-4708-8e28-6d723d9601cb tempest-VolumesSnapshotsTestJSON-705068246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-4670c443-e846-4d40-8ea4-242feda9aa3d.869e4de1-0d94-4b5d-863c-d41251d0157f" returned: 0 in 0.872s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:05:59 devstack cinder-volume[82756]: DEBUG cinder.coordination [req-bebc6719-e4b6-4a10-9127-da99c227eba8 req-39581f18-eb86-4708-8e28-6d723d9601cb tempest-VolumesSnapshotsTestJSON-705068246 None] Lock "cinder-quobyte-869e4de1-0d94-4b5d-863c-d41251d0157f" released by "_delete_snapshot" :: held 2.673s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:05:59 devstack cinder-volume[82756]: DEBUG cinder.coordination [req-bebc6719-e4b6-4a10-9127-da99c227eba8 req-39581f18-eb86-4708-8e28-6d723d9601cb tempest-VolumesSnapshotsTestJSON-705068246 None] Lock "cinder-quobyte-4670c443-e846-4d40-8ea4-242feda9aa3d" released by "delete_snapshot" :: held 2.688s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:05:59 devstack sudo[84796]: pam_unix(sudo:session): session closed for user root Apr 16 15:05:59 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-6e5c8b16-8cb8-44a0-9c53-d3870896d56f tempest-GroupSnapshotsV319Test-2140345526 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-58909726-efe9-45b6-9a97-b544139bc455" returned: 0 in 1.251s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:05:59 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-6e5c8b16-8cb8-44a0-9c53-d3870896d56f tempest-GroupSnapshotsV319Test-2140345526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-58909726-efe9-45b6-9a97-b544139bc455,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-58909726-efe9-45b6-9a97-b544139bc455.82296a38-cf78-499b-932d-4b2b71515096 1G {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:05:59 devstack sudo[84901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-58909726-efe9-45b6-9a97-b544139bc455,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-58909726-efe9-45b6-9a97-b544139bc455.82296a38-cf78-499b-932d-4b2b71515096 1G Apr 16 15:05:59 devstack sudo[84901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:05:59 devstack cinder-volume[82756]: WARNING cinder.quota [req-bebc6719-e4b6-4a10-9127-da99c227eba8 req-39581f18-eb86-4708-8e28-6d723d9601cb tempest-VolumesSnapshotsTestJSON-705068246 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 16 15:06:00 devstack cinder-volume[82756]: DEBUG cinder.quota [req-bebc6719-e4b6-4a10-9127-da99c227eba8 req-39581f18-eb86-4708-8e28-6d723d9601cb tempest-VolumesSnapshotsTestJSON-705068246 None] Created reservations ['ae1e3b6f-67ca-4375-a1c3-bd33298fc186', 'f00be357-0aab-44d5-ab8e-cea424e7d84d', 'c344bff5-efc4-4ce3-8b31-28aa52290cb0', 'e04b01f0-b5a1-4819-8363-5ace5a6ddc01'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:06:00 devstack cinder-volume[82756]: INFO cinder.volume.manager [req-bebc6719-e4b6-4a10-9127-da99c227eba8 req-39581f18-eb86-4708-8e28-6d723d9601cb tempest-VolumesSnapshotsTestJSON-705068246 None] Delete snapshot completed successfully. Apr 16 15:06:00 devstack cinder-volume[82756]: DEBUG cinder.coordination [req-bebc6719-e4b6-4a10-9127-da99c227eba8 req-39581f18-eb86-4708-8e28-6d723d9601cb tempest-VolumesSnapshotsTestJSON-705068246 None] Lock "cinder-869e4de1-0d94-4b5d-863c-d41251d0157f-delete_snapshot" released by "delete_snapshot" :: held 2.827s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:06:00 devstack sudo[84897]: pam_unix(sudo:session): session closed for user root Apr 16 15:06:00 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-d0ad886c-1a1c-4fc0-a7ec-15dda4f42e18 tempest-GroupsTest-1909532821 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-a10b913b-4236-4fe3-882b-340c12052776" returned: 0 in 0.611s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:06:00 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-d0ad886c-1a1c-4fc0-a7ec-15dda4f42e18 tempest-GroupsTest-1909532821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-a10b913b-4236-4fe3-882b-340c12052776 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:06:00 devstack sudo[84909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-a10b913b-4236-4fe3-882b-340c12052776 Apr 16 15:06:00 devstack sudo[84909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:06:00 devstack cinder-volume[82756]: DEBUG cinder.coordination [req-1912e115-1b23-407e-8155-61e4e5191d09 req-9eab455a-d465-42ce-8641-827011821497 tempest-VolumesSnapshotsTestJSON-705068246 None] Acquiring lock "cinder-4670c443-e846-4d40-8ea4-242feda9aa3d-delete_volume" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:06:00 devstack cinder-volume[82756]: DEBUG cinder.coordination [req-1912e115-1b23-407e-8155-61e4e5191d09 req-9eab455a-d465-42ce-8641-827011821497 tempest-VolumesSnapshotsTestJSON-705068246 None] Lock "cinder-4670c443-e846-4d40-8ea4-242feda9aa3d-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:06:00 devstack sudo[84901]: pam_unix(sudo:session): session closed for user root Apr 16 15:06:00 devstack cinder-volume[82756]: DEBUG cinder.coordination [req-1912e115-1b23-407e-8155-61e4e5191d09 req-9eab455a-d465-42ce-8641-827011821497 tempest-VolumesSnapshotsTestJSON-705068246 None] Acquiring lock "cinder-quobyte-4670c443-e846-4d40-8ea4-242feda9aa3d" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:06:00 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-6e5c8b16-8cb8-44a0-9c53-d3870896d56f tempest-GroupSnapshotsV319Test-2140345526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-58909726-efe9-45b6-9a97-b544139bc455,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-58909726-efe9-45b6-9a97-b544139bc455.82296a38-cf78-499b-932d-4b2b71515096 1G" returned: 0 in 0.605s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:06:00 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-6e5c8b16-8cb8-44a0-9c53-d3870896d56f tempest-GroupSnapshotsV319Test-2140345526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58909726-efe9-45b6-9a97-b544139bc455 -F qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-58909726-efe9-45b6-9a97-b544139bc455.82296a38-cf78-499b-932d-4b2b71515096 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:06:00 devstack cinder-volume[82756]: DEBUG cinder.coordination [req-1912e115-1b23-407e-8155-61e4e5191d09 req-9eab455a-d465-42ce-8641-827011821497 tempest-VolumesSnapshotsTestJSON-705068246 None] Lock "cinder-quobyte-4670c443-e846-4d40-8ea4-242feda9aa3d" acquired by "delete_volume" :: waited 0.020s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:06:00 devstack sudo[84911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58909726-efe9-45b6-9a97-b544139bc455 -F qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-58909726-efe9-45b6-9a97-b544139bc455.82296a38-cf78-499b-932d-4b2b71515096 Apr 16 15:06:00 devstack sudo[84911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:06:00 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[79fd1888-44ad-4304-a37b-fdbad71143e2]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:06:00 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [req-1912e115-1b23-407e-8155-61e4e5191d09 req-9eab455a-d465-42ce-8641-827011821497 tempest-VolumesSnapshotsTestJSON-705068246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-4670c443-e846-4d40-8ea4-242feda9aa3d {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:06:00 devstack sudo[84913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-4670c443-e846-4d40-8ea4-242feda9aa3d Apr 16 15:06:00 devstack sudo[84913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:06:00 devstack sudo[84909]: pam_unix(sudo:session): session closed for user root Apr 16 15:06:00 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-d0ad886c-1a1c-4fc0-a7ec-15dda4f42e18 tempest-GroupsTest-1909532821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-a10b913b-4236-4fe3-882b-340c12052776" returned: 0 in 0.501s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:06:00 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-d0ad886c-1a1c-4fc0-a7ec-15dda4f42e18 tempest-GroupsTest-1909532821 None] Lock "cinder-quobyte-a10b913b-4236-4fe3-882b-340c12052776" released by "delete_volume" :: held 1.156s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:06:00 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-d0ad886c-1a1c-4fc0-a7ec-15dda4f42e18 tempest-GroupsTest-1909532821 None] Created reservations ['e52d88be-00e3-4223-aed4-b110250e9b93'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:06:00 devstack cinder-volume[82756]: WARNING cinder.quota [None req-d0ad886c-1a1c-4fc0-a7ec-15dda4f42e18 tempest-GroupsTest-1909532821 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-793086459 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-793086459, it is now deprecated. Please use the default quota class for default quota. Apr 16 15:06:00 devstack cinder-volume[82756]: WARNING cinder.quota [None req-d0ad886c-1a1c-4fc0-a7ec-15dda4f42e18 tempest-GroupsTest-1909532821 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-793086459 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-793086459, it is now deprecated. Please use the default quota class for default quota. Apr 16 15:06:00 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-d0ad886c-1a1c-4fc0-a7ec-15dda4f42e18 tempest-GroupsTest-1909532821 None] Created reservations ['0f8afe41-8d57-4817-9628-0687dc846b65', '82500e35-435e-4479-bf4e-19b9a35f1ee3', '3762c900-38df-4eb9-ae2e-94ef2fa08a6d', '1185571f-fedd-437b-8323-641037ebfbaa'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:06:01 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-d0ad886c-1a1c-4fc0-a7ec-15dda4f42e18 tempest-GroupsTest-1909532821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:06:01 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-d0ad886c-1a1c-4fc0-a7ec-15dda4f42e18 tempest-GroupsTest-1909532821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:06:01 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-d0ad886c-1a1c-4fc0-a7ec-15dda4f42e18 tempest-GroupsTest-1909532821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:06:01 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-d0ad886c-1a1c-4fc0-a7ec-15dda4f42e18 tempest-GroupsTest-1909532821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:06:01 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-d0ad886c-1a1c-4fc0-a7ec-15dda4f42e18 tempest-GroupsTest-1909532821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:06:01 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-d0ad886c-1a1c-4fc0-a7ec-15dda4f42e18 tempest-GroupsTest-1909532821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:06:01 devstack sudo[84916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:06:01 devstack sudo[84916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:06:01 devstack sudo[84911]: pam_unix(sudo:session): session closed for user root Apr 16 15:06:01 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-6e5c8b16-8cb8-44a0-9c53-d3870896d56f tempest-GroupSnapshotsV319Test-2140345526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58909726-efe9-45b6-9a97-b544139bc455 -F qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-58909726-efe9-45b6-9a97-b544139bc455.82296a38-cf78-499b-932d-4b2b71515096" returned: 0 in 0.881s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:06:01 devstack cinder-volume[82756]: WARNING cinder.volume.drivers.remotefs [None req-6e5c8b16-8cb8-44a0-9c53-d3870896d56f tempest-GroupSnapshotsV319Test-2140345526 None] /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-58909726-efe9-45b6-9a97-b544139bc455.82296a38-cf78-499b-932d-4b2b71515096 is being set with open permissions: ugo+rw: NotImplementedError Apr 16 15:06:01 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-6e5c8b16-8cb8-44a0-9c53-d3870896d56f tempest-GroupSnapshotsV319Test-2140345526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-58909726-efe9-45b6-9a97-b544139bc455.82296a38-cf78-499b-932d-4b2b71515096 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:06:01 devstack sudo[84913]: pam_unix(sudo:session): session closed for user root Apr 16 15:06:01 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [req-1912e115-1b23-407e-8155-61e4e5191d09 req-9eab455a-d465-42ce-8641-827011821497 tempest-VolumesSnapshotsTestJSON-705068246 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-4670c443-e846-4d40-8ea4-242feda9aa3d" returned: 0 in 0.854s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:06:01 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [req-1912e115-1b23-407e-8155-61e4e5191d09 req-9eab455a-d465-42ce-8641-827011821497 tempest-VolumesSnapshotsTestJSON-705068246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-4670c443-e846-4d40-8ea4-242feda9aa3d {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:06:01 devstack sudo[84932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-58909726-efe9-45b6-9a97-b544139bc455.82296a38-cf78-499b-932d-4b2b71515096 Apr 16 15:06:01 devstack sudo[84932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:06:01 devstack sudo[84933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-4670c443-e846-4d40-8ea4-242feda9aa3d Apr 16 15:06:01 devstack sudo[84933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:06:01 devstack sudo[84916]: pam_unix(sudo:session): session closed for user root Apr 16 15:06:01 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-d0ad886c-1a1c-4fc0-a7ec-15dda4f42e18 tempest-GroupsTest-1909532821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.478s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:06:01 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-d0ad886c-1a1c-4fc0-a7ec-15dda4f42e18 tempest-GroupsTest-1909532821 None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:06:01 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-d0ad886c-1a1c-4fc0-a7ec-15dda4f42e18 tempest-GroupsTest-1909532821 None] Delete group completed successfully. Apr 16 15:06:01 devstack sudo[84932]: pam_unix(sudo:session): session closed for user root Apr 16 15:06:01 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-6e5c8b16-8cb8-44a0-9c53-d3870896d56f tempest-GroupSnapshotsV319Test-2140345526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-58909726-efe9-45b6-9a97-b544139bc455.82296a38-cf78-499b-932d-4b2b71515096" returned: 0 in 0.415s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:06:01 devstack sudo[84933]: pam_unix(sudo:session): session closed for user root Apr 16 15:06:01 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-6e5c8b16-8cb8-44a0-9c53-d3870896d56f tempest-GroupSnapshotsV319Test-2140345526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-58909726-efe9-45b6-9a97-b544139bc455.info {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:06:01 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [req-1912e115-1b23-407e-8155-61e4e5191d09 req-9eab455a-d465-42ce-8641-827011821497 tempest-VolumesSnapshotsTestJSON-705068246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-4670c443-e846-4d40-8ea4-242feda9aa3d" returned: 0 in 0.446s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:06:01 devstack cinder-volume[82756]: DEBUG cinder.coordination [req-1912e115-1b23-407e-8155-61e4e5191d09 req-9eab455a-d465-42ce-8641-827011821497 tempest-VolumesSnapshotsTestJSON-705068246 None] Lock "cinder-quobyte-4670c443-e846-4d40-8ea4-242feda9aa3d" released by "delete_volume" :: held 1.342s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:06:01 devstack sudo[84939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-58909726-efe9-45b6-9a97-b544139bc455.info Apr 16 15:06:01 devstack sudo[84939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:06:01 devstack cinder-volume[82756]: DEBUG cinder.quota [req-1912e115-1b23-407e-8155-61e4e5191d09 req-9eab455a-d465-42ce-8641-827011821497 tempest-VolumesSnapshotsTestJSON-705068246 None] Created reservations ['13cc23fa-10b6-4b8c-8e08-29cc084c52a7', '5e372276-f3da-49df-8336-c3ac769eb129', '92d381ad-4f3d-4dd9-8d32-b17ce57a2213', '0ea1b781-f05c-46f9-8774-cec3f8a52b5b'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:06:01 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [req-1912e115-1b23-407e-8155-61e4e5191d09 req-9eab455a-d465-42ce-8641-827011821497 tempest-VolumesSnapshotsTestJSON-705068246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:06:01 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [req-1912e115-1b23-407e-8155-61e4e5191d09 req-9eab455a-d465-42ce-8641-827011821497 tempest-VolumesSnapshotsTestJSON-705068246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:06:01 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [req-1912e115-1b23-407e-8155-61e4e5191d09 req-9eab455a-d465-42ce-8641-827011821497 tempest-VolumesSnapshotsTestJSON-705068246 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:06:01 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [req-1912e115-1b23-407e-8155-61e4e5191d09 req-9eab455a-d465-42ce-8641-827011821497 tempest-VolumesSnapshotsTestJSON-705068246 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:06:01 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [req-1912e115-1b23-407e-8155-61e4e5191d09 req-9eab455a-d465-42ce-8641-827011821497 tempest-VolumesSnapshotsTestJSON-705068246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:06:01 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [req-1912e115-1b23-407e-8155-61e4e5191d09 req-9eab455a-d465-42ce-8641-827011821497 tempest-VolumesSnapshotsTestJSON-705068246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:06:02 devstack sudo[84941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:06:02 devstack sudo[84941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:06:02 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-df30e50c-b6c3-4508-9854-f9ae198f0cf2 tempest-GroupsTest-1909532821 None] Created reservations ['faa3b016-6312-47e5-9c88-18fd64f645da'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:06:02 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-df30e50c-b6c3-4508-9854-f9ae198f0cf2 tempest-GroupsTest-1909532821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:06:02 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-df30e50c-b6c3-4508-9854-f9ae198f0cf2 tempest-GroupsTest-1909532821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:06:02 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-df30e50c-b6c3-4508-9854-f9ae198f0cf2 tempest-GroupsTest-1909532821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:06:02 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-df30e50c-b6c3-4508-9854-f9ae198f0cf2 tempest-GroupsTest-1909532821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:06:02 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-df30e50c-b6c3-4508-9854-f9ae198f0cf2 tempest-GroupsTest-1909532821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:06:02 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-df30e50c-b6c3-4508-9854-f9ae198f0cf2 tempest-GroupsTest-1909532821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:06:02 devstack sudo[84943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:06:02 devstack sudo[84943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:06:02 devstack sudo[84941]: pam_unix(sudo:session): session closed for user root Apr 16 15:06:02 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [req-1912e115-1b23-407e-8155-61e4e5191d09 req-9eab455a-d465-42ce-8641-827011821497 tempest-VolumesSnapshotsTestJSON-705068246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.466s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:06:02 devstack cinder-volume[82756]: DEBUG cinder.manager [req-1912e115-1b23-407e-8155-61e4e5191d09 req-9eab455a-d465-42ce-8641-827011821497 tempest-VolumesSnapshotsTestJSON-705068246 None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:06:02 devstack cinder-volume[82756]: INFO cinder.volume.manager [req-1912e115-1b23-407e-8155-61e4e5191d09 req-9eab455a-d465-42ce-8641-827011821497 tempest-VolumesSnapshotsTestJSON-705068246 None] Deleted volume successfully. Apr 16 15:06:02 devstack cinder-volume[82756]: DEBUG cinder.coordination [req-1912e115-1b23-407e-8155-61e4e5191d09 req-9eab455a-d465-42ce-8641-827011821497 tempest-VolumesSnapshotsTestJSON-705068246 None] Lock "cinder-4670c443-e846-4d40-8ea4-242feda9aa3d-delete_volume" released by "delete_volume" :: held 1.954s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:06:02 devstack sudo[84939]: pam_unix(sudo:session): session closed for user root Apr 16 15:06:02 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-6e5c8b16-8cb8-44a0-9c53-d3870896d56f tempest-GroupSnapshotsV319Test-2140345526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-58909726-efe9-45b6-9a97-b544139bc455.info" returned: 0 in 0.636s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:06:02 devstack cinder-volume[82756]: WARNING cinder.volume.drivers.remotefs [None req-6e5c8b16-8cb8-44a0-9c53-d3870896d56f tempest-GroupSnapshotsV319Test-2140345526 None] /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-58909726-efe9-45b6-9a97-b544139bc455.info is being set with open permissions: ugo+rw: NotImplementedError Apr 16 15:06:02 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-6e5c8b16-8cb8-44a0-9c53-d3870896d56f tempest-GroupSnapshotsV319Test-2140345526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-58909726-efe9-45b6-9a97-b544139bc455.info {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:06:02 devstack sudo[84947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-58909726-efe9-45b6-9a97-b544139bc455.info Apr 16 15:06:02 devstack sudo[84947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:06:02 devstack sudo[84943]: pam_unix(sudo:session): session closed for user root Apr 16 15:06:02 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-df30e50c-b6c3-4508-9854-f9ae198f0cf2 tempest-GroupsTest-1909532821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.588s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:06:02 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-df30e50c-b6c3-4508-9854-f9ae198f0cf2 tempest-GroupsTest-1909532821 None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:06:02 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-df30e50c-b6c3-4508-9854-f9ae198f0cf2 tempest-GroupsTest-1909532821 None] Delete group completed successfully. Apr 16 15:06:02 devstack sudo[84947]: pam_unix(sudo:session): session closed for user root Apr 16 15:06:02 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-6e5c8b16-8cb8-44a0-9c53-d3870896d56f tempest-GroupSnapshotsV319Test-2140345526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-58909726-efe9-45b6-9a97-b544139bc455.info" returned: 0 in 0.474s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:06:02 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-6e5c8b16-8cb8-44a0-9c53-d3870896d56f tempest-GroupSnapshotsV319Test-2140345526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.349s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:06:03 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-6e5c8b16-8cb8-44a0-9c53-d3870896d56f tempest-GroupSnapshotsV319Test-2140345526 None] group_snapshot 4c81793a-319f-4182-95cd-a96e8df1f145: created successfully Apr 16 15:06:03 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-fb7b3c16-3983-4874-a0f1-7752a9ca636c tempest-GroupsTest-1909532821 None] Group tempest-GroupsTest-Group-1340827884: creating Apr 16 15:06:03 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-fb7b3c16-3983-4874-a0f1-7752a9ca636c tempest-GroupsTest-1909532821 None] Group tempest-GroupsTest-Group-1340827884: created successfully Apr 16 15:06:03 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-fb7b3c16-3983-4874-a0f1-7752a9ca636c tempest-GroupsTest-1909532821 None] Create group completed successfully. Apr 16 15:06:04 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-875b17b8-6d91-4a80-b1f7-8fa73f7f2911 tempest-GroupSnapshotsV319Test-2140345526 None] group_snapshot 4c81793a-319f-4182-95cd-a96e8df1f145: deleting Apr 16 15:06:04 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-875b17b8-6d91-4a80-b1f7-8fa73f7f2911 tempest-GroupSnapshotsV319Test-2140345526 None] group_snapshot 4c81793a-319f-4182-95cd-a96e8df1f145: deleting {{(pid=82756) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 16 15:06:04 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-875b17b8-6d91-4a80-b1f7-8fa73f7f2911 tempest-GroupSnapshotsV319Test-2140345526 None] Acquiring lock "cinder-quobyte-58909726-efe9-45b6-9a97-b544139bc455" by "delete_snapshot" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:06:04 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-875b17b8-6d91-4a80-b1f7-8fa73f7f2911 tempest-GroupSnapshotsV319Test-2140345526 None] Lock "cinder-quobyte-58909726-efe9-45b6-9a97-b544139bc455" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:06:04 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-875b17b8-6d91-4a80-b1f7-8fa73f7f2911 tempest-GroupSnapshotsV319Test-2140345526 None] Acquiring lock "cinder-quobyte-82296a38-cf78-499b-932d-4b2b71515096" by "_delete_snapshot" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:06:04 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-875b17b8-6d91-4a80-b1f7-8fa73f7f2911 tempest-GroupSnapshotsV319Test-2140345526 None] Lock "cinder-quobyte-82296a38-cf78-499b-932d-4b2b71515096" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:06:04 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-875b17b8-6d91-4a80-b1f7-8fa73f7f2911 tempest-GroupSnapshotsV319Test-2140345526 None] Deleting offline snapshot 82296a38-cf78-499b-932d-4b2b71515096 of volume 58909726-efe9-45b6-9a97-b544139bc455 {{(pid=82756) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 15:06:04 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-875b17b8-6d91-4a80-b1f7-8fa73f7f2911 tempest-GroupSnapshotsV319Test-2140345526 None] snapshot_file for this snap is: volume-58909726-efe9-45b6-9a97-b544139bc455.82296a38-cf78-499b-932d-4b2b71515096 {{(pid=82756) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 15:06:04 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[1abaa521-175c-462c-9b92-f097d1dbb4a6]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:06:04 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-875b17b8-6d91-4a80-b1f7-8fa73f7f2911 tempest-GroupSnapshotsV319Test-2140345526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-58909726-efe9-45b6-9a97-b544139bc455.82296a38-cf78-499b-932d-4b2b71515096 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:06:04 devstack sudo[84981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-58909726-efe9-45b6-9a97-b544139bc455.82296a38-cf78-499b-932d-4b2b71515096 Apr 16 15:06:04 devstack sudo[84981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:06:05 devstack sudo[84981]: pam_unix(sudo:session): session closed for user root Apr 16 15:06:05 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-875b17b8-6d91-4a80-b1f7-8fa73f7f2911 tempest-GroupSnapshotsV319Test-2140345526 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-58909726-efe9-45b6-9a97-b544139bc455.82296a38-cf78-499b-932d-4b2b71515096" returned: 0 in 0.830s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:06:05 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-875b17b8-6d91-4a80-b1f7-8fa73f7f2911 tempest-GroupSnapshotsV319Test-2140345526 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-58909726-efe9-45b6-9a97-b544139bc455(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82756) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 15:06:05 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4fd2577-85f2-417f-af4f-a1232355c7a7]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:06:05 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-875b17b8-6d91-4a80-b1f7-8fa73f7f2911 tempest-GroupSnapshotsV319Test-2140345526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-58909726-efe9-45b6-9a97-b544139bc455 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:06:05 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcad8290-a97c-4168-be35-434d210bce27 tempest-GroupsTest-1909532821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82756) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 15:06:05 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-fcad8290-a97c-4168-be35-434d210bce27 tempest-GroupsTest-1909532821 None] Flow 'volume_create_manager' (4a58221b-8eba-4b48-a47a-9817b3433cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:06:05 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-fcad8290-a97c-4168-be35-434d210bce27 tempest-GroupsTest-1909532821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff7d32cc-96d6-4179-8c27-db2e72679980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:06:05 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-fcad8290-a97c-4168-be35-434d210bce27 tempest-GroupsTest-1909532821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff7d32cc-96d6-4179-8c27-db2e72679980) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:06:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-85524124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=832dc34d-d46d-4dd4-8531-ec1099eee49c,host='devstack@QuobyteHD#QuobyteHD',id=7c1772a2-3e32-4955-9435-75a5d91ce06a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5099cfd6bb39435499c0988e2c492584',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:06:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:06:05Z,use_quota=True,user_id='84f0f364aa134122861068c6779b0494',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e42ad67-ac47-435d-91d5-b2107cb64df1),volume_type_id=7e42ad67-ac47-435d-91d5-b2107cb64df1)' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:06:05 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-fcad8290-a97c-4168-be35-434d210bce27 tempest-GroupsTest-1909532821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7b7a706-d16c-43db-a71b-c90c9f78aa51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:06:05 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-fcad8290-a97c-4168-be35-434d210bce27 tempest-GroupsTest-1909532821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7b7a706-d16c-43db-a71b-c90c9f78aa51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:06:05 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-fcad8290-a97c-4168-be35-434d210bce27 tempest-GroupsTest-1909532821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (045ebe5c-09a4-4200-b7ee-774819afca2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:06:05 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-fcad8290-a97c-4168-be35-434d210bce27 tempest-GroupsTest-1909532821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (045ebe5c-09a4-4200-b7ee-774819afca2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c1772a2-3e32-4955-9435-75a5d91ce06a', 'volume_name': 'volume-7c1772a2-3e32-4955-9435-75a5d91ce06a', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:06:05 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-fcad8290-a97c-4168-be35-434d210bce27 tempest-GroupsTest-1909532821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88c8bb5b-421a-499c-b94b-504f35eabe70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:06:05 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-fcad8290-a97c-4168-be35-434d210bce27 tempest-GroupsTest-1909532821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88c8bb5b-421a-499c-b94b-504f35eabe70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:06:05 devstack sudo[85009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-58909726-efe9-45b6-9a97-b544139bc455 Apr 16 15:06:05 devstack sudo[85009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:06:05 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-fcad8290-a97c-4168-be35-434d210bce27 tempest-GroupsTest-1909532821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (544d29e8-3d0c-46dd-9e4b-c75d32de66ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:06:05 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-fcad8290-a97c-4168-be35-434d210bce27 tempest-GroupsTest-1909532821 None] Volume 7c1772a2-3e32-4955-9435-75a5d91ce06a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c1772a2-3e32-4955-9435-75a5d91ce06a', 'volume_size': 1} Apr 16 15:06:05 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-fcad8290-a97c-4168-be35-434d210bce27 tempest-GroupsTest-1909532821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:06:05 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-fcad8290-a97c-4168-be35-434d210bce27 tempest-GroupsTest-1909532821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:06:05 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-fcad8290-a97c-4168-be35-434d210bce27 tempest-GroupsTest-1909532821 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=832dc34d-d46d-4dd4-8531-ec1099eee49c,created_at=2026-04-16T13:06:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-85524124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=832dc34d-d46d-4dd4-8531-ec1099eee49c,host='devstack@QuobyteHD#QuobyteHD',id=7c1772a2-3e32-4955-9435-75a5d91ce06a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5099cfd6bb39435499c0988e2c492584',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:06:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:06:05Z,use_quota=True,user_id='84f0f364aa134122861068c6779b0494',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e42ad67-ac47-435d-91d5-b2107cb64df1),volume_type_id=7e42ad67-ac47-435d-91d5-b2107cb64df1)}" {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 15:06:05 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-fcad8290-a97c-4168-be35-434d210bce27 tempest-GroupsTest-1909532821 None] Creating volume 7c1772a2-3e32-4955-9435-75a5d91ce06a {{(pid=82756) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 15:06:05 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-fcad8290-a97c-4168-be35-434d210bce27 tempest-GroupsTest-1909532821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:06:05 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-fcad8290-a97c-4168-be35-434d210bce27 tempest-GroupsTest-1909532821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:06:05 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-fcad8290-a97c-4168-be35-434d210bce27 tempest-GroupsTest-1909532821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:06:05 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-fcad8290-a97c-4168-be35-434d210bce27 tempest-GroupsTest-1909532821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:06:05 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-fcad8290-a97c-4168-be35-434d210bce27 tempest-GroupsTest-1909532821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:06:05 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-fcad8290-a97c-4168-be35-434d210bce27 tempest-GroupsTest-1909532821 None] Selected osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 as target Quobyte volume. {{(pid=82756) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 15:06:05 devstack cinder-volume[82756]: INFO cinder.volume.drivers.remotefs [None req-fcad8290-a97c-4168-be35-434d210bce27 tempest-GroupsTest-1909532821 None] casted to osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 Apr 16 15:06:05 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-fcad8290-a97c-4168-be35-434d210bce27 tempest-GroupsTest-1909532821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-7c1772a2-3e32-4955-9435-75a5d91ce06a 1073741824 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:06:05 devstack sudo[85011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-7c1772a2-3e32-4955-9435-75a5d91ce06a 1073741824 Apr 16 15:06:05 devstack sudo[85011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:06:05 devstack sudo[85009]: pam_unix(sudo:session): session closed for user root Apr 16 15:06:05 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-875b17b8-6d91-4a80-b1f7-8fa73f7f2911 tempest-GroupSnapshotsV319Test-2140345526 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-58909726-efe9-45b6-9a97-b544139bc455" returned: 0 in 0.543s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:06:05 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-875b17b8-6d91-4a80-b1f7-8fa73f7f2911 tempest-GroupSnapshotsV319Test-2140345526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-58909726-efe9-45b6-9a97-b544139bc455.82296a38-cf78-499b-932d-4b2b71515096 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:06:05 devstack sudo[85016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-58909726-efe9-45b6-9a97-b544139bc455.82296a38-cf78-499b-932d-4b2b71515096 Apr 16 15:06:05 devstack sudo[85016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:06:05 devstack sudo[85011]: pam_unix(sudo:session): session closed for user root Apr 16 15:06:05 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-fcad8290-a97c-4168-be35-434d210bce27 tempest-GroupsTest-1909532821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-7c1772a2-3e32-4955-9435-75a5d91ce06a 1073741824" returned: 0 in 0.769s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:06:06 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-fcad8290-a97c-4168-be35-434d210bce27 tempest-GroupsTest-1909532821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-7c1772a2-3e32-4955-9435-75a5d91ce06a {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:06:06 devstack sudo[85024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-7c1772a2-3e32-4955-9435-75a5d91ce06a Apr 16 15:06:06 devstack sudo[85024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:06:06 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [req-d0bbb131-7afd-4933-bfda-1d9eb9d836ac req-a41c2750-0827-428d-8051-f75861d4e127 tempest-VolumesGetTestJSON-763643571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82756) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 15:06:06 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [req-d0bbb131-7afd-4933-bfda-1d9eb9d836ac req-a41c2750-0827-428d-8051-f75861d4e127 tempest-VolumesGetTestJSON-763643571 None] Flow 'volume_create_manager' (b1037683-55d5-4d28-9c05-78e12cde2453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:06:06 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [req-d0bbb131-7afd-4933-bfda-1d9eb9d836ac req-a41c2750-0827-428d-8051-f75861d4e127 tempest-VolumesGetTestJSON-763643571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0017f414-8bde-4920-97c9-7a75a25b6c96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:06:06 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [req-d0bbb131-7afd-4933-bfda-1d9eb9d836ac req-a41c2750-0827-428d-8051-f75861d4e127 tempest-VolumesGetTestJSON-763643571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0017f414-8bde-4920-97c9-7a75a25b6c96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:06:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-246225967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3d94305-d0c7-4239-bba0-c7f9492cef5b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8928da93e4f5437c92df0d9f411f5c82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:06:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:06:06Z,use_quota=True,user_id='badf701e7a78419dae03abfc0d34639e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:06:06 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [req-d0bbb131-7afd-4933-bfda-1d9eb9d836ac req-a41c2750-0827-428d-8051-f75861d4e127 tempest-VolumesGetTestJSON-763643571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1673fbe6-518a-42b1-84d9-138002408b98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:06:06 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [req-d0bbb131-7afd-4933-bfda-1d9eb9d836ac req-a41c2750-0827-428d-8051-f75861d4e127 tempest-VolumesGetTestJSON-763643571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1673fbe6-518a-42b1-84d9-138002408b98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:06:06 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [req-d0bbb131-7afd-4933-bfda-1d9eb9d836ac req-a41c2750-0827-428d-8051-f75861d4e127 tempest-VolumesGetTestJSON-763643571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (861d35ff-f645-4915-a4b4-a1a18ea492b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:06:06 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [req-d0bbb131-7afd-4933-bfda-1d9eb9d836ac req-a41c2750-0827-428d-8051-f75861d4e127 tempest-VolumesGetTestJSON-763643571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (861d35ff-f645-4915-a4b4-a1a18ea492b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3d94305-d0c7-4239-bba0-c7f9492cef5b', 'volume_name': 'volume-e3d94305-d0c7-4239-bba0-c7f9492cef5b', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:06:06 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [req-d0bbb131-7afd-4933-bfda-1d9eb9d836ac req-a41c2750-0827-428d-8051-f75861d4e127 tempest-VolumesGetTestJSON-763643571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0fb6e64-0dc1-40e3-815c-31f0d6dc9e26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:06:06 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [req-d0bbb131-7afd-4933-bfda-1d9eb9d836ac req-a41c2750-0827-428d-8051-f75861d4e127 tempest-VolumesGetTestJSON-763643571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0fb6e64-0dc1-40e3-815c-31f0d6dc9e26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:06:06 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [req-d0bbb131-7afd-4933-bfda-1d9eb9d836ac req-a41c2750-0827-428d-8051-f75861d4e127 tempest-VolumesGetTestJSON-763643571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd2391a9-131b-42c5-89b9-e2955b304d8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:06:06 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [req-d0bbb131-7afd-4933-bfda-1d9eb9d836ac req-a41c2750-0827-428d-8051-f75861d4e127 tempest-VolumesGetTestJSON-763643571 None] Volume e3d94305-d0c7-4239-bba0-c7f9492cef5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3d94305-d0c7-4239-bba0-c7f9492cef5b', 'volume_size': 1} Apr 16 15:06:06 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [req-d0bbb131-7afd-4933-bfda-1d9eb9d836ac req-a41c2750-0827-428d-8051-f75861d4e127 tempest-VolumesGetTestJSON-763643571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:06:06 devstack sudo[85016]: pam_unix(sudo:session): session closed for user root Apr 16 15:06:06 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-875b17b8-6d91-4a80-b1f7-8fa73f7f2911 tempest-GroupSnapshotsV319Test-2140345526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-58909726-efe9-45b6-9a97-b544139bc455.82296a38-cf78-499b-932d-4b2b71515096" returned: 0 in 0.658s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:06:06 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-875b17b8-6d91-4a80-b1f7-8fa73f7f2911 tempest-GroupSnapshotsV319Test-2140345526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-58909726-efe9-45b6-9a97-b544139bc455.82296a38-cf78-499b-932d-4b2b71515096 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:06:06 devstack sudo[85031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-58909726-efe9-45b6-9a97-b544139bc455.82296a38-cf78-499b-932d-4b2b71515096 Apr 16 15:06:06 devstack sudo[85031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:06:06 devstack sudo[85024]: pam_unix(sudo:session): session closed for user root Apr 16 15:06:06 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-fcad8290-a97c-4168-be35-434d210bce27 tempest-GroupsTest-1909532821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-7c1772a2-3e32-4955-9435-75a5d91ce06a" returned: 0 in 0.595s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:06:06 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-fcad8290-a97c-4168-be35-434d210bce27 tempest-GroupsTest-1909532821 None] <== create_volume: return (1401ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'} {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 15:06:06 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-fcad8290-a97c-4168-be35-434d210bce27 tempest-GroupsTest-1909532821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.403s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:06:06 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [req-d0bbb131-7afd-4933-bfda-1d9eb9d836ac req-a41c2750-0827-428d-8051-f75861d4e127 tempest-VolumesGetTestJSON-763643571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.456s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:06:06 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [req-d0bbb131-7afd-4933-bfda-1d9eb9d836ac req-a41c2750-0827-428d-8051-f75861d4e127 tempest-VolumesGetTestJSON-763643571 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:06:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-246225967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3d94305-d0c7-4239-bba0-c7f9492cef5b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8928da93e4f5437c92df0d9f411f5c82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:06:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:06:06Z,use_quota=True,user_id='badf701e7a78419dae03abfc0d34639e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)}" {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 15:06:06 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [req-d0bbb131-7afd-4933-bfda-1d9eb9d836ac req-a41c2750-0827-428d-8051-f75861d4e127 tempest-VolumesGetTestJSON-763643571 None] Creating volume e3d94305-d0c7-4239-bba0-c7f9492cef5b {{(pid=82756) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 15:06:06 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [req-d0bbb131-7afd-4933-bfda-1d9eb9d836ac req-a41c2750-0827-428d-8051-f75861d4e127 tempest-VolumesGetTestJSON-763643571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:06:06 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [req-d0bbb131-7afd-4933-bfda-1d9eb9d836ac req-a41c2750-0827-428d-8051-f75861d4e127 tempest-VolumesGetTestJSON-763643571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:06:06 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [req-d0bbb131-7afd-4933-bfda-1d9eb9d836ac req-a41c2750-0827-428d-8051-f75861d4e127 tempest-VolumesGetTestJSON-763643571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:06:06 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [req-d0bbb131-7afd-4933-bfda-1d9eb9d836ac req-a41c2750-0827-428d-8051-f75861d4e127 tempest-VolumesGetTestJSON-763643571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:06:06 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [req-d0bbb131-7afd-4933-bfda-1d9eb9d836ac req-a41c2750-0827-428d-8051-f75861d4e127 tempest-VolumesGetTestJSON-763643571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:06:06 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [req-d0bbb131-7afd-4933-bfda-1d9eb9d836ac req-a41c2750-0827-428d-8051-f75861d4e127 tempest-VolumesGetTestJSON-763643571 None] Selected osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 as target Quobyte volume. {{(pid=82756) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 15:06:06 devstack cinder-volume[82756]: INFO cinder.volume.drivers.remotefs [req-d0bbb131-7afd-4933-bfda-1d9eb9d836ac req-a41c2750-0827-428d-8051-f75861d4e127 tempest-VolumesGetTestJSON-763643571 None] casted to osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 Apr 16 15:06:06 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [req-d0bbb131-7afd-4933-bfda-1d9eb9d836ac req-a41c2750-0827-428d-8051-f75861d4e127 tempest-VolumesGetTestJSON-763643571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-e3d94305-d0c7-4239-bba0-c7f9492cef5b 1073741824 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:06:06 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-fcad8290-a97c-4168-be35-434d210bce27 tempest-GroupsTest-1909532821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (544d29e8-3d0c-46dd-9e4b-c75d32de66ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c1772a2-3e32-4955-9435-75a5d91ce06a', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:06:06 devstack sudo[85037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-e3d94305-d0c7-4239-bba0-c7f9492cef5b 1073741824 Apr 16 15:06:06 devstack sudo[85037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:06:06 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-fcad8290-a97c-4168-be35-434d210bce27 tempest-GroupsTest-1909532821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8ec0c66-9c16-4fc9-9009-e06a265aee3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:06:06 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-fcad8290-a97c-4168-be35-434d210bce27 tempest-GroupsTest-1909532821 None] Volume volume-7c1772a2-3e32-4955-9435-75a5d91ce06a (7c1772a2-3e32-4955-9435-75a5d91ce06a): created successfully Apr 16 15:06:06 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-fcad8290-a97c-4168-be35-434d210bce27 tempest-GroupsTest-1909532821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8ec0c66-9c16-4fc9-9009-e06a265aee3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:06:06 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-fcad8290-a97c-4168-be35-434d210bce27 tempest-GroupsTest-1909532821 None] Flow 'volume_create_manager' (4a58221b-8eba-4b48-a47a-9817b3433cc1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:06:06 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-fcad8290-a97c-4168-be35-434d210bce27 tempest-GroupsTest-1909532821 None] Created volume successfully. Apr 16 15:06:06 devstack sudo[85031]: pam_unix(sudo:session): session closed for user root Apr 16 15:06:06 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-875b17b8-6d91-4a80-b1f7-8fa73f7f2911 tempest-GroupSnapshotsV319Test-2140345526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-58909726-efe9-45b6-9a97-b544139bc455.82296a38-cf78-499b-932d-4b2b71515096" returned: 0 in 0.483s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:06:06 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-875b17b8-6d91-4a80-b1f7-8fa73f7f2911 tempest-GroupSnapshotsV319Test-2140345526 None] Lock "cinder-quobyte-82296a38-cf78-499b-932d-4b2b71515096" released by "_delete_snapshot" :: held 2.577s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:06:06 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-875b17b8-6d91-4a80-b1f7-8fa73f7f2911 tempest-GroupSnapshotsV319Test-2140345526 None] Lock "cinder-quobyte-58909726-efe9-45b6-9a97-b544139bc455" released by "delete_snapshot" :: held 2.588s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:06:06 devstack cinder-volume[82756]: WARNING cinder.quota [None req-875b17b8-6d91-4a80-b1f7-8fa73f7f2911 tempest-GroupSnapshotsV319Test-2140345526 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-151975967 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-151975967, it is now deprecated. Please use the default quota class for default quota. Apr 16 15:06:06 devstack cinder-volume[82756]: WARNING cinder.quota [None req-875b17b8-6d91-4a80-b1f7-8fa73f7f2911 tempest-GroupSnapshotsV319Test-2140345526 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-151975967 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-151975967, it is now deprecated. Please use the default quota class for default quota. Apr 16 15:06:06 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-875b17b8-6d91-4a80-b1f7-8fa73f7f2911 tempest-GroupSnapshotsV319Test-2140345526 None] Created reservations ['6ed607ba-af8a-4fe9-a9df-3767d17b258e', '428d16db-39ba-4a5f-b2c9-297090266297', 'a1ce31cb-c173-4b87-b2a1-62b7ea9860a8', 'e4c42092-20ea-43d4-a281-75fec5be360a'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:06:06 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-875b17b8-6d91-4a80-b1f7-8fa73f7f2911 tempest-GroupSnapshotsV319Test-2140345526 None] group_snapshot 4c81793a-319f-4182-95cd-a96e8df1f145: deleted successfully Apr 16 15:06:07 devstack sudo[85037]: pam_unix(sudo:session): session closed for user root Apr 16 15:06:07 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [req-d0bbb131-7afd-4933-bfda-1d9eb9d836ac req-a41c2750-0827-428d-8051-f75861d4e127 tempest-VolumesGetTestJSON-763643571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-e3d94305-d0c7-4239-bba0-c7f9492cef5b 1073741824" returned: 0 in 0.474s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:06:07 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [req-d0bbb131-7afd-4933-bfda-1d9eb9d836ac req-a41c2750-0827-428d-8051-f75861d4e127 tempest-VolumesGetTestJSON-763643571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-e3d94305-d0c7-4239-bba0-c7f9492cef5b {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:06:07 devstack sudo[85043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-e3d94305-d0c7-4239-bba0-c7f9492cef5b Apr 16 15:06:07 devstack sudo[85043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:06:07 devstack sudo[85043]: pam_unix(sudo:session): session closed for user root Apr 16 15:06:07 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [req-d0bbb131-7afd-4933-bfda-1d9eb9d836ac req-a41c2750-0827-428d-8051-f75861d4e127 tempest-VolumesGetTestJSON-763643571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-e3d94305-d0c7-4239-bba0-c7f9492cef5b" returned: 0 in 0.445s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:06:07 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [req-d0bbb131-7afd-4933-bfda-1d9eb9d836ac req-a41c2750-0827-428d-8051-f75861d4e127 tempest-VolumesGetTestJSON-763643571 None] <== create_volume: return (944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'} {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 15:06:07 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [req-d0bbb131-7afd-4933-bfda-1d9eb9d836ac req-a41c2750-0827-428d-8051-f75861d4e127 tempest-VolumesGetTestJSON-763643571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:06:07 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [req-d0bbb131-7afd-4933-bfda-1d9eb9d836ac req-a41c2750-0827-428d-8051-f75861d4e127 tempest-VolumesGetTestJSON-763643571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd2391a9-131b-42c5-89b9-e2955b304d8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3d94305-d0c7-4239-bba0-c7f9492cef5b', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:06:07 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [req-d0bbb131-7afd-4933-bfda-1d9eb9d836ac req-a41c2750-0827-428d-8051-f75861d4e127 tempest-VolumesGetTestJSON-763643571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ce9d78d-e1a8-4167-a2a0-86e7adacb3ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:06:07 devstack cinder-volume[82756]: DEBUG dbcounter [-] [82756] Writing DB stats cinder:SELECT=114,cinder:UPDATE=103,cinder:INSERT=24,cinder:DELETE=7 {{(pid=82756) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 15:06:07 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [req-d0bbb131-7afd-4933-bfda-1d9eb9d836ac req-a41c2750-0827-428d-8051-f75861d4e127 tempest-VolumesGetTestJSON-763643571 None] Volume volume-e3d94305-d0c7-4239-bba0-c7f9492cef5b (e3d94305-d0c7-4239-bba0-c7f9492cef5b): created successfully Apr 16 15:06:07 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [req-d0bbb131-7afd-4933-bfda-1d9eb9d836ac req-a41c2750-0827-428d-8051-f75861d4e127 tempest-VolumesGetTestJSON-763643571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ce9d78d-e1a8-4167-a2a0-86e7adacb3ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:06:07 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [req-d0bbb131-7afd-4933-bfda-1d9eb9d836ac req-a41c2750-0827-428d-8051-f75861d4e127 tempest-VolumesGetTestJSON-763643571 None] Flow 'volume_create_manager' (b1037683-55d5-4d28-9c05-78e12cde2453) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:06:07 devstack cinder-volume[82756]: INFO cinder.volume.manager [req-d0bbb131-7afd-4933-bfda-1d9eb9d836ac req-a41c2750-0827-428d-8051-f75861d4e127 tempest-VolumesGetTestJSON-763643571 None] Created volume successfully. Apr 16 15:06:07 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [None req-350a877b-6512-415c-95ad-a384354ebb79 tempest-GroupsTest-1909532821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82756) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 15:06:07 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-350a877b-6512-415c-95ad-a384354ebb79 tempest-GroupsTest-1909532821 None] Flow 'volume_create_manager' (dadf4d64-4b32-445c-961f-b90dffe7f3c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:06:07 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-350a877b-6512-415c-95ad-a384354ebb79 tempest-GroupsTest-1909532821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df490ab6-e6a2-47b5-b05f-cf3d178a5f9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:06:07 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-350a877b-6512-415c-95ad-a384354ebb79 tempest-GroupsTest-1909532821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df490ab6-e6a2-47b5-b05f-cf3d178a5f9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:06:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-511699543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=832dc34d-d46d-4dd4-8531-ec1099eee49c,host='devstack@QuobyteHD#QuobyteHD',id=7738f63e-4590-44aa-a3fe-b501c3e66344,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5099cfd6bb39435499c0988e2c492584',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:06:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:06:08Z,use_quota=True,user_id='84f0f364aa134122861068c6779b0494',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e42ad67-ac47-435d-91d5-b2107cb64df1),volume_type_id=7e42ad67-ac47-435d-91d5-b2107cb64df1)' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:06:07 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-350a877b-6512-415c-95ad-a384354ebb79 tempest-GroupsTest-1909532821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (303ab642-17ae-497a-ba0a-0e2f3571b5a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:06:07 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-350a877b-6512-415c-95ad-a384354ebb79 tempest-GroupsTest-1909532821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (303ab642-17ae-497a-ba0a-0e2f3571b5a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:06:07 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-350a877b-6512-415c-95ad-a384354ebb79 tempest-GroupsTest-1909532821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8df8eef3-1bb8-4ad4-8f36-04f51d7f1e51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:06:07 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-350a877b-6512-415c-95ad-a384354ebb79 tempest-GroupsTest-1909532821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8df8eef3-1bb8-4ad4-8f36-04f51d7f1e51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7738f63e-4590-44aa-a3fe-b501c3e66344', 'volume_name': 'volume-7738f63e-4590-44aa-a3fe-b501c3e66344', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:06:07 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-350a877b-6512-415c-95ad-a384354ebb79 tempest-GroupsTest-1909532821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88c58640-7cd0-4725-8733-6e82754dc49d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:06:07 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-350a877b-6512-415c-95ad-a384354ebb79 tempest-GroupsTest-1909532821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88c58640-7cd0-4725-8733-6e82754dc49d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:06:07 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-350a877b-6512-415c-95ad-a384354ebb79 tempest-GroupsTest-1909532821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30a12228-0e59-40c1-82c2-012bc6420612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:06:07 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-350a877b-6512-415c-95ad-a384354ebb79 tempest-GroupsTest-1909532821 None] Volume 7738f63e-4590-44aa-a3fe-b501c3e66344: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7738f63e-4590-44aa-a3fe-b501c3e66344', 'volume_size': 1} Apr 16 15:06:07 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-350a877b-6512-415c-95ad-a384354ebb79 tempest-GroupsTest-1909532821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:06:07 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-350a877b-6512-415c-95ad-a384354ebb79 tempest-GroupsTest-1909532821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:06:07 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-350a877b-6512-415c-95ad-a384354ebb79 tempest-GroupsTest-1909532821 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=832dc34d-d46d-4dd4-8531-ec1099eee49c,created_at=2026-04-16T13:06:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-511699543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=832dc34d-d46d-4dd4-8531-ec1099eee49c,host='devstack@QuobyteHD#QuobyteHD',id=7738f63e-4590-44aa-a3fe-b501c3e66344,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5099cfd6bb39435499c0988e2c492584',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:06:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:06:08Z,use_quota=True,user_id='84f0f364aa134122861068c6779b0494',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e42ad67-ac47-435d-91d5-b2107cb64df1),volume_type_id=7e42ad67-ac47-435d-91d5-b2107cb64df1)}" {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 15:06:07 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-350a877b-6512-415c-95ad-a384354ebb79 tempest-GroupsTest-1909532821 None] Creating volume 7738f63e-4590-44aa-a3fe-b501c3e66344 {{(pid=82756) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 15:06:07 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-350a877b-6512-415c-95ad-a384354ebb79 tempest-GroupsTest-1909532821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:06:07 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-350a877b-6512-415c-95ad-a384354ebb79 tempest-GroupsTest-1909532821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:06:07 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-350a877b-6512-415c-95ad-a384354ebb79 tempest-GroupsTest-1909532821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:06:07 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-350a877b-6512-415c-95ad-a384354ebb79 tempest-GroupsTest-1909532821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:06:07 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-350a877b-6512-415c-95ad-a384354ebb79 tempest-GroupsTest-1909532821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:06:07 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-350a877b-6512-415c-95ad-a384354ebb79 tempest-GroupsTest-1909532821 None] Selected osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 as target Quobyte volume. {{(pid=82756) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 15:06:07 devstack cinder-volume[82756]: INFO cinder.volume.drivers.remotefs [None req-350a877b-6512-415c-95ad-a384354ebb79 tempest-GroupsTest-1909532821 None] casted to osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 Apr 16 15:06:07 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-350a877b-6512-415c-95ad-a384354ebb79 tempest-GroupsTest-1909532821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-7738f63e-4590-44aa-a3fe-b501c3e66344 1073741824 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:06:07 devstack sudo[85046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-7738f63e-4590-44aa-a3fe-b501c3e66344 1073741824 Apr 16 15:06:07 devstack sudo[85046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:06:07 devstack cinder-volume[82756]: DEBUG dbcounter [-] [82756] Writing DB stats cinder:SELECT=100,cinder:UPDATE=131,cinder:INSERT=27,cinder:DELETE=11 {{(pid=82756) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 15:06:07 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-a5fb0b52-5ce7-4b0c-9697-a833a99e6174 tempest-GroupSnapshotsV319Test-2140345526 None] Acquiring lock "cinder-quobyte-58909726-efe9-45b6-9a97-b544139bc455" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:06:07 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-a5fb0b52-5ce7-4b0c-9697-a833a99e6174 tempest-GroupSnapshotsV319Test-2140345526 None] Lock "cinder-quobyte-58909726-efe9-45b6-9a97-b544139bc455" acquired by "delete_volume" :: waited 0.011s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:06:08 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[de3e1391-c4a6-4a6c-877f-fd58c4698da9]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:06:08 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-a5fb0b52-5ce7-4b0c-9697-a833a99e6174 tempest-GroupSnapshotsV319Test-2140345526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-58909726-efe9-45b6-9a97-b544139bc455 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:06:08 devstack sudo[85048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-58909726-efe9-45b6-9a97-b544139bc455 Apr 16 15:06:08 devstack sudo[85048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:06:08 devstack sudo[85046]: pam_unix(sudo:session): session closed for user root Apr 16 15:06:08 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-350a877b-6512-415c-95ad-a384354ebb79 tempest-GroupsTest-1909532821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-7738f63e-4590-44aa-a3fe-b501c3e66344 1073741824" returned: 0 in 0.471s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:06:08 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-350a877b-6512-415c-95ad-a384354ebb79 tempest-GroupsTest-1909532821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-7738f63e-4590-44aa-a3fe-b501c3e66344 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:06:08 devstack sudo[85053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-7738f63e-4590-44aa-a3fe-b501c3e66344 Apr 16 15:06:08 devstack sudo[85053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:06:08 devstack cinder-volume[82756]: DEBUG cinder.coordination [req-14e56762-776f-4cd9-87b7-f196813219d2 req-5a988e55-02c9-4d3e-a21d-366bb7feca3d tempest-VolumesGetTestJSON-763643571 None] Acquiring lock "cinder-e3d94305-d0c7-4239-bba0-c7f9492cef5b-delete_volume" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:06:08 devstack cinder-volume[82756]: DEBUG cinder.coordination [req-14e56762-776f-4cd9-87b7-f196813219d2 req-5a988e55-02c9-4d3e-a21d-366bb7feca3d tempest-VolumesGetTestJSON-763643571 None] Lock "cinder-e3d94305-d0c7-4239-bba0-c7f9492cef5b-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:06:08 devstack cinder-volume[82756]: DEBUG cinder.coordination [req-14e56762-776f-4cd9-87b7-f196813219d2 req-5a988e55-02c9-4d3e-a21d-366bb7feca3d tempest-VolumesGetTestJSON-763643571 None] Acquiring lock "cinder-quobyte-e3d94305-d0c7-4239-bba0-c7f9492cef5b" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:06:08 devstack cinder-volume[82756]: DEBUG cinder.coordination [req-14e56762-776f-4cd9-87b7-f196813219d2 req-5a988e55-02c9-4d3e-a21d-366bb7feca3d tempest-VolumesGetTestJSON-763643571 None] Lock "cinder-quobyte-e3d94305-d0c7-4239-bba0-c7f9492cef5b" acquired by "delete_volume" :: waited 0.020s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:06:08 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aa08612-2cd5-4819-93b1-7874e88ca6a3]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:06:08 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [req-14e56762-776f-4cd9-87b7-f196813219d2 req-5a988e55-02c9-4d3e-a21d-366bb7feca3d tempest-VolumesGetTestJSON-763643571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-e3d94305-d0c7-4239-bba0-c7f9492cef5b {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:06:08 devstack sudo[85048]: pam_unix(sudo:session): session closed for user root Apr 16 15:06:08 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-a5fb0b52-5ce7-4b0c-9697-a833a99e6174 tempest-GroupSnapshotsV319Test-2140345526 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-58909726-efe9-45b6-9a97-b544139bc455" returned: 0 in 0.528s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:06:08 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-a5fb0b52-5ce7-4b0c-9697-a833a99e6174 tempest-GroupSnapshotsV319Test-2140345526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-58909726-efe9-45b6-9a97-b544139bc455 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:06:08 devstack sudo[85059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-58909726-efe9-45b6-9a97-b544139bc455 Apr 16 15:06:08 devstack sudo[85059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:06:08 devstack sudo[85058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-e3d94305-d0c7-4239-bba0-c7f9492cef5b Apr 16 15:06:08 devstack sudo[85058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:06:08 devstack sudo[85053]: pam_unix(sudo:session): session closed for user root Apr 16 15:06:08 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-350a877b-6512-415c-95ad-a384354ebb79 tempest-GroupsTest-1909532821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-7738f63e-4590-44aa-a3fe-b501c3e66344" returned: 0 in 0.538s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:06:08 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-350a877b-6512-415c-95ad-a384354ebb79 tempest-GroupsTest-1909532821 None] <== create_volume: return (1057ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'} {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 15:06:08 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-350a877b-6512-415c-95ad-a384354ebb79 tempest-GroupsTest-1909532821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.061s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:06:08 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-350a877b-6512-415c-95ad-a384354ebb79 tempest-GroupsTest-1909532821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30a12228-0e59-40c1-82c2-012bc6420612) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7738f63e-4590-44aa-a3fe-b501c3e66344', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:06:08 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-350a877b-6512-415c-95ad-a384354ebb79 tempest-GroupsTest-1909532821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c73ed0f1-410b-455f-8685-20a3b40e8e1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:06:08 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-350a877b-6512-415c-95ad-a384354ebb79 tempest-GroupsTest-1909532821 None] Volume volume-7738f63e-4590-44aa-a3fe-b501c3e66344 (7738f63e-4590-44aa-a3fe-b501c3e66344): created successfully Apr 16 15:06:08 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-350a877b-6512-415c-95ad-a384354ebb79 tempest-GroupsTest-1909532821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c73ed0f1-410b-455f-8685-20a3b40e8e1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:06:08 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-350a877b-6512-415c-95ad-a384354ebb79 tempest-GroupsTest-1909532821 None] Flow 'volume_create_manager' (dadf4d64-4b32-445c-961f-b90dffe7f3c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:06:08 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-350a877b-6512-415c-95ad-a384354ebb79 tempest-GroupsTest-1909532821 None] Created volume successfully. Apr 16 15:06:08 devstack sudo[85059]: pam_unix(sudo:session): session closed for user root Apr 16 15:06:08 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-a5fb0b52-5ce7-4b0c-9697-a833a99e6174 tempest-GroupSnapshotsV319Test-2140345526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-58909726-efe9-45b6-9a97-b544139bc455" returned: 0 in 0.462s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:06:09 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-a5fb0b52-5ce7-4b0c-9697-a833a99e6174 tempest-GroupSnapshotsV319Test-2140345526 None] Lock "cinder-quobyte-58909726-efe9-45b6-9a97-b544139bc455" released by "delete_volume" :: held 1.032s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:06:09 devstack sudo[85058]: pam_unix(sudo:session): session closed for user root Apr 16 15:06:09 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [req-14e56762-776f-4cd9-87b7-f196813219d2 req-5a988e55-02c9-4d3e-a21d-366bb7feca3d tempest-VolumesGetTestJSON-763643571 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-e3d94305-d0c7-4239-bba0-c7f9492cef5b" returned: 0 in 0.552s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:06:09 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [req-14e56762-776f-4cd9-87b7-f196813219d2 req-5a988e55-02c9-4d3e-a21d-366bb7feca3d tempest-VolumesGetTestJSON-763643571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-e3d94305-d0c7-4239-bba0-c7f9492cef5b {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:06:09 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-a5fb0b52-5ce7-4b0c-9697-a833a99e6174 tempest-GroupSnapshotsV319Test-2140345526 None] Created reservations ['2ce0c6f7-7a4e-422d-b8ba-229365caacff'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:06:09 devstack sudo[85067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-e3d94305-d0c7-4239-bba0-c7f9492cef5b Apr 16 15:06:09 devstack sudo[85067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:06:09 devstack cinder-volume[82756]: WARNING cinder.quota [None req-a5fb0b52-5ce7-4b0c-9697-a833a99e6174 tempest-GroupSnapshotsV319Test-2140345526 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-151975967 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-151975967, it is now deprecated. Please use the default quota class for default quota. Apr 16 15:06:09 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-a5fb0b52-5ce7-4b0c-9697-a833a99e6174 tempest-GroupSnapshotsV319Test-2140345526 None] Created reservations ['ebbf3068-bdcc-462e-81bf-f4f5c44af42f', '3e162ff5-52a8-456d-9c2f-0e48e2698abf', '9d04bb9d-d9cf-4485-b332-31fa9e8fbdba', '77c8f050-7f9a-4611-b1e9-11e6b92f1a18'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:06:09 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-a5fb0b52-5ce7-4b0c-9697-a833a99e6174 tempest-GroupSnapshotsV319Test-2140345526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:06:09 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-a5fb0b52-5ce7-4b0c-9697-a833a99e6174 tempest-GroupSnapshotsV319Test-2140345526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:06:09 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-a5fb0b52-5ce7-4b0c-9697-a833a99e6174 tempest-GroupSnapshotsV319Test-2140345526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:06:09 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-a5fb0b52-5ce7-4b0c-9697-a833a99e6174 tempest-GroupSnapshotsV319Test-2140345526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:06:09 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-a5fb0b52-5ce7-4b0c-9697-a833a99e6174 tempest-GroupSnapshotsV319Test-2140345526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:06:09 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-a5fb0b52-5ce7-4b0c-9697-a833a99e6174 tempest-GroupSnapshotsV319Test-2140345526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:06:09 devstack sudo[85069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:06:09 devstack sudo[85069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:06:09 devstack sudo[85067]: pam_unix(sudo:session): session closed for user root Apr 16 15:06:09 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [req-14e56762-776f-4cd9-87b7-f196813219d2 req-5a988e55-02c9-4d3e-a21d-366bb7feca3d tempest-VolumesGetTestJSON-763643571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-e3d94305-d0c7-4239-bba0-c7f9492cef5b" returned: 0 in 0.446s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:06:09 devstack cinder-volume[82756]: DEBUG cinder.coordination [req-14e56762-776f-4cd9-87b7-f196813219d2 req-5a988e55-02c9-4d3e-a21d-366bb7feca3d tempest-VolumesGetTestJSON-763643571 None] Lock "cinder-quobyte-e3d94305-d0c7-4239-bba0-c7f9492cef5b" released by "delete_volume" :: held 1.023s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:06:09 devstack cinder-volume[82756]: DEBUG cinder.quota [req-14e56762-776f-4cd9-87b7-f196813219d2 req-5a988e55-02c9-4d3e-a21d-366bb7feca3d tempest-VolumesGetTestJSON-763643571 None] Created reservations ['4119dba4-99c3-48dd-8868-179882c4e13f', '8c5c0484-7cd2-4443-99d9-6a913b8f4807', 'd5785d36-51f9-457a-9ba6-0ecacb378fd0', '8eab2ce3-5e7f-4d39-97b5-ed53523cc43a'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:06:09 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [req-14e56762-776f-4cd9-87b7-f196813219d2 req-5a988e55-02c9-4d3e-a21d-366bb7feca3d tempest-VolumesGetTestJSON-763643571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:06:09 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [req-14e56762-776f-4cd9-87b7-f196813219d2 req-5a988e55-02c9-4d3e-a21d-366bb7feca3d tempest-VolumesGetTestJSON-763643571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:06:09 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [req-14e56762-776f-4cd9-87b7-f196813219d2 req-5a988e55-02c9-4d3e-a21d-366bb7feca3d tempest-VolumesGetTestJSON-763643571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:06:09 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [req-14e56762-776f-4cd9-87b7-f196813219d2 req-5a988e55-02c9-4d3e-a21d-366bb7feca3d tempest-VolumesGetTestJSON-763643571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:06:09 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [req-14e56762-776f-4cd9-87b7-f196813219d2 req-5a988e55-02c9-4d3e-a21d-366bb7feca3d tempest-VolumesGetTestJSON-763643571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:06:09 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [req-14e56762-776f-4cd9-87b7-f196813219d2 req-5a988e55-02c9-4d3e-a21d-366bb7feca3d tempest-VolumesGetTestJSON-763643571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:06:09 devstack sudo[85069]: pam_unix(sudo:session): session closed for user root Apr 16 15:06:09 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-a5fb0b52-5ce7-4b0c-9697-a833a99e6174 tempest-GroupSnapshotsV319Test-2140345526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.438s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:06:09 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-a5fb0b52-5ce7-4b0c-9697-a833a99e6174 tempest-GroupSnapshotsV319Test-2140345526 None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:06:09 devstack sudo[85073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:06:09 devstack sudo[85073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:06:09 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-a5fb0b52-5ce7-4b0c-9697-a833a99e6174 tempest-GroupSnapshotsV319Test-2140345526 None] Delete group completed successfully. Apr 16 15:06:09 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-f2b0a1f1-35e4-4458-8283-a46757a5d53e tempest-GroupsTest-1909532821 None] Update group completed successfully. Apr 16 15:06:10 devstack sudo[85073]: pam_unix(sudo:session): session closed for user root Apr 16 15:06:10 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [req-14e56762-776f-4cd9-87b7-f196813219d2 req-5a988e55-02c9-4d3e-a21d-366bb7feca3d tempest-VolumesGetTestJSON-763643571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.444s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:06:10 devstack cinder-volume[82756]: DEBUG cinder.manager [req-14e56762-776f-4cd9-87b7-f196813219d2 req-5a988e55-02c9-4d3e-a21d-366bb7feca3d tempest-VolumesGetTestJSON-763643571 None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:06:10 devstack cinder-volume[82756]: INFO cinder.volume.manager [req-14e56762-776f-4cd9-87b7-f196813219d2 req-5a988e55-02c9-4d3e-a21d-366bb7feca3d tempest-VolumesGetTestJSON-763643571 None] Deleted volume successfully. Apr 16 15:06:10 devstack cinder-volume[82756]: DEBUG cinder.coordination [req-14e56762-776f-4cd9-87b7-f196813219d2 req-5a988e55-02c9-4d3e-a21d-366bb7feca3d tempest-VolumesGetTestJSON-763643571 None] Lock "cinder-e3d94305-d0c7-4239-bba0-c7f9492cef5b-delete_volume" released by "delete_volume" :: held 1.613s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:06:11 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-6010e705-622f-4c07-935a-4c63a76f91a6 tempest-GroupsTest-1909532821 None] Update group completed successfully. Apr 16 15:06:12 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-f06f7725-c573-492e-9cc3-03f7d50f1b28 tempest-GroupsTest-1909532821 None] Acquiring lock "cinder-quobyte-7738f63e-4590-44aa-a3fe-b501c3e66344" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:06:12 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-f06f7725-c573-492e-9cc3-03f7d50f1b28 tempest-GroupsTest-1909532821 None] Lock "cinder-quobyte-7738f63e-4590-44aa-a3fe-b501c3e66344" acquired by "delete_volume" :: waited 0.015s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:06:12 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[a368461f-cfce-480e-bd9e-6849171a8132]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:06:12 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-f06f7725-c573-492e-9cc3-03f7d50f1b28 tempest-GroupsTest-1909532821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-7738f63e-4590-44aa-a3fe-b501c3e66344 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:06:12 devstack sudo[85089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-7738f63e-4590-44aa-a3fe-b501c3e66344 Apr 16 15:06:12 devstack sudo[85089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:06:13 devstack sudo[85089]: pam_unix(sudo:session): session closed for user root Apr 16 15:06:13 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-f06f7725-c573-492e-9cc3-03f7d50f1b28 tempest-GroupsTest-1909532821 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-7738f63e-4590-44aa-a3fe-b501c3e66344" returned: 0 in 0.654s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:06:13 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-f06f7725-c573-492e-9cc3-03f7d50f1b28 tempest-GroupsTest-1909532821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-7738f63e-4590-44aa-a3fe-b501c3e66344 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:06:13 devstack sudo[85100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-7738f63e-4590-44aa-a3fe-b501c3e66344 Apr 16 15:06:13 devstack sudo[85100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:06:13 devstack sudo[85100]: pam_unix(sudo:session): session closed for user root Apr 16 15:06:13 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-f06f7725-c573-492e-9cc3-03f7d50f1b28 tempest-GroupsTest-1909532821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-7738f63e-4590-44aa-a3fe-b501c3e66344" returned: 0 in 0.488s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:06:13 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-f06f7725-c573-492e-9cc3-03f7d50f1b28 tempest-GroupsTest-1909532821 None] Lock "cinder-quobyte-7738f63e-4590-44aa-a3fe-b501c3e66344" released by "delete_volume" :: held 1.176s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:06:13 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-f06f7725-c573-492e-9cc3-03f7d50f1b28 tempest-GroupsTest-1909532821 None] Acquiring lock "cinder-quobyte-7c1772a2-3e32-4955-9435-75a5d91ce06a" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:06:13 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-f06f7725-c573-492e-9cc3-03f7d50f1b28 tempest-GroupsTest-1909532821 None] Lock "cinder-quobyte-7c1772a2-3e32-4955-9435-75a5d91ce06a" acquired by "delete_volume" :: waited 0.008s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:06:13 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[eef93336-96de-4e86-a84c-d3b8424d86e4]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:06:13 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-f06f7725-c573-492e-9cc3-03f7d50f1b28 tempest-GroupsTest-1909532821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-7c1772a2-3e32-4955-9435-75a5d91ce06a {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:06:14 devstack sudo[85103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-7c1772a2-3e32-4955-9435-75a5d91ce06a Apr 16 15:06:14 devstack sudo[85103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:06:14 devstack sudo[85103]: pam_unix(sudo:session): session closed for user root Apr 16 15:06:14 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-f06f7725-c573-492e-9cc3-03f7d50f1b28 tempest-GroupsTest-1909532821 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-7c1772a2-3e32-4955-9435-75a5d91ce06a" returned: 0 in 0.542s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:06:14 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-f06f7725-c573-492e-9cc3-03f7d50f1b28 tempest-GroupsTest-1909532821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-7c1772a2-3e32-4955-9435-75a5d91ce06a {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:06:14 devstack sudo[85108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-7c1772a2-3e32-4955-9435-75a5d91ce06a Apr 16 15:06:14 devstack sudo[85108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:06:14 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-381e2821-5b0f-44dc-b6cd-b4aa03ac5d8e tempest-BackendsCapabilitiesAdminTestsJSON-1282706708 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7327880859375, 'free_capacity_gb': 1775.7327880859375, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82756) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 16 15:06:14 devstack sudo[85108]: pam_unix(sudo:session): session closed for user root Apr 16 15:06:14 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-f06f7725-c573-492e-9cc3-03f7d50f1b28 tempest-GroupsTest-1909532821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-7c1772a2-3e32-4955-9435-75a5d91ce06a" returned: 0 in 0.453s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:06:14 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-f06f7725-c573-492e-9cc3-03f7d50f1b28 tempest-GroupsTest-1909532821 None] Lock "cinder-quobyte-7c1772a2-3e32-4955-9435-75a5d91ce06a" released by "delete_volume" :: held 1.017s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:06:14 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-f06f7725-c573-492e-9cc3-03f7d50f1b28 tempest-GroupsTest-1909532821 None] Created reservations ['a9d57ff9-bf63-4da3-b73c-a195351a0577'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:06:14 devstack cinder-volume[82756]: WARNING cinder.quota [None req-f06f7725-c573-492e-9cc3-03f7d50f1b28 tempest-GroupsTest-1909532821 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1428356529 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1428356529, it is now deprecated. Please use the default quota class for default quota. Apr 16 15:06:14 devstack cinder-volume[82756]: WARNING cinder.quota [None req-f06f7725-c573-492e-9cc3-03f7d50f1b28 tempest-GroupsTest-1909532821 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1428356529 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1428356529, it is now deprecated. Please use the default quota class for default quota. Apr 16 15:06:15 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-f06f7725-c573-492e-9cc3-03f7d50f1b28 tempest-GroupsTest-1909532821 None] Created reservations ['620197a1-c0fe-42f4-94df-ca827ff46d7a', '97f0572b-645f-4b7e-97ca-ea8b1804dbc9', '16371cd3-88c7-4af2-8d37-1ef54d4dabb9', '6e5c0560-52e4-41ed-a1f1-cb74cc22153e'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:06:15 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-f06f7725-c573-492e-9cc3-03f7d50f1b28 tempest-GroupsTest-1909532821 None] Created reservations ['29e041e2-e3bd-4b62-8266-b7c4ca1cc99f', 'bf02a854-8f78-4554-a99f-c30c7f7c436e', '4930db24-9f15-44e0-b638-b9ecf1a2fa78', 'aa43fa7a-c41b-4d83-9cdb-06f948745604'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:06:15 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-f06f7725-c573-492e-9cc3-03f7d50f1b28 tempest-GroupsTest-1909532821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:06:15 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-f06f7725-c573-492e-9cc3-03f7d50f1b28 tempest-GroupsTest-1909532821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:06:15 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-f06f7725-c573-492e-9cc3-03f7d50f1b28 tempest-GroupsTest-1909532821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:06:15 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-f06f7725-c573-492e-9cc3-03f7d50f1b28 tempest-GroupsTest-1909532821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:06:15 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-f06f7725-c573-492e-9cc3-03f7d50f1b28 tempest-GroupsTest-1909532821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:06:15 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-f06f7725-c573-492e-9cc3-03f7d50f1b28 tempest-GroupsTest-1909532821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:06:15 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-3fa7abc7-bee3-4cf9-a9d1-8e5f24def2b4 tempest-BackendsCapabilitiesAdminTestsJSON-1282706708 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7327880859375, 'free_capacity_gb': 1775.7327880859375, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82756) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 16 15:06:15 devstack sudo[85111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:06:15 devstack sudo[85111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:06:15 devstack sudo[85111]: pam_unix(sudo:session): session closed for user root Apr 16 15:06:15 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-f06f7725-c573-492e-9cc3-03f7d50f1b28 tempest-GroupsTest-1909532821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.395s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:06:15 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-f06f7725-c573-492e-9cc3-03f7d50f1b28 tempest-GroupsTest-1909532821 None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:06:15 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-f06f7725-c573-492e-9cc3-03f7d50f1b28 tempest-GroupsTest-1909532821 None] Delete group completed successfully. Apr 16 15:06:20 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-70427a11-9a19-48a0-883b-71a4f7b801e4 tempest-GroupsV314Test-1949227607 None] Group tempest-GroupsV314Test-Group-1490639096: creating Apr 16 15:06:20 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-70427a11-9a19-48a0-883b-71a4f7b801e4 tempest-GroupsV314Test-1949227607 None] Group tempest-GroupsV314Test-Group-1490639096: created successfully Apr 16 15:06:20 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-70427a11-9a19-48a0-883b-71a4f7b801e4 tempest-GroupsV314Test-1949227607 None] Create group completed successfully. Apr 16 15:06:21 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-e4136608-ed0d-41ba-b069-25c8f18f57dd tempest-GroupsV320Test-1329722571 None] Group tempest-GroupsV320Test-Group-1478202794: creating Apr 16 15:06:21 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-e4136608-ed0d-41ba-b069-25c8f18f57dd tempest-GroupsV320Test-1329722571 None] Group tempest-GroupsV320Test-Group-1478202794: created successfully Apr 16 15:06:21 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-e4136608-ed0d-41ba-b069-25c8f18f57dd tempest-GroupsV320Test-1329722571 None] Create group completed successfully. Apr 16 15:06:22 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [None req-9cca2c45-f69c-4139-bf85-a260dcfcc9c3 tempest-GroupsV314Test-1949227607 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82756) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 15:06:22 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-9cca2c45-f69c-4139-bf85-a260dcfcc9c3 tempest-GroupsV314Test-1949227607 None] Flow 'volume_create_manager' (55c8756a-65de-4191-b08e-a59b94bb8f2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:06:22 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-9cca2c45-f69c-4139-bf85-a260dcfcc9c3 tempest-GroupsV314Test-1949227607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78a6737a-d318-4ab0-91b4-0a34f2315fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:06:22 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-9cca2c45-f69c-4139-bf85-a260dcfcc9c3 tempest-GroupsV314Test-1949227607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78a6737a-d318-4ab0-91b4-0a34f2315fe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:06:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1074207027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3c477b82-c947-44b2-9505-bd27d6290b9d,host='devstack@QuobyteHD#QuobyteHD',id=e4b16ee6-0a28-44eb-9597-7605f83b327d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='302b08e2be0144a58f8e7ceb5fbf069f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:06:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:06:22Z,use_quota=True,user_id='fdc244aed2f04151965ebbd6f6720114',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cd52b62d-086d-4424-b01b-41d774ac406a),volume_type_id=cd52b62d-086d-4424-b01b-41d774ac406a)' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:06:22 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-9cca2c45-f69c-4139-bf85-a260dcfcc9c3 tempest-GroupsV314Test-1949227607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95156d6d-d3eb-4b78-86ff-c71849277aed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:06:22 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-9cca2c45-f69c-4139-bf85-a260dcfcc9c3 tempest-GroupsV314Test-1949227607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95156d6d-d3eb-4b78-86ff-c71849277aed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:06:22 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-9cca2c45-f69c-4139-bf85-a260dcfcc9c3 tempest-GroupsV314Test-1949227607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb176fc0-e21c-4e29-beb4-9dd8830a419b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:06:22 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-9cca2c45-f69c-4139-bf85-a260dcfcc9c3 tempest-GroupsV314Test-1949227607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb176fc0-e21c-4e29-beb4-9dd8830a419b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4b16ee6-0a28-44eb-9597-7605f83b327d', 'volume_name': 'volume-e4b16ee6-0a28-44eb-9597-7605f83b327d', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:06:22 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-9cca2c45-f69c-4139-bf85-a260dcfcc9c3 tempest-GroupsV314Test-1949227607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (493b5a8d-a0ae-4e6f-9eb1-e96d5e7e330d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:06:22 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-9cca2c45-f69c-4139-bf85-a260dcfcc9c3 tempest-GroupsV314Test-1949227607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (493b5a8d-a0ae-4e6f-9eb1-e96d5e7e330d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:06:22 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-9cca2c45-f69c-4139-bf85-a260dcfcc9c3 tempest-GroupsV314Test-1949227607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b0b12ac-0994-4331-987b-729a509ff6b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:06:22 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-9cca2c45-f69c-4139-bf85-a260dcfcc9c3 tempest-GroupsV314Test-1949227607 None] Volume e4b16ee6-0a28-44eb-9597-7605f83b327d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4b16ee6-0a28-44eb-9597-7605f83b327d', 'volume_size': 1} Apr 16 15:06:22 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-9cca2c45-f69c-4139-bf85-a260dcfcc9c3 tempest-GroupsV314Test-1949227607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:06:22 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-9cca2c45-f69c-4139-bf85-a260dcfcc9c3 tempest-GroupsV314Test-1949227607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:06:22 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-9cca2c45-f69c-4139-bf85-a260dcfcc9c3 tempest-GroupsV314Test-1949227607 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3c477b82-c947-44b2-9505-bd27d6290b9d,created_at=2026-04-16T13:06:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1074207027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3c477b82-c947-44b2-9505-bd27d6290b9d,host='devstack@QuobyteHD#QuobyteHD',id=e4b16ee6-0a28-44eb-9597-7605f83b327d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='302b08e2be0144a58f8e7ceb5fbf069f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:06:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:06:22Z,use_quota=True,user_id='fdc244aed2f04151965ebbd6f6720114',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cd52b62d-086d-4424-b01b-41d774ac406a),volume_type_id=cd52b62d-086d-4424-b01b-41d774ac406a)}" {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 15:06:22 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-9cca2c45-f69c-4139-bf85-a260dcfcc9c3 tempest-GroupsV314Test-1949227607 None] Creating volume e4b16ee6-0a28-44eb-9597-7605f83b327d {{(pid=82756) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 15:06:22 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-9cca2c45-f69c-4139-bf85-a260dcfcc9c3 tempest-GroupsV314Test-1949227607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:06:22 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-9cca2c45-f69c-4139-bf85-a260dcfcc9c3 tempest-GroupsV314Test-1949227607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:06:22 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-9cca2c45-f69c-4139-bf85-a260dcfcc9c3 tempest-GroupsV314Test-1949227607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:06:22 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-9cca2c45-f69c-4139-bf85-a260dcfcc9c3 tempest-GroupsV314Test-1949227607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:06:22 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-9cca2c45-f69c-4139-bf85-a260dcfcc9c3 tempest-GroupsV314Test-1949227607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:06:22 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-9cca2c45-f69c-4139-bf85-a260dcfcc9c3 tempest-GroupsV314Test-1949227607 None] Selected osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 as target Quobyte volume. {{(pid=82756) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 15:06:22 devstack cinder-volume[82756]: INFO cinder.volume.drivers.remotefs [None req-9cca2c45-f69c-4139-bf85-a260dcfcc9c3 tempest-GroupsV314Test-1949227607 None] casted to osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 Apr 16 15:06:22 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-9cca2c45-f69c-4139-bf85-a260dcfcc9c3 tempest-GroupsV314Test-1949227607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-e4b16ee6-0a28-44eb-9597-7605f83b327d 1073741824 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:06:22 devstack sudo[85162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-e4b16ee6-0a28-44eb-9597-7605f83b327d 1073741824 Apr 16 15:06:22 devstack sudo[85162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:06:23 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-597452c3-a9ee-4540-9650-38e245c7ccca tempest-GroupsV320Test-1329722571 None] Created reservations ['badabfc5-3a7f-467c-b32a-f5855d44ec26'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:06:23 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-597452c3-a9ee-4540-9650-38e245c7ccca tempest-GroupsV320Test-1329722571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:06:23 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-597452c3-a9ee-4540-9650-38e245c7ccca tempest-GroupsV320Test-1329722571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:06:23 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-597452c3-a9ee-4540-9650-38e245c7ccca tempest-GroupsV320Test-1329722571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:06:23 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-597452c3-a9ee-4540-9650-38e245c7ccca tempest-GroupsV320Test-1329722571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:06:23 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-597452c3-a9ee-4540-9650-38e245c7ccca tempest-GroupsV320Test-1329722571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:06:23 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-597452c3-a9ee-4540-9650-38e245c7ccca tempest-GroupsV320Test-1329722571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:06:23 devstack sudo[85167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:06:23 devstack sudo[85167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:06:23 devstack sudo[85162]: pam_unix(sudo:session): session closed for user root Apr 16 15:06:23 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-9cca2c45-f69c-4139-bf85-a260dcfcc9c3 tempest-GroupsV314Test-1949227607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-e4b16ee6-0a28-44eb-9597-7605f83b327d 1073741824" returned: 0 in 0.724s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:06:23 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-9cca2c45-f69c-4139-bf85-a260dcfcc9c3 tempest-GroupsV314Test-1949227607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-e4b16ee6-0a28-44eb-9597-7605f83b327d {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:06:23 devstack sudo[85169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-e4b16ee6-0a28-44eb-9597-7605f83b327d Apr 16 15:06:23 devstack sudo[85169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:06:23 devstack sudo[85169]: pam_unix(sudo:session): session closed for user root Apr 16 15:06:23 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-9cca2c45-f69c-4139-bf85-a260dcfcc9c3 tempest-GroupsV314Test-1949227607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-e4b16ee6-0a28-44eb-9597-7605f83b327d" returned: 0 in 0.476s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:06:23 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-9cca2c45-f69c-4139-bf85-a260dcfcc9c3 tempest-GroupsV314Test-1949227607 None] <== create_volume: return (1263ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'} {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 15:06:23 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-9cca2c45-f69c-4139-bf85-a260dcfcc9c3 tempest-GroupsV314Test-1949227607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.265s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:06:23 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-9cca2c45-f69c-4139-bf85-a260dcfcc9c3 tempest-GroupsV314Test-1949227607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b0b12ac-0994-4331-987b-729a509ff6b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4b16ee6-0a28-44eb-9597-7605f83b327d', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:06:23 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-9cca2c45-f69c-4139-bf85-a260dcfcc9c3 tempest-GroupsV314Test-1949227607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc64124a-d83f-4ed7-8564-b34fad088705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:06:23 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-9cca2c45-f69c-4139-bf85-a260dcfcc9c3 tempest-GroupsV314Test-1949227607 None] Volume volume-e4b16ee6-0a28-44eb-9597-7605f83b327d (e4b16ee6-0a28-44eb-9597-7605f83b327d): created successfully Apr 16 15:06:23 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-9cca2c45-f69c-4139-bf85-a260dcfcc9c3 tempest-GroupsV314Test-1949227607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc64124a-d83f-4ed7-8564-b34fad088705) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:06:23 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-9cca2c45-f69c-4139-bf85-a260dcfcc9c3 tempest-GroupsV314Test-1949227607 None] Flow 'volume_create_manager' (55c8756a-65de-4191-b08e-a59b94bb8f2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:06:23 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-9cca2c45-f69c-4139-bf85-a260dcfcc9c3 tempest-GroupsV314Test-1949227607 None] Created volume successfully. Apr 16 15:06:23 devstack sudo[85167]: pam_unix(sudo:session): session closed for user root Apr 16 15:06:23 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-597452c3-a9ee-4540-9650-38e245c7ccca tempest-GroupsV320Test-1329722571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.872s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:06:23 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-597452c3-a9ee-4540-9650-38e245c7ccca tempest-GroupsV320Test-1329722571 None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:06:23 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-597452c3-a9ee-4540-9650-38e245c7ccca tempest-GroupsV320Test-1329722571 None] Delete group completed successfully. Apr 16 15:06:25 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-a792f518-feb6-4323-ac4b-bb4a0c672803 tempest-GroupsV314Test-1949227607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:06:25 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-a792f518-feb6-4323-ac4b-bb4a0c672803 tempest-GroupsV314Test-1949227607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:06:25 devstack cinder-volume[82756]: INFO cinder.volume.drivers.remotefs [None req-a792f518-feb6-4323-ac4b-bb4a0c672803 tempest-GroupsV314Test-1949227607 None] Cloning volume e4b16ee6-0a28-44eb-9597-7605f83b327d to volume 474495d0-c2a2-4b76-9342-64b271e07ff0 Apr 16 15:06:25 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-a792f518-feb6-4323-ac4b-bb4a0c672803 tempest-GroupsV314Test-1949227607 None] Creating offline snapshot 49553429-dd9b-4870-9d18-f4e08f18f9b1 of volume e4b16ee6-0a28-44eb-9597-7605f83b327d {{(pid=82756) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 16 15:06:25 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5e49cd9-b82e-4359-ae46-da048bd9e1ac]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:06:25 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-a792f518-feb6-4323-ac4b-bb4a0c672803 tempest-GroupsV314Test-1949227607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-e4b16ee6-0a28-44eb-9597-7605f83b327d {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:06:26 devstack sudo[85200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-e4b16ee6-0a28-44eb-9597-7605f83b327d Apr 16 15:06:26 devstack sudo[85200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:06:27 devstack sudo[85200]: pam_unix(sudo:session): session closed for user root Apr 16 15:06:27 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-a792f518-feb6-4323-ac4b-bb4a0c672803 tempest-GroupsV314Test-1949227607 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-e4b16ee6-0a28-44eb-9597-7605f83b327d" returned: 0 in 1.076s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:06:27 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-a792f518-feb6-4323-ac4b-bb4a0c672803 tempest-GroupsV314Test-1949227607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-e4b16ee6-0a28-44eb-9597-7605f83b327d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-e4b16ee6-0a28-44eb-9597-7605f83b327d.49553429-dd9b-4870-9d18-f4e08f18f9b1 1G {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:06:27 devstack sudo[85206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-e4b16ee6-0a28-44eb-9597-7605f83b327d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-e4b16ee6-0a28-44eb-9597-7605f83b327d.49553429-dd9b-4870-9d18-f4e08f18f9b1 1G Apr 16 15:06:27 devstack sudo[85206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:06:27 devstack sudo[85206]: pam_unix(sudo:session): session closed for user root Apr 16 15:06:27 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-a792f518-feb6-4323-ac4b-bb4a0c672803 tempest-GroupsV314Test-1949227607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-e4b16ee6-0a28-44eb-9597-7605f83b327d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-e4b16ee6-0a28-44eb-9597-7605f83b327d.49553429-dd9b-4870-9d18-f4e08f18f9b1 1G" returned: 0 in 0.827s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:06:27 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-a792f518-feb6-4323-ac4b-bb4a0c672803 tempest-GroupsV314Test-1949227607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4b16ee6-0a28-44eb-9597-7605f83b327d -F qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-e4b16ee6-0a28-44eb-9597-7605f83b327d.49553429-dd9b-4870-9d18-f4e08f18f9b1 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:06:27 devstack sudo[85211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4b16ee6-0a28-44eb-9597-7605f83b327d -F qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-e4b16ee6-0a28-44eb-9597-7605f83b327d.49553429-dd9b-4870-9d18-f4e08f18f9b1 Apr 16 15:06:27 devstack sudo[85211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:06:28 devstack sudo[85211]: pam_unix(sudo:session): session closed for user root Apr 16 15:06:28 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-a792f518-feb6-4323-ac4b-bb4a0c672803 tempest-GroupsV314Test-1949227607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4b16ee6-0a28-44eb-9597-7605f83b327d -F qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-e4b16ee6-0a28-44eb-9597-7605f83b327d.49553429-dd9b-4870-9d18-f4e08f18f9b1" returned: 0 in 0.676s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:06:28 devstack cinder-volume[82756]: WARNING cinder.volume.drivers.remotefs [None req-a792f518-feb6-4323-ac4b-bb4a0c672803 tempest-GroupsV314Test-1949227607 None] /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-e4b16ee6-0a28-44eb-9597-7605f83b327d.49553429-dd9b-4870-9d18-f4e08f18f9b1 is being set with open permissions: ugo+rw: NotImplementedError Apr 16 15:06:28 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-a792f518-feb6-4323-ac4b-bb4a0c672803 tempest-GroupsV314Test-1949227607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-e4b16ee6-0a28-44eb-9597-7605f83b327d.49553429-dd9b-4870-9d18-f4e08f18f9b1 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:06:28 devstack sudo[85216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-e4b16ee6-0a28-44eb-9597-7605f83b327d.49553429-dd9b-4870-9d18-f4e08f18f9b1 Apr 16 15:06:28 devstack sudo[85216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:06:29 devstack sudo[85216]: pam_unix(sudo:session): session closed for user root Apr 16 15:06:29 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-a792f518-feb6-4323-ac4b-bb4a0c672803 tempest-GroupsV314Test-1949227607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-e4b16ee6-0a28-44eb-9597-7605f83b327d.49553429-dd9b-4870-9d18-f4e08f18f9b1" returned: 0 in 0.629s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:06:29 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [None req-904c4e3b-f04b-446a-bb86-c934e663421d tempest-VolumesImageMetadata-1639441407 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82756) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 15:06:29 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-904c4e3b-f04b-446a-bb86-c934e663421d tempest-VolumesImageMetadata-1639441407 None] Flow 'volume_create_manager' (db2d2857-3d16-427b-9650-3d249eeaf962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:06:29 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-904c4e3b-f04b-446a-bb86-c934e663421d tempest-VolumesImageMetadata-1639441407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8974baa5-170d-40e6-a395-3b62b4257d5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:06:29 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-a792f518-feb6-4323-ac4b-bb4a0c672803 tempest-GroupsV314Test-1949227607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-e4b16ee6-0a28-44eb-9597-7605f83b327d.info {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:06:29 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-904c4e3b-f04b-446a-bb86-c934e663421d tempest-VolumesImageMetadata-1639441407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8974baa5-170d-40e6-a395-3b62b4257d5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:06:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-2061752108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3c35e06-524e-4f22-8d64-255fe16ad660,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cb4f4b5df8d4a97b8f182d6afbbd057',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:06:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:06:29Z,use_quota=True,user_id='712ff7e43dac4592b223a8a2be5a4339',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:06:29 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-904c4e3b-f04b-446a-bb86-c934e663421d tempest-VolumesImageMetadata-1639441407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a5eb1a7-43ef-4594-9bce-969eb8a60072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:06:29 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-904c4e3b-f04b-446a-bb86-c934e663421d tempest-VolumesImageMetadata-1639441407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a5eb1a7-43ef-4594-9bce-969eb8a60072) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:06:29 devstack sudo[85219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-e4b16ee6-0a28-44eb-9597-7605f83b327d.info Apr 16 15:06:29 devstack sudo[85219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:06:29 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-904c4e3b-f04b-446a-bb86-c934e663421d tempest-VolumesImageMetadata-1639441407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e959aef-7b3a-4e4a-aa2d-9fc4d56acd9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:06:29 devstack cinder-volume[82756]: DEBUG cinder.image.glance [None req-904c4e3b-f04b-446a-bb86-c934e663421d tempest-VolumesImageMetadata-1639441407 None] Creating Keystone auth plugin from conf {{(pid=82756) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 16 15:06:29 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-904c4e3b-f04b-446a-bb86-c934e663421d tempest-VolumesImageMetadata-1639441407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e959aef-7b3a-4e4a-aa2d-9fc4d56acd9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c3c35e06-524e-4f22-8d64-255fe16ad660', 'volume_name': 'volume-c3c35e06-524e-4f22-8d64-255fe16ad660', 'volume_size': 1, 'image_id': 'b5f01913-4ea7-4cdb-8c76-10fda64d06e5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b5f01913-4ea7-4cdb-8c76-10fda64d06e5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '42394d2631114f428489519b24c78a03', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b5f01913-4ea7-4cdb-8c76-10fda64d06e5', 'created_at': datetime.datetime(2026, 4, 16, 13, 0, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 16, 13, 0, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b5f01913-4ea7-4cdb-8c76-10fda64d06e5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:06:29 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-904c4e3b-f04b-446a-bb86-c934e663421d tempest-VolumesImageMetadata-1639441407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4053654b-c358-43ea-b431-79c72ba46312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:06:29 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-904c4e3b-f04b-446a-bb86-c934e663421d tempest-VolumesImageMetadata-1639441407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4053654b-c358-43ea-b431-79c72ba46312) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:06:29 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-904c4e3b-f04b-446a-bb86-c934e663421d tempest-VolumesImageMetadata-1639441407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b558dc35-ea85-4d57-85fc-d1a4e966cd9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:06:29 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-904c4e3b-f04b-446a-bb86-c934e663421d tempest-VolumesImageMetadata-1639441407 None] Volume c3c35e06-524e-4f22-8d64-255fe16ad660: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c3c35e06-524e-4f22-8d64-255fe16ad660', 'volume_size': 1, 'image_id': 'b5f01913-4ea7-4cdb-8c76-10fda64d06e5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b5f01913-4ea7-4cdb-8c76-10fda64d06e5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '42394d2631114f428489519b24c78a03', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b5f01913-4ea7-4cdb-8c76-10fda64d06e5', 'created_at': datetime.datetime(2026, 4, 16, 13, 0, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 16, 13, 0, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b5f01913-4ea7-4cdb-8c76-10fda64d06e5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 16 15:06:29 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [None req-904c4e3b-f04b-446a-bb86-c934e663421d tempest-VolumesImageMetadata-1639441407 None] Trying to clone c3c35e06-524e-4f22-8d64-255fe16ad660 from image b5f01913-4ea7-4cdb-8c76-10fda64d06e5 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b5f01913-4ea7-4cdb-8c76-10fda64d06e5', 'metadata': {}}]). {{(pid=82756) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 16 15:06:29 devstack cinder-volume[82756]: DEBUG cinder.image.image_utils [None req-904c4e3b-f04b-446a-bb86-c934e663421d tempest-VolumesImageMetadata-1639441407 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b5f01913-4ea7-4cdb-8c76-10fda64d06e5_qdnr10b0devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82756) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 16 15:06:29 devstack cinder-volume[82756]: INFO cinder.image.image_utils [None req-904c4e3b-f04b-446a-bb86-c934e663421d tempest-VolumesImageMetadata-1639441407 None] Image download 20.69 MB at 20.69 MB/s Apr 16 15:06:30 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b7c8a26-d12f-493d-af6f-a99b0e8306b6]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:06:30 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-904c4e3b-f04b-446a-bb86-c934e663421d tempest-VolumesImageMetadata-1639441407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5f01913-4ea7-4cdb-8c76-10fda64d06e5_qdnr10b0devstack@QuobyteHD {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:06:30 devstack sudo[85219]: pam_unix(sudo:session): session closed for user root Apr 16 15:06:30 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-a792f518-feb6-4323-ac4b-bb4a0c672803 tempest-GroupsV314Test-1949227607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-e4b16ee6-0a28-44eb-9597-7605f83b327d.info" returned: 0 in 0.924s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:06:30 devstack cinder-volume[82756]: WARNING cinder.volume.drivers.remotefs [None req-a792f518-feb6-4323-ac4b-bb4a0c672803 tempest-GroupsV314Test-1949227607 None] /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-e4b16ee6-0a28-44eb-9597-7605f83b327d.info is being set with open permissions: ugo+rw: NotImplementedError Apr 16 15:06:30 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-a792f518-feb6-4323-ac4b-bb4a0c672803 tempest-GroupsV314Test-1949227607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-e4b16ee6-0a28-44eb-9597-7605f83b327d.info {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:06:30 devstack sudo[85246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5f01913-4ea7-4cdb-8c76-10fda64d06e5_qdnr10b0devstack@QuobyteHD Apr 16 15:06:30 devstack sudo[85246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:06:30 devstack sudo[85248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-e4b16ee6-0a28-44eb-9597-7605f83b327d.info Apr 16 15:06:30 devstack sudo[85248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:06:30 devstack sudo[85248]: pam_unix(sudo:session): session closed for user root Apr 16 15:06:30 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-a792f518-feb6-4323-ac4b-bb4a0c672803 tempest-GroupsV314Test-1949227607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-e4b16ee6-0a28-44eb-9597-7605f83b327d.info" returned: 0 in 0.628s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:06:30 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-a792f518-feb6-4323-ac4b-bb4a0c672803 tempest-GroupsV314Test-1949227607 None] Acquiring lock "cinder-quobyte-474495d0-c2a2-4b76-9342-64b271e07ff0" by "_copy_volume_from_snapshot" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:06:30 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-a792f518-feb6-4323-ac4b-bb4a0c672803 tempest-GroupsV314Test-1949227607 None] Lock "cinder-quobyte-474495d0-c2a2-4b76-9342-64b271e07ff0" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:06:30 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-a792f518-feb6-4323-ac4b-bb4a0c672803 tempest-GroupsV314Test-1949227607 None] snapshot: 49553429-dd9b-4870-9d18-f4e08f18f9b1, volume: 474495d0-c2a2-4b76-9342-64b271e07ff0, {{(pid=82756) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 16 15:06:30 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-a792f518-feb6-4323-ac4b-bb4a0c672803 tempest-GroupsV314Test-1949227607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:06:30 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-a792f518-feb6-4323-ac4b-bb4a0c672803 tempest-GroupsV314Test-1949227607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:06:30 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-a792f518-feb6-4323-ac4b-bb4a0c672803 tempest-GroupsV314Test-1949227607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:06:30 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-a792f518-feb6-4323-ac4b-bb4a0c672803 tempest-GroupsV314Test-1949227607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:06:30 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-a792f518-feb6-4323-ac4b-bb4a0c672803 tempest-GroupsV314Test-1949227607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:06:30 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab4cf396-c2b1-49fc-be1c-0afcef04b517]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:06:30 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-a792f518-feb6-4323-ac4b-bb4a0c672803 tempest-GroupsV314Test-1949227607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-e4b16ee6-0a28-44eb-9597-7605f83b327d.49553429-dd9b-4870-9d18-f4e08f18f9b1 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:06:30 devstack sudo[85246]: pam_unix(sudo:session): session closed for user root Apr 16 15:06:30 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-904c4e3b-f04b-446a-bb86-c934e663421d tempest-VolumesImageMetadata-1639441407 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5f01913-4ea7-4cdb-8c76-10fda64d06e5_qdnr10b0devstack@QuobyteHD" returned: 0 in 0.818s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:06:30 devstack cinder-volume[82756]: DEBUG cinder.image.image_utils [None req-904c4e3b-f04b-446a-bb86-c934e663421d tempest-VolumesImageMetadata-1639441407 None] Temporary image b5f01913-4ea7-4cdb-8c76-10fda64d06e5 is fetched for user 712ff7e43dac4592b223a8a2be5a4339. {{(pid=82756) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 16 15:06:30 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[01cafb21-0f22-4727-a0ff-c9eb2f283f18]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:06:30 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-904c4e3b-f04b-446a-bb86-c934e663421d tempest-VolumesImageMetadata-1639441407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5f01913-4ea7-4cdb-8c76-10fda64d06e5_qdnr10b0devstack@QuobyteHD {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:06:30 devstack sudo[85257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-e4b16ee6-0a28-44eb-9597-7605f83b327d.49553429-dd9b-4870-9d18-f4e08f18f9b1 Apr 16 15:06:30 devstack sudo[85257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:06:30 devstack sudo[85258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5f01913-4ea7-4cdb-8c76-10fda64d06e5_qdnr10b0devstack@QuobyteHD Apr 16 15:06:30 devstack sudo[85258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:06:31 devstack sudo[85257]: pam_unix(sudo:session): session closed for user root Apr 16 15:06:31 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-a792f518-feb6-4323-ac4b-bb4a0c672803 tempest-GroupsV314Test-1949227607 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-e4b16ee6-0a28-44eb-9597-7605f83b327d.49553429-dd9b-4870-9d18-f4e08f18f9b1" returned: 0 in 0.655s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:06:31 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-a792f518-feb6-4323-ac4b-bb4a0c672803 tempest-GroupsV314Test-1949227607 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e4b16ee6-0a28-44eb-9597-7605f83b327d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82756) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 15:06:31 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-a792f518-feb6-4323-ac4b-bb4a0c672803 tempest-GroupsV314Test-1949227607 None] will copy from snapshot at /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-e4b16ee6-0a28-44eb-9597-7605f83b327d {{(pid=82756) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 16 15:06:31 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-a792f518-feb6-4323-ac4b-bb4a0c672803 tempest-GroupsV314Test-1949227607 None] Creating direct copy from snapshot {{(pid=82756) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 16 15:06:31 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb839d0d-2463-4e26-b22d-744526792d26]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:06:31 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-a792f518-feb6-4323-ac4b-bb4a0c672803 tempest-GroupsV314Test-1949227607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-e4b16ee6-0a28-44eb-9597-7605f83b327d {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:06:31 devstack sudo[85264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-e4b16ee6-0a28-44eb-9597-7605f83b327d Apr 16 15:06:31 devstack sudo[85264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:06:31 devstack sudo[85258]: pam_unix(sudo:session): session closed for user root Apr 16 15:06:31 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-904c4e3b-f04b-446a-bb86-c934e663421d tempest-VolumesImageMetadata-1639441407 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5f01913-4ea7-4cdb-8c76-10fda64d06e5_qdnr10b0devstack@QuobyteHD" returned: 0 in 0.763s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:06:31 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-904c4e3b-f04b-446a-bb86-c934e663421d tempest-VolumesImageMetadata-1639441407 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:06:32 devstack sudo[85264]: pam_unix(sudo:session): session closed for user root Apr 16 15:06:32 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-a792f518-feb6-4323-ac4b-bb4a0c672803 tempest-GroupsV314Test-1949227607 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-e4b16ee6-0a28-44eb-9597-7605f83b327d" returned: 0 in 0.538s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:06:32 devstack cinder-volume[82756]: DEBUG cinder.utils [None req-a792f518-feb6-4323-ac4b-bb4a0c672803 tempest-GroupsV314Test-1949227607 None] Path /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-474495d0-c2a2-4b76-9342-64b271e07ff0 not found in is_blk_device check {{(pid=82756) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 16 15:06:32 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-a792f518-feb6-4323-ac4b-bb4a0c672803 tempest-GroupsV314Test-1949227607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-e4b16ee6-0a28-44eb-9597-7605f83b327d /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-474495d0-c2a2-4b76-9342-64b271e07ff0 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:06:32 devstack sudo[85273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-e4b16ee6-0a28-44eb-9597-7605f83b327d /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-474495d0-c2a2-4b76-9342-64b271e07ff0 Apr 16 15:06:32 devstack sudo[85273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:06:35 devstack sudo[85273]: pam_unix(sudo:session): session closed for user root Apr 16 15:06:35 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-a792f518-feb6-4323-ac4b-bb4a0c672803 tempest-GroupsV314Test-1949227607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-e4b16ee6-0a28-44eb-9597-7605f83b327d /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-474495d0-c2a2-4b76-9342-64b271e07ff0" returned: 0 in 3.258s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:06:35 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[62b7804f-fe1a-48f4-bb91-29d62b435860]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:06:35 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-a792f518-feb6-4323-ac4b-bb4a0c672803 tempest-GroupsV314Test-1949227607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-e4b16ee6-0a28-44eb-9597-7605f83b327d {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:06:35 devstack sudo[85300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-e4b16ee6-0a28-44eb-9597-7605f83b327d Apr 16 15:06:35 devstack sudo[85300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:06:36 devstack sudo[85300]: pam_unix(sudo:session): session closed for user root Apr 16 15:06:36 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-a792f518-feb6-4323-ac4b-bb4a0c672803 tempest-GroupsV314Test-1949227607 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-e4b16ee6-0a28-44eb-9597-7605f83b327d" returned: 0 in 0.817s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:06:36 devstack cinder-volume[82756]: DEBUG cinder.image.image_utils [None req-a792f518-feb6-4323-ac4b-bb4a0c672803 tempest-GroupsV314Test-1949227607 None] Image conversion details: src /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-e4b16ee6-0a28-44eb-9597-7605f83b327d, size 1024.00 MB, duration 3.26 sec, destination /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-474495d0-c2a2-4b76-9342-64b271e07ff0 {{(pid=82756) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 15:06:36 devstack cinder-volume[82756]: INFO cinder.image.image_utils [None req-a792f518-feb6-4323-ac4b-bb4a0c672803 tempest-GroupsV314Test-1949227607 None] Converted 1024.00 MB image at 314.15 MB/s Apr 16 15:06:36 devstack cinder-volume[82756]: WARNING cinder.volume.drivers.remotefs [None req-a792f518-feb6-4323-ac4b-bb4a0c672803 tempest-GroupsV314Test-1949227607 None] /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-474495d0-c2a2-4b76-9342-64b271e07ff0 is being set with open permissions: ugo+rw: NotImplementedError Apr 16 15:06:36 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-a792f518-feb6-4323-ac4b-bb4a0c672803 tempest-GroupsV314Test-1949227607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-474495d0-c2a2-4b76-9342-64b271e07ff0 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:06:36 devstack sudo[85305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-474495d0-c2a2-4b76-9342-64b271e07ff0 Apr 16 15:06:36 devstack sudo[85305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:06:36 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [req-248793ba-b58c-4302-891c-7aa49bae2822 req-1fa1fd88-efd4-4e07-a00f-48eb4b7675e6 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82756) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 15:06:36 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [req-248793ba-b58c-4302-891c-7aa49bae2822 req-1fa1fd88-efd4-4e07-a00f-48eb4b7675e6 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Flow 'volume_create_manager' (5ebd84b8-0a6b-4a88-b7f3-1d4eebd0c0a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:06:36 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [req-248793ba-b58c-4302-891c-7aa49bae2822 req-1fa1fd88-efd4-4e07-a00f-48eb4b7675e6 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a295a71e-d07d-439f-95ea-e2fda1218ad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:06:36 devstack sudo[85305]: pam_unix(sudo:session): session closed for user root Apr 16 15:06:36 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-a792f518-feb6-4323-ac4b-bb4a0c672803 tempest-GroupsV314Test-1949227607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-474495d0-c2a2-4b76-9342-64b271e07ff0" returned: 0 in 0.652s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:06:36 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-a792f518-feb6-4323-ac4b-bb4a0c672803 tempest-GroupsV314Test-1949227607 None] Lock "cinder-quobyte-474495d0-c2a2-4b76-9342-64b271e07ff0" released by "_copy_volume_from_snapshot" :: held 6.015s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:06:36 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [req-248793ba-b58c-4302-891c-7aa49bae2822 req-1fa1fd88-efd4-4e07-a00f-48eb4b7675e6 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a295a71e-d07d-439f-95ea-e2fda1218ad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:06:36Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=203917d0-9fc3-4949-81b0-fe0872b639f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42bb5dcbcc07406fa017af1e43b594d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:06:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:06:37Z,use_quota=True,user_id='faeeca99fa814c848e8eba16aa72cb29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:06:36 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [req-248793ba-b58c-4302-891c-7aa49bae2822 req-1fa1fd88-efd4-4e07-a00f-48eb4b7675e6 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10900221-5bc2-4066-b423-23ed1ba22fd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:06:36 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [req-248793ba-b58c-4302-891c-7aa49bae2822 req-1fa1fd88-efd4-4e07-a00f-48eb4b7675e6 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10900221-5bc2-4066-b423-23ed1ba22fd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:06:36 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [req-248793ba-b58c-4302-891c-7aa49bae2822 req-1fa1fd88-efd4-4e07-a00f-48eb4b7675e6 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (715b39d8-22f7-4250-ae8b-8f030c5655db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:06:36 devstack cinder-volume[82756]: DEBUG cinder.image.glance [req-248793ba-b58c-4302-891c-7aa49bae2822 req-1fa1fd88-efd4-4e07-a00f-48eb4b7675e6 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Creating Keystone auth plugin from conf {{(pid=82756) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 16 15:06:36 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-a792f518-feb6-4323-ac4b-bb4a0c672803 tempest-GroupsV314Test-1949227607 None] Acquiring lock "cinder-quobyte-49553429-dd9b-4870-9d18-f4e08f18f9b1" by "_delete_snapshot" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:06:36 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-a792f518-feb6-4323-ac4b-bb4a0c672803 tempest-GroupsV314Test-1949227607 None] Lock "cinder-quobyte-49553429-dd9b-4870-9d18-f4e08f18f9b1" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:06:36 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-a792f518-feb6-4323-ac4b-bb4a0c672803 tempest-GroupsV314Test-1949227607 None] Deleting offline snapshot 49553429-dd9b-4870-9d18-f4e08f18f9b1 of volume e4b16ee6-0a28-44eb-9597-7605f83b327d {{(pid=82756) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 15:06:36 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-a792f518-feb6-4323-ac4b-bb4a0c672803 tempest-GroupsV314Test-1949227607 None] snapshot_file for this snap is: volume-e4b16ee6-0a28-44eb-9597-7605f83b327d.49553429-dd9b-4870-9d18-f4e08f18f9b1 {{(pid=82756) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 15:06:36 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d59e25f-59da-4e1a-bd56-b451f77216a6]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:06:36 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-a792f518-feb6-4323-ac4b-bb4a0c672803 tempest-GroupsV314Test-1949227607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-e4b16ee6-0a28-44eb-9597-7605f83b327d.49553429-dd9b-4870-9d18-f4e08f18f9b1 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:06:37 devstack sudo[85310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-e4b16ee6-0a28-44eb-9597-7605f83b327d.49553429-dd9b-4870-9d18-f4e08f18f9b1 Apr 16 15:06:37 devstack sudo[85310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:06:37 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [req-248793ba-b58c-4302-891c-7aa49bae2822 req-1fa1fd88-efd4-4e07-a00f-48eb4b7675e6 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (715b39d8-22f7-4250-ae8b-8f030c5655db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '203917d0-9fc3-4949-81b0-fe0872b639f0', 'volume_name': 'volume-203917d0-9fc3-4949-81b0-fe0872b639f0', 'volume_size': 1, 'image_id': 'b5f01913-4ea7-4cdb-8c76-10fda64d06e5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b5f01913-4ea7-4cdb-8c76-10fda64d06e5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '42394d2631114f428489519b24c78a03', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b5f01913-4ea7-4cdb-8c76-10fda64d06e5', 'created_at': datetime.datetime(2026, 4, 16, 13, 0, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 16, 13, 0, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b5f01913-4ea7-4cdb-8c76-10fda64d06e5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:06:37 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [req-248793ba-b58c-4302-891c-7aa49bae2822 req-1fa1fd88-efd4-4e07-a00f-48eb4b7675e6 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (434b1e2f-9f69-4e2e-a52a-4a71502134f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:06:37 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [req-248793ba-b58c-4302-891c-7aa49bae2822 req-1fa1fd88-efd4-4e07-a00f-48eb4b7675e6 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (434b1e2f-9f69-4e2e-a52a-4a71502134f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:06:37 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [req-248793ba-b58c-4302-891c-7aa49bae2822 req-1fa1fd88-efd4-4e07-a00f-48eb4b7675e6 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (baacc947-c071-44d8-ba13-0d8c09794874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:06:37 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [req-248793ba-b58c-4302-891c-7aa49bae2822 req-1fa1fd88-efd4-4e07-a00f-48eb4b7675e6 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Volume 203917d0-9fc3-4949-81b0-fe0872b639f0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-203917d0-9fc3-4949-81b0-fe0872b639f0', 'volume_size': 1, 'image_id': 'b5f01913-4ea7-4cdb-8c76-10fda64d06e5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b5f01913-4ea7-4cdb-8c76-10fda64d06e5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '42394d2631114f428489519b24c78a03', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b5f01913-4ea7-4cdb-8c76-10fda64d06e5', 'created_at': datetime.datetime(2026, 4, 16, 13, 0, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 16, 13, 0, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b5f01913-4ea7-4cdb-8c76-10fda64d06e5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 16 15:06:37 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [req-248793ba-b58c-4302-891c-7aa49bae2822 req-1fa1fd88-efd4-4e07-a00f-48eb4b7675e6 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Trying to clone 203917d0-9fc3-4949-81b0-fe0872b639f0 from image b5f01913-4ea7-4cdb-8c76-10fda64d06e5 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b5f01913-4ea7-4cdb-8c76-10fda64d06e5', 'metadata': {}}]). {{(pid=82756) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 16 15:06:37 devstack cinder-volume[82756]: DEBUG cinder.image.image_utils [req-248793ba-b58c-4302-891c-7aa49bae2822 req-1fa1fd88-efd4-4e07-a00f-48eb4b7675e6 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b5f01913-4ea7-4cdb-8c76-10fda64d06e5_x97cd1wadevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82756) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 16 15:06:37 devstack cinder-volume[82756]: INFO cinder.image.image_utils [req-248793ba-b58c-4302-891c-7aa49bae2822 req-1fa1fd88-efd4-4e07-a00f-48eb4b7675e6 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Image download 20.69 MB at 20.69 MB/s Apr 16 15:06:37 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7659be6-8ac8-43ce-be62-a4ec29523e09]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:06:37 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [req-248793ba-b58c-4302-891c-7aa49bae2822 req-1fa1fd88-efd4-4e07-a00f-48eb4b7675e6 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5f01913-4ea7-4cdb-8c76-10fda64d06e5_x97cd1wadevstack@QuobyteHD {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:06:37 devstack sudo[85314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5f01913-4ea7-4cdb-8c76-10fda64d06e5_x97cd1wadevstack@QuobyteHD Apr 16 15:06:37 devstack sudo[85314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:06:37 devstack sudo[85310]: pam_unix(sudo:session): session closed for user root Apr 16 15:06:37 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-a792f518-feb6-4323-ac4b-bb4a0c672803 tempest-GroupsV314Test-1949227607 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-e4b16ee6-0a28-44eb-9597-7605f83b327d.49553429-dd9b-4870-9d18-f4e08f18f9b1" returned: 0 in 0.763s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:06:37 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-a792f518-feb6-4323-ac4b-bb4a0c672803 tempest-GroupsV314Test-1949227607 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e4b16ee6-0a28-44eb-9597-7605f83b327d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82756) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 15:06:37 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [None req-76bc98ff-d416-4b8c-a094-62b706bdef70 tempest-VolumeQuotasAdminTestJSON-1728164091 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82756) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 15:06:37 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-76bc98ff-d416-4b8c-a094-62b706bdef70 tempest-VolumeQuotasAdminTestJSON-1728164091 None] Flow 'volume_create_manager' (9f7f2994-968c-415b-bc1c-f0ad6e2fadb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:06:37 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-76bc98ff-d416-4b8c-a094-62b706bdef70 tempest-VolumeQuotasAdminTestJSON-1728164091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b096031-11ff-4bda-b9cc-5b07d541d235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:06:37 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[f687801a-5962-4976-ae5b-51c8b1d2f794]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:06:37 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-a792f518-feb6-4323-ac4b-bb4a0c672803 tempest-GroupsV314Test-1949227607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-e4b16ee6-0a28-44eb-9597-7605f83b327d {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:06:37 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-76bc98ff-d416-4b8c-a094-62b706bdef70 tempest-VolumeQuotasAdminTestJSON-1728164091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b096031-11ff-4bda-b9cc-5b07d541d235) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:06:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-110155126',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=383b2d71-04d4-4c8f-8e6d-3764812435ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d86d100506964f1395060c57d24b5817',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:06:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:06:38Z,use_quota=True,user_id='5109835013844a70a8dffbadfcbb0846',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:06:37 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-76bc98ff-d416-4b8c-a094-62b706bdef70 tempest-VolumeQuotasAdminTestJSON-1728164091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (439e3ada-b6fc-4ba8-bf8e-626c565ec55d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:06:37 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-76bc98ff-d416-4b8c-a094-62b706bdef70 tempest-VolumeQuotasAdminTestJSON-1728164091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (439e3ada-b6fc-4ba8-bf8e-626c565ec55d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:06:37 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-76bc98ff-d416-4b8c-a094-62b706bdef70 tempest-VolumeQuotasAdminTestJSON-1728164091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50d67f72-871c-462d-911f-cca866f501e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:06:37 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-76bc98ff-d416-4b8c-a094-62b706bdef70 tempest-VolumeQuotasAdminTestJSON-1728164091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50d67f72-871c-462d-911f-cca866f501e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '383b2d71-04d4-4c8f-8e6d-3764812435ca', 'volume_name': 'volume-383b2d71-04d4-4c8f-8e6d-3764812435ca', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:06:37 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-76bc98ff-d416-4b8c-a094-62b706bdef70 tempest-VolumeQuotasAdminTestJSON-1728164091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cd4a9b9-8a6c-4cb6-8be7-ad843f9c1fd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:06:37 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-76bc98ff-d416-4b8c-a094-62b706bdef70 tempest-VolumeQuotasAdminTestJSON-1728164091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cd4a9b9-8a6c-4cb6-8be7-ad843f9c1fd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:06:37 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-76bc98ff-d416-4b8c-a094-62b706bdef70 tempest-VolumeQuotasAdminTestJSON-1728164091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (447a532b-d6ec-49b4-ba8a-abda9dfe3c18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:06:37 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-76bc98ff-d416-4b8c-a094-62b706bdef70 tempest-VolumeQuotasAdminTestJSON-1728164091 None] Volume 383b2d71-04d4-4c8f-8e6d-3764812435ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-383b2d71-04d4-4c8f-8e6d-3764812435ca', 'volume_size': 1} Apr 16 15:06:37 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-76bc98ff-d416-4b8c-a094-62b706bdef70 tempest-VolumeQuotasAdminTestJSON-1728164091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:06:37 devstack sudo[85319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-e4b16ee6-0a28-44eb-9597-7605f83b327d Apr 16 15:06:37 devstack sudo[85319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:06:38 devstack sudo[85314]: pam_unix(sudo:session): session closed for user root Apr 16 15:06:38 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [req-248793ba-b58c-4302-891c-7aa49bae2822 req-1fa1fd88-efd4-4e07-a00f-48eb4b7675e6 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5f01913-4ea7-4cdb-8c76-10fda64d06e5_x97cd1wadevstack@QuobyteHD" returned: 0 in 0.674s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:06:38 devstack cinder-volume[82756]: DEBUG cinder.image.image_utils [req-248793ba-b58c-4302-891c-7aa49bae2822 req-1fa1fd88-efd4-4e07-a00f-48eb4b7675e6 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Temporary image b5f01913-4ea7-4cdb-8c76-10fda64d06e5 is fetched for user faeeca99fa814c848e8eba16aa72cb29. {{(pid=82756) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 16 15:06:38 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaceace8-1579-40c4-a9d7-35112abd12ec]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:06:38 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [req-248793ba-b58c-4302-891c-7aa49bae2822 req-1fa1fd88-efd4-4e07-a00f-48eb4b7675e6 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5f01913-4ea7-4cdb-8c76-10fda64d06e5_x97cd1wadevstack@QuobyteHD {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:06:38 devstack sudo[85341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5f01913-4ea7-4cdb-8c76-10fda64d06e5_x97cd1wadevstack@QuobyteHD Apr 16 15:06:38 devstack sudo[85341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:06:38 devstack sudo[85319]: pam_unix(sudo:session): session closed for user root Apr 16 15:06:38 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-a792f518-feb6-4323-ac4b-bb4a0c672803 tempest-GroupsV314Test-1949227607 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-e4b16ee6-0a28-44eb-9597-7605f83b327d" returned: 0 in 0.611s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:06:38 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-a792f518-feb6-4323-ac4b-bb4a0c672803 tempest-GroupsV314Test-1949227607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-e4b16ee6-0a28-44eb-9597-7605f83b327d.49553429-dd9b-4870-9d18-f4e08f18f9b1 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:06:38 devstack sudo[85346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-e4b16ee6-0a28-44eb-9597-7605f83b327d.49553429-dd9b-4870-9d18-f4e08f18f9b1 Apr 16 15:06:38 devstack sudo[85346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:06:38 devstack sudo[85341]: pam_unix(sudo:session): session closed for user root Apr 16 15:06:38 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [req-248793ba-b58c-4302-891c-7aa49bae2822 req-1fa1fd88-efd4-4e07-a00f-48eb4b7675e6 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5f01913-4ea7-4cdb-8c76-10fda64d06e5_x97cd1wadevstack@QuobyteHD" returned: 0 in 0.528s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:06:38 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [req-248793ba-b58c-4302-891c-7aa49bae2822 req-1fa1fd88-efd4-4e07-a00f-48eb4b7675e6 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:06:38 devstack sudo[85346]: pam_unix(sudo:session): session closed for user root Apr 16 15:06:38 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-a792f518-feb6-4323-ac4b-bb4a0c672803 tempest-GroupsV314Test-1949227607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-e4b16ee6-0a28-44eb-9597-7605f83b327d.49553429-dd9b-4870-9d18-f4e08f18f9b1" returned: 0 in 0.456s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:06:38 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-a792f518-feb6-4323-ac4b-bb4a0c672803 tempest-GroupsV314Test-1949227607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-e4b16ee6-0a28-44eb-9597-7605f83b327d.49553429-dd9b-4870-9d18-f4e08f18f9b1 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:06:38 devstack sudo[85354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-e4b16ee6-0a28-44eb-9597-7605f83b327d.49553429-dd9b-4870-9d18-f4e08f18f9b1 Apr 16 15:06:38 devstack sudo[85354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:06:39 devstack sudo[85354]: pam_unix(sudo:session): session closed for user root Apr 16 15:06:39 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-a792f518-feb6-4323-ac4b-bb4a0c672803 tempest-GroupsV314Test-1949227607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-e4b16ee6-0a28-44eb-9597-7605f83b327d.49553429-dd9b-4870-9d18-f4e08f18f9b1" returned: 0 in 0.531s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:06:39 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-a792f518-feb6-4323-ac4b-bb4a0c672803 tempest-GroupsV314Test-1949227607 None] Lock "cinder-quobyte-49553429-dd9b-4870-9d18-f4e08f18f9b1" released by "_delete_snapshot" :: held 2.465s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:06:39 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-a792f518-feb6-4323-ac4b-bb4a0c672803 tempest-GroupsV314Test-1949227607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.493s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:06:39 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-904c4e3b-f04b-446a-bb86-c934e663421d tempest-VolumesImageMetadata-1639441407 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.721s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:06:39 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-904c4e3b-f04b-446a-bb86-c934e663421d tempest-VolumesImageMetadata-1639441407 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:06:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-2061752108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3c35e06-524e-4f22-8d64-255fe16ad660,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cb4f4b5df8d4a97b8f182d6afbbd057',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:06:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:06:29Z,use_quota=True,user_id='712ff7e43dac4592b223a8a2be5a4339',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)}" {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 15:06:39 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-904c4e3b-f04b-446a-bb86-c934e663421d tempest-VolumesImageMetadata-1639441407 None] Creating volume c3c35e06-524e-4f22-8d64-255fe16ad660 {{(pid=82756) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 15:06:39 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-904c4e3b-f04b-446a-bb86-c934e663421d tempest-VolumesImageMetadata-1639441407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:06:39 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-904c4e3b-f04b-446a-bb86-c934e663421d tempest-VolumesImageMetadata-1639441407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:06:39 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-904c4e3b-f04b-446a-bb86-c934e663421d tempest-VolumesImageMetadata-1639441407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:06:39 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-904c4e3b-f04b-446a-bb86-c934e663421d tempest-VolumesImageMetadata-1639441407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:06:39 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-904c4e3b-f04b-446a-bb86-c934e663421d tempest-VolumesImageMetadata-1639441407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:06:39 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-904c4e3b-f04b-446a-bb86-c934e663421d tempest-VolumesImageMetadata-1639441407 None] Selected osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 as target Quobyte volume. {{(pid=82756) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 15:06:39 devstack cinder-volume[82756]: INFO cinder.volume.drivers.remotefs [None req-904c4e3b-f04b-446a-bb86-c934e663421d tempest-VolumesImageMetadata-1639441407 None] casted to osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 Apr 16 15:06:39 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-904c4e3b-f04b-446a-bb86-c934e663421d tempest-VolumesImageMetadata-1639441407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c3c35e06-524e-4f22-8d64-255fe16ad660 1073741824 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:06:39 devstack sudo[85357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c3c35e06-524e-4f22-8d64-255fe16ad660 1073741824 Apr 16 15:06:39 devstack sudo[85357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:06:39 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-a792f518-feb6-4323-ac4b-bb4a0c672803 tempest-GroupsV314Test-1949227607 None] Create group from source-group-3c477b82-c947-44b2-9505-bd27d6290b9d completed successfully. Apr 16 15:06:39 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-6cd37c87-77a7-4eb6-bcf0-f87d784e8f1a tempest-GroupsV314Test-1949227607 None] Acquiring lock "cinder-quobyte-474495d0-c2a2-4b76-9342-64b271e07ff0" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:06:40 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-6cd37c87-77a7-4eb6-bcf0-f87d784e8f1a tempest-GroupsV314Test-1949227607 None] Lock "cinder-quobyte-474495d0-c2a2-4b76-9342-64b271e07ff0" acquired by "delete_volume" :: waited 0.010s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:06:40 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[200a7fa1-9fa6-4976-a259-5416e3dfd374]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:06:40 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-6cd37c87-77a7-4eb6-bcf0-f87d784e8f1a tempest-GroupsV314Test-1949227607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-474495d0-c2a2-4b76-9342-64b271e07ff0 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:06:40 devstack sudo[85357]: pam_unix(sudo:session): session closed for user root Apr 16 15:06:40 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-904c4e3b-f04b-446a-bb86-c934e663421d tempest-VolumesImageMetadata-1639441407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c3c35e06-524e-4f22-8d64-255fe16ad660 1073741824" returned: 0 in 0.648s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:06:40 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-904c4e3b-f04b-446a-bb86-c934e663421d tempest-VolumesImageMetadata-1639441407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c3c35e06-524e-4f22-8d64-255fe16ad660 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:06:40 devstack sudo[85370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c3c35e06-524e-4f22-8d64-255fe16ad660 Apr 16 15:06:40 devstack sudo[85370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:06:40 devstack sudo[85369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-474495d0-c2a2-4b76-9342-64b271e07ff0 Apr 16 15:06:40 devstack sudo[85369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:06:40 devstack sudo[85370]: pam_unix(sudo:session): session closed for user root Apr 16 15:06:40 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-904c4e3b-f04b-446a-bb86-c934e663421d tempest-VolumesImageMetadata-1639441407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c3c35e06-524e-4f22-8d64-255fe16ad660" returned: 0 in 0.472s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:06:40 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-904c4e3b-f04b-446a-bb86-c934e663421d tempest-VolumesImageMetadata-1639441407 None] <== create_volume: return (1162ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'} {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 15:06:40 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-904c4e3b-f04b-446a-bb86-c934e663421d tempest-VolumesImageMetadata-1639441407 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.166s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:06:40 devstack sudo[85369]: pam_unix(sudo:session): session closed for user root Apr 16 15:06:40 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-76bc98ff-d416-4b8c-a094-62b706bdef70 tempest-VolumeQuotasAdminTestJSON-1728164091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.743s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:06:40 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-76bc98ff-d416-4b8c-a094-62b706bdef70 tempest-VolumeQuotasAdminTestJSON-1728164091 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:06:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-110155126',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=383b2d71-04d4-4c8f-8e6d-3764812435ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d86d100506964f1395060c57d24b5817',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:06:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:06:38Z,use_quota=True,user_id='5109835013844a70a8dffbadfcbb0846',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)}" {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 15:06:40 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-76bc98ff-d416-4b8c-a094-62b706bdef70 tempest-VolumeQuotasAdminTestJSON-1728164091 None] Creating volume 383b2d71-04d4-4c8f-8e6d-3764812435ca {{(pid=82756) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 15:06:40 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-76bc98ff-d416-4b8c-a094-62b706bdef70 tempest-VolumeQuotasAdminTestJSON-1728164091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:06:40 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-76bc98ff-d416-4b8c-a094-62b706bdef70 tempest-VolumeQuotasAdminTestJSON-1728164091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:06:40 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-76bc98ff-d416-4b8c-a094-62b706bdef70 tempest-VolumeQuotasAdminTestJSON-1728164091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:06:40 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-76bc98ff-d416-4b8c-a094-62b706bdef70 tempest-VolumeQuotasAdminTestJSON-1728164091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:06:40 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-76bc98ff-d416-4b8c-a094-62b706bdef70 tempest-VolumeQuotasAdminTestJSON-1728164091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:06:40 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-76bc98ff-d416-4b8c-a094-62b706bdef70 tempest-VolumeQuotasAdminTestJSON-1728164091 None] Selected osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 as target Quobyte volume. {{(pid=82756) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 15:06:40 devstack cinder-volume[82756]: INFO cinder.volume.drivers.remotefs [None req-76bc98ff-d416-4b8c-a094-62b706bdef70 tempest-VolumeQuotasAdminTestJSON-1728164091 None] casted to osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 Apr 16 15:06:40 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-76bc98ff-d416-4b8c-a094-62b706bdef70 tempest-VolumeQuotasAdminTestJSON-1728164091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-383b2d71-04d4-4c8f-8e6d-3764812435ca 1073741824 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:06:40 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-6cd37c87-77a7-4eb6-bcf0-f87d784e8f1a tempest-GroupsV314Test-1949227607 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-474495d0-c2a2-4b76-9342-64b271e07ff0" returned: 0 in 0.573s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:06:40 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-6cd37c87-77a7-4eb6-bcf0-f87d784e8f1a tempest-GroupsV314Test-1949227607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-474495d0-c2a2-4b76-9342-64b271e07ff0 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:06:40 devstack sudo[85377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-383b2d71-04d4-4c8f-8e6d-3764812435ca 1073741824 Apr 16 15:06:40 devstack sudo[85377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:06:40 devstack cinder-volume[82756]: DEBUG cinder.volume.volume_utils [None req-904c4e3b-f04b-446a-bb86-c934e663421d tempest-VolumesImageMetadata-1639441407 None] Attempting download of b5f01913-4ea7-4cdb-8c76-10fda64d06e5 ((None, [{'url': 'file:///opt/stack/data/glance/images/b5f01913-4ea7-4cdb-8c76-10fda64d06e5', 'metadata': {}}])) to volume c3c35e06-524e-4f22-8d64-255fe16ad660. {{(pid=82756) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 16 15:06:40 devstack sudo[85379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-474495d0-c2a2-4b76-9342-64b271e07ff0 Apr 16 15:06:40 devstack sudo[85379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:06:40 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfeff0b3-8280-4664-a5fc-c2fc356db8a1]: (4, 'raw') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:06:40 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-904c4e3b-f04b-446a-bb86-c934e663421d tempest-VolumesImageMetadata-1639441407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b5f01913-4ea7-4cdb-8c76-10fda64d06e5_ixadmjlj {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:06:40 devstack sudo[85381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b5f01913-4ea7-4cdb-8c76-10fda64d06e5_ixadmjlj Apr 16 15:06:40 devstack sudo[85381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:06:41 devstack sudo[85377]: pam_unix(sudo:session): session closed for user root Apr 16 15:06:41 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-76bc98ff-d416-4b8c-a094-62b706bdef70 tempest-VolumeQuotasAdminTestJSON-1728164091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-383b2d71-04d4-4c8f-8e6d-3764812435ca 1073741824" returned: 0 in 0.631s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:06:41 devstack sudo[85381]: pam_unix(sudo:session): session closed for user root Apr 16 15:06:41 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-904c4e3b-f04b-446a-bb86-c934e663421d tempest-VolumesImageMetadata-1639441407 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b5f01913-4ea7-4cdb-8c76-10fda64d06e5_ixadmjlj" returned: 0 in 0.560s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:06:41 devstack sudo[85379]: pam_unix(sudo:session): session closed for user root Apr 16 15:06:41 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-904c4e3b-f04b-446a-bb86-c934e663421d tempest-VolumesImageMetadata-1639441407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5f01913-4ea7-4cdb-8c76-10fda64d06e5_ixadmjlj {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:06:41 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-6cd37c87-77a7-4eb6-bcf0-f87d784e8f1a tempest-GroupsV314Test-1949227607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-474495d0-c2a2-4b76-9342-64b271e07ff0" returned: 0 in 0.648s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:06:41 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-76bc98ff-d416-4b8c-a094-62b706bdef70 tempest-VolumeQuotasAdminTestJSON-1728164091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-383b2d71-04d4-4c8f-8e6d-3764812435ca {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:06:41 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-6cd37c87-77a7-4eb6-bcf0-f87d784e8f1a tempest-GroupsV314Test-1949227607 None] Lock "cinder-quobyte-474495d0-c2a2-4b76-9342-64b271e07ff0" released by "delete_volume" :: held 1.269s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:06:41 devstack sudo[85390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-383b2d71-04d4-4c8f-8e6d-3764812435ca Apr 16 15:06:41 devstack sudo[85390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:06:41 devstack sudo[85389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5f01913-4ea7-4cdb-8c76-10fda64d06e5_ixadmjlj Apr 16 15:06:41 devstack sudo[85389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:06:41 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-6cd37c87-77a7-4eb6-bcf0-f87d784e8f1a tempest-GroupsV314Test-1949227607 None] Created reservations ['80b65c0d-0826-42ae-81ac-2fcc085fa1b9'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:06:41 devstack cinder-volume[82756]: WARNING cinder.quota [None req-6cd37c87-77a7-4eb6-bcf0-f87d784e8f1a tempest-GroupsV314Test-1949227607 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1893158159 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1893158159, it is now deprecated. Please use the default quota class for default quota. Apr 16 15:06:41 devstack cinder-volume[82756]: WARNING cinder.quota [None req-6cd37c87-77a7-4eb6-bcf0-f87d784e8f1a tempest-GroupsV314Test-1949227607 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1893158159 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1893158159, it is now deprecated. Please use the default quota class for default quota. Apr 16 15:06:41 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-6cd37c87-77a7-4eb6-bcf0-f87d784e8f1a tempest-GroupsV314Test-1949227607 None] Created reservations ['160a34d3-eaeb-4de6-8deb-0911960e7792', 'ff8e7341-35b5-4d01-882d-de0e2549e420', '0127511f-819e-48ff-9a2d-56f34ffab3ef', 'a2a66349-a341-4161-8e09-bcb8915354e5'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:06:41 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-6cd37c87-77a7-4eb6-bcf0-f87d784e8f1a tempest-GroupsV314Test-1949227607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:06:41 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-6cd37c87-77a7-4eb6-bcf0-f87d784e8f1a tempest-GroupsV314Test-1949227607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:06:41 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-6cd37c87-77a7-4eb6-bcf0-f87d784e8f1a tempest-GroupsV314Test-1949227607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:06:41 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-6cd37c87-77a7-4eb6-bcf0-f87d784e8f1a tempest-GroupsV314Test-1949227607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:06:41 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-6cd37c87-77a7-4eb6-bcf0-f87d784e8f1a tempest-GroupsV314Test-1949227607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:06:41 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-6cd37c87-77a7-4eb6-bcf0-f87d784e8f1a tempest-GroupsV314Test-1949227607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:06:41 devstack sudo[85393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:06:41 devstack sudo[85393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:06:41 devstack sudo[85389]: pam_unix(sudo:session): session closed for user root Apr 16 15:06:41 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-904c4e3b-f04b-446a-bb86-c934e663421d tempest-VolumesImageMetadata-1639441407 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5f01913-4ea7-4cdb-8c76-10fda64d06e5_ixadmjlj" returned: 1 in 0.549s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:06:41 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-904c4e3b-f04b-446a-bb86-c934e663421d tempest-VolumesImageMetadata-1639441407 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5f01913-4ea7-4cdb-8c76-10fda64d06e5_ixadmjlj' failed. Not Retrying. {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 16 15:06:41 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef5801ae-07e4-4912-afd5-f631d82fe11c]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:06:41 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-904c4e3b-f04b-446a-bb86-c934e663421d tempest-VolumesImageMetadata-1639441407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5f01913-4ea7-4cdb-8c76-10fda64d06e5_qdnr10b0devstack@QuobyteHD {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:06:41 devstack sudo[85390]: pam_unix(sudo:session): session closed for user root Apr 16 15:06:41 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-76bc98ff-d416-4b8c-a094-62b706bdef70 tempest-VolumeQuotasAdminTestJSON-1728164091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-383b2d71-04d4-4c8f-8e6d-3764812435ca" returned: 0 in 0.556s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:06:41 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-76bc98ff-d416-4b8c-a094-62b706bdef70 tempest-VolumeQuotasAdminTestJSON-1728164091 None] <== create_volume: return (1240ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'} {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 15:06:41 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-76bc98ff-d416-4b8c-a094-62b706bdef70 tempest-VolumeQuotasAdminTestJSON-1728164091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.245s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:06:41 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [req-248793ba-b58c-4302-891c-7aa49bae2822 req-1fa1fd88-efd4-4e07-a00f-48eb4b7675e6 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.115s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:06:41 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [req-248793ba-b58c-4302-891c-7aa49bae2822 req-1fa1fd88-efd4-4e07-a00f-48eb4b7675e6 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:06:36Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=203917d0-9fc3-4949-81b0-fe0872b639f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42bb5dcbcc07406fa017af1e43b594d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:06:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:06:37Z,use_quota=True,user_id='faeeca99fa814c848e8eba16aa72cb29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)}" {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 15:06:41 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [req-248793ba-b58c-4302-891c-7aa49bae2822 req-1fa1fd88-efd4-4e07-a00f-48eb4b7675e6 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Creating volume 203917d0-9fc3-4949-81b0-fe0872b639f0 {{(pid=82756) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 15:06:41 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [req-248793ba-b58c-4302-891c-7aa49bae2822 req-1fa1fd88-efd4-4e07-a00f-48eb4b7675e6 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:06:41 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [req-248793ba-b58c-4302-891c-7aa49bae2822 req-1fa1fd88-efd4-4e07-a00f-48eb4b7675e6 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:06:41 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [req-248793ba-b58c-4302-891c-7aa49bae2822 req-1fa1fd88-efd4-4e07-a00f-48eb4b7675e6 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:06:41 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [req-248793ba-b58c-4302-891c-7aa49bae2822 req-1fa1fd88-efd4-4e07-a00f-48eb4b7675e6 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:06:41 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [req-248793ba-b58c-4302-891c-7aa49bae2822 req-1fa1fd88-efd4-4e07-a00f-48eb4b7675e6 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:06:41 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [req-248793ba-b58c-4302-891c-7aa49bae2822 req-1fa1fd88-efd4-4e07-a00f-48eb4b7675e6 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Selected osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 as target Quobyte volume. {{(pid=82756) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 15:06:41 devstack cinder-volume[82756]: INFO cinder.volume.drivers.remotefs [req-248793ba-b58c-4302-891c-7aa49bae2822 req-1fa1fd88-efd4-4e07-a00f-48eb4b7675e6 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] casted to osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 Apr 16 15:06:41 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [req-248793ba-b58c-4302-891c-7aa49bae2822 req-1fa1fd88-efd4-4e07-a00f-48eb4b7675e6 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-203917d0-9fc3-4949-81b0-fe0872b639f0 1073741824 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:06:41 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-76bc98ff-d416-4b8c-a094-62b706bdef70 tempest-VolumeQuotasAdminTestJSON-1728164091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (447a532b-d6ec-49b4-ba8a-abda9dfe3c18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-383b2d71-04d4-4c8f-8e6d-3764812435ca', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:06:41 devstack sudo[85413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5f01913-4ea7-4cdb-8c76-10fda64d06e5_qdnr10b0devstack@QuobyteHD Apr 16 15:06:41 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-76bc98ff-d416-4b8c-a094-62b706bdef70 tempest-VolumeQuotasAdminTestJSON-1728164091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa359e13-71f1-42cb-9992-f87b9b8c8319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:06:41 devstack sudo[85413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:06:41 devstack sudo[85415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-203917d0-9fc3-4949-81b0-fe0872b639f0 1073741824 Apr 16 15:06:41 devstack sudo[85415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:06:41 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-76bc98ff-d416-4b8c-a094-62b706bdef70 tempest-VolumeQuotasAdminTestJSON-1728164091 None] Volume volume-383b2d71-04d4-4c8f-8e6d-3764812435ca (383b2d71-04d4-4c8f-8e6d-3764812435ca): created successfully Apr 16 15:06:41 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-76bc98ff-d416-4b8c-a094-62b706bdef70 tempest-VolumeQuotasAdminTestJSON-1728164091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa359e13-71f1-42cb-9992-f87b9b8c8319) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:06:41 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-76bc98ff-d416-4b8c-a094-62b706bdef70 tempest-VolumeQuotasAdminTestJSON-1728164091 None] Flow 'volume_create_manager' (9f7f2994-968c-415b-bc1c-f0ad6e2fadb6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:06:41 devstack sudo[85393]: pam_unix(sudo:session): session closed for user root Apr 16 15:06:41 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-6cd37c87-77a7-4eb6-bcf0-f87d784e8f1a tempest-GroupsV314Test-1949227607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.501s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:06:41 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-6cd37c87-77a7-4eb6-bcf0-f87d784e8f1a tempest-GroupsV314Test-1949227607 None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:06:41 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-6cd37c87-77a7-4eb6-bcf0-f87d784e8f1a tempest-GroupsV314Test-1949227607 None] Delete group completed successfully. Apr 16 15:06:41 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-76bc98ff-d416-4b8c-a094-62b706bdef70 tempest-VolumeQuotasAdminTestJSON-1728164091 None] Created volume successfully. Apr 16 15:06:42 devstack sudo[85413]: pam_unix(sudo:session): session closed for user root Apr 16 15:06:42 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-904c4e3b-f04b-446a-bb86-c934e663421d tempest-VolumesImageMetadata-1639441407 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5f01913-4ea7-4cdb-8c76-10fda64d06e5_qdnr10b0devstack@QuobyteHD" returned: 0 in 0.507s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:06:42 devstack cinder-volume[82756]: DEBUG cinder.image.image_utils [None req-904c4e3b-f04b-446a-bb86-c934e663421d tempest-VolumesImageMetadata-1639441407 None] b5f01913-4ea7-4cdb-8c76-10fda64d06e5 was qcow2, converting to raw {{(pid=82756) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 16 15:06:42 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-904c4e3b-f04b-446a-bb86-c934e663421d tempest-VolumesImageMetadata-1639441407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b5f01913-4ea7-4cdb-8c76-10fda64d06e5_qdnr10b0devstack@QuobyteHD /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c3c35e06-524e-4f22-8d64-255fe16ad660 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:06:42 devstack sudo[85424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b5f01913-4ea7-4cdb-8c76-10fda64d06e5_qdnr10b0devstack@QuobyteHD /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c3c35e06-524e-4f22-8d64-255fe16ad660 Apr 16 15:06:42 devstack sudo[85424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:06:42 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-31cfe92d-3bdf-4676-bb40-ed69b5b5abcb tempest-GroupsV314Test-1949227607 None] Acquiring lock "cinder-quobyte-e4b16ee6-0a28-44eb-9597-7605f83b327d" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:06:42 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-31cfe92d-3bdf-4676-bb40-ed69b5b5abcb tempest-GroupsV314Test-1949227607 None] Lock "cinder-quobyte-e4b16ee6-0a28-44eb-9597-7605f83b327d" acquired by "delete_volume" :: waited 0.011s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:06:42 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[60d26ab1-dd5f-452a-85ec-b077450af579]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:06:42 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-31cfe92d-3bdf-4676-bb40-ed69b5b5abcb tempest-GroupsV314Test-1949227607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-e4b16ee6-0a28-44eb-9597-7605f83b327d {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:06:42 devstack sudo[85415]: pam_unix(sudo:session): session closed for user root Apr 16 15:06:42 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [req-248793ba-b58c-4302-891c-7aa49bae2822 req-1fa1fd88-efd4-4e07-a00f-48eb4b7675e6 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-203917d0-9fc3-4949-81b0-fe0872b639f0 1073741824" returned: 0 in 0.699s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:06:42 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [req-248793ba-b58c-4302-891c-7aa49bae2822 req-1fa1fd88-efd4-4e07-a00f-48eb4b7675e6 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-203917d0-9fc3-4949-81b0-fe0872b639f0 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:06:42 devstack sudo[85426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-e4b16ee6-0a28-44eb-9597-7605f83b327d Apr 16 15:06:42 devstack sudo[85426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:06:42 devstack sudo[85428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-203917d0-9fc3-4949-81b0-fe0872b639f0 Apr 16 15:06:42 devstack sudo[85428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:06:43 devstack sudo[85428]: pam_unix(sudo:session): session closed for user root Apr 16 15:06:43 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-4d3658b3-7ff9-4b27-8eef-84c9eed3384a tempest-VolumeQuotasAdminTestJSON-1728164091 None] Acquiring lock "cinder-383b2d71-04d4-4c8f-8e6d-3764812435ca-delete_volume" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:06:43 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [req-248793ba-b58c-4302-891c-7aa49bae2822 req-1fa1fd88-efd4-4e07-a00f-48eb4b7675e6 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-203917d0-9fc3-4949-81b0-fe0872b639f0" returned: 0 in 0.623s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:06:43 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [req-248793ba-b58c-4302-891c-7aa49bae2822 req-1fa1fd88-efd4-4e07-a00f-48eb4b7675e6 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] <== create_volume: return (1369ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'} {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 15:06:43 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [req-248793ba-b58c-4302-891c-7aa49bae2822 req-1fa1fd88-efd4-4e07-a00f-48eb4b7675e6 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.375s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:06:43 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-4d3658b3-7ff9-4b27-8eef-84c9eed3384a tempest-VolumeQuotasAdminTestJSON-1728164091 None] Lock "cinder-383b2d71-04d4-4c8f-8e6d-3764812435ca-delete_volume" acquired by "delete_volume" :: waited 0.080s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:06:43 devstack cinder-volume[82756]: DEBUG cinder.volume.volume_utils [req-248793ba-b58c-4302-891c-7aa49bae2822 req-1fa1fd88-efd4-4e07-a00f-48eb4b7675e6 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Attempting download of b5f01913-4ea7-4cdb-8c76-10fda64d06e5 ((None, [{'url': 'file:///opt/stack/data/glance/images/b5f01913-4ea7-4cdb-8c76-10fda64d06e5', 'metadata': {}}])) to volume 203917d0-9fc3-4949-81b0-fe0872b639f0. {{(pid=82756) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 16 15:06:43 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-4d3658b3-7ff9-4b27-8eef-84c9eed3384a tempest-VolumeQuotasAdminTestJSON-1728164091 None] Acquiring lock "cinder-quobyte-383b2d71-04d4-4c8f-8e6d-3764812435ca" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:06:43 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-4d3658b3-7ff9-4b27-8eef-84c9eed3384a tempest-VolumeQuotasAdminTestJSON-1728164091 None] Lock "cinder-quobyte-383b2d71-04d4-4c8f-8e6d-3764812435ca" acquired by "delete_volume" :: waited 0.021s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:06:43 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[36606f63-0e14-4c52-88e8-99ecfa8cc4a5]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:06:43 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-4d3658b3-7ff9-4b27-8eef-84c9eed3384a tempest-VolumeQuotasAdminTestJSON-1728164091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-383b2d71-04d4-4c8f-8e6d-3764812435ca {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:06:43 devstack sudo[85426]: pam_unix(sudo:session): session closed for user root Apr 16 15:06:43 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-31cfe92d-3bdf-4676-bb40-ed69b5b5abcb tempest-GroupsV314Test-1949227607 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-e4b16ee6-0a28-44eb-9597-7605f83b327d" returned: 0 in 0.886s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:06:43 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-31cfe92d-3bdf-4676-bb40-ed69b5b5abcb tempest-GroupsV314Test-1949227607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-e4b16ee6-0a28-44eb-9597-7605f83b327d {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:06:43 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[f76292d5-30c6-4b04-9b9d-c3160e03321c]: (4, 'raw') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:06:43 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [req-248793ba-b58c-4302-891c-7aa49bae2822 req-1fa1fd88-efd4-4e07-a00f-48eb4b7675e6 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b5f01913-4ea7-4cdb-8c76-10fda64d06e5_7iq9znh7 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:06:43 devstack sudo[85462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-e4b16ee6-0a28-44eb-9597-7605f83b327d Apr 16 15:06:43 devstack sudo[85462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:06:43 devstack sudo[85461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-383b2d71-04d4-4c8f-8e6d-3764812435ca Apr 16 15:06:43 devstack sudo[85461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:06:43 devstack sudo[85424]: pam_unix(sudo:session): session closed for user root Apr 16 15:06:43 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-904c4e3b-f04b-446a-bb86-c934e663421d tempest-VolumesImageMetadata-1639441407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b5f01913-4ea7-4cdb-8c76-10fda64d06e5_qdnr10b0devstack@QuobyteHD /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c3c35e06-524e-4f22-8d64-255fe16ad660" returned: 0 in 1.268s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:06:43 devstack cinder-volume[82756]: DEBUG cinder.image.image_utils [None req-904c4e3b-f04b-446a-bb86-c934e663421d tempest-VolumesImageMetadata-1639441407 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b5f01913-4ea7-4cdb-8c76-10fda64d06e5_qdnr10b0devstack@QuobyteHD, size 112.00 MB, duration 1.27 sec, destination /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c3c35e06-524e-4f22-8d64-255fe16ad660 {{(pid=82756) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 15:06:43 devstack cinder-volume[82756]: INFO cinder.image.image_utils [None req-904c4e3b-f04b-446a-bb86-c934e663421d tempest-VolumesImageMetadata-1639441407 None] Converted 112.00 MB image at 88.24 MB/s Apr 16 15:06:43 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-904c4e3b-f04b-446a-bb86-c934e663421d tempest-VolumesImageMetadata-1639441407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c3c35e06-524e-4f22-8d64-255fe16ad660 1G {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:06:43 devstack sudo[85463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b5f01913-4ea7-4cdb-8c76-10fda64d06e5_7iq9znh7 Apr 16 15:06:43 devstack sudo[85463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:06:43 devstack sudo[85466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c3c35e06-524e-4f22-8d64-255fe16ad660 1G Apr 16 15:06:43 devstack sudo[85466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:06:43 devstack sudo[85462]: pam_unix(sudo:session): session closed for user root Apr 16 15:06:43 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-31cfe92d-3bdf-4676-bb40-ed69b5b5abcb tempest-GroupsV314Test-1949227607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-e4b16ee6-0a28-44eb-9597-7605f83b327d" returned: 0 in 0.573s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:06:43 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-31cfe92d-3bdf-4676-bb40-ed69b5b5abcb tempest-GroupsV314Test-1949227607 None] Lock "cinder-quobyte-e4b16ee6-0a28-44eb-9597-7605f83b327d" released by "delete_volume" :: held 1.494s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:06:44 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-31cfe92d-3bdf-4676-bb40-ed69b5b5abcb tempest-GroupsV314Test-1949227607 None] Created reservations ['c64663f7-fdcc-4085-86cf-573b19f43562'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:06:44 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-31cfe92d-3bdf-4676-bb40-ed69b5b5abcb tempest-GroupsV314Test-1949227607 None] Created reservations ['a6f0bf27-4a7b-4c25-ac50-02f99fc3639c', '21923d41-77b4-4cf3-84e6-732f1e4acfed', 'b88e0efc-ebe0-44d3-ab3b-9307827f664d', '00984870-2f2b-4cd8-a5c5-3c46aa87c758'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:06:44 devstack sudo[85463]: pam_unix(sudo:session): session closed for user root Apr 16 15:06:44 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [req-248793ba-b58c-4302-891c-7aa49bae2822 req-1fa1fd88-efd4-4e07-a00f-48eb4b7675e6 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b5f01913-4ea7-4cdb-8c76-10fda64d06e5_7iq9znh7" returned: 0 in 0.702s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:06:44 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [req-248793ba-b58c-4302-891c-7aa49bae2822 req-1fa1fd88-efd4-4e07-a00f-48eb4b7675e6 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5f01913-4ea7-4cdb-8c76-10fda64d06e5_7iq9znh7 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:06:44 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-31cfe92d-3bdf-4676-bb40-ed69b5b5abcb tempest-GroupsV314Test-1949227607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:06:44 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-31cfe92d-3bdf-4676-bb40-ed69b5b5abcb tempest-GroupsV314Test-1949227607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:06:44 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-31cfe92d-3bdf-4676-bb40-ed69b5b5abcb tempest-GroupsV314Test-1949227607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:06:44 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-31cfe92d-3bdf-4676-bb40-ed69b5b5abcb tempest-GroupsV314Test-1949227607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:06:44 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-31cfe92d-3bdf-4676-bb40-ed69b5b5abcb tempest-GroupsV314Test-1949227607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:06:44 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-31cfe92d-3bdf-4676-bb40-ed69b5b5abcb tempest-GroupsV314Test-1949227607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:06:44 devstack sudo[85478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:06:44 devstack sudo[85478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:06:44 devstack sudo[85461]: pam_unix(sudo:session): session closed for user root Apr 16 15:06:44 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-4d3658b3-7ff9-4b27-8eef-84c9eed3384a tempest-VolumeQuotasAdminTestJSON-1728164091 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-383b2d71-04d4-4c8f-8e6d-3764812435ca" returned: 0 in 0.902s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:06:44 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-4d3658b3-7ff9-4b27-8eef-84c9eed3384a tempest-VolumeQuotasAdminTestJSON-1728164091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-383b2d71-04d4-4c8f-8e6d-3764812435ca {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:06:44 devstack sudo[85475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5f01913-4ea7-4cdb-8c76-10fda64d06e5_7iq9znh7 Apr 16 15:06:44 devstack sudo[85475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:06:44 devstack sudo[85481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-383b2d71-04d4-4c8f-8e6d-3764812435ca Apr 16 15:06:44 devstack sudo[85481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:06:44 devstack sudo[85466]: pam_unix(sudo:session): session closed for user root Apr 16 15:06:44 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-904c4e3b-f04b-446a-bb86-c934e663421d tempest-VolumesImageMetadata-1639441407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c3c35e06-524e-4f22-8d64-255fe16ad660 1G" returned: 0 in 0.815s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:06:44 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[321b2a5f-472e-404f-abca-3047274c573d]: (4, 'raw') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:06:44 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-904c4e3b-f04b-446a-bb86-c934e663421d tempest-VolumesImageMetadata-1639441407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c3c35e06-524e-4f22-8d64-255fe16ad660 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:06:44 devstack sudo[85484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c3c35e06-524e-4f22-8d64-255fe16ad660 Apr 16 15:06:44 devstack sudo[85484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:06:44 devstack sudo[85478]: pam_unix(sudo:session): session closed for user root Apr 16 15:06:44 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-31cfe92d-3bdf-4676-bb40-ed69b5b5abcb tempest-GroupsV314Test-1949227607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.696s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:06:44 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-31cfe92d-3bdf-4676-bb40-ed69b5b5abcb tempest-GroupsV314Test-1949227607 None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:06:44 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-31cfe92d-3bdf-4676-bb40-ed69b5b5abcb tempest-GroupsV314Test-1949227607 None] Delete group completed successfully. Apr 16 15:06:45 devstack sudo[85475]: pam_unix(sudo:session): session closed for user root Apr 16 15:06:45 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [req-248793ba-b58c-4302-891c-7aa49bae2822 req-1fa1fd88-efd4-4e07-a00f-48eb4b7675e6 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5f01913-4ea7-4cdb-8c76-10fda64d06e5_7iq9znh7" returned: 1 in 0.980s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:06:45 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [req-248793ba-b58c-4302-891c-7aa49bae2822 req-1fa1fd88-efd4-4e07-a00f-48eb4b7675e6 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5f01913-4ea7-4cdb-8c76-10fda64d06e5_7iq9znh7' failed. Not Retrying. {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 16 15:06:45 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[26bfb9bd-91e3-43e2-a288-3cf40021b962]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:06:45 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [req-248793ba-b58c-4302-891c-7aa49bae2822 req-1fa1fd88-efd4-4e07-a00f-48eb4b7675e6 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5f01913-4ea7-4cdb-8c76-10fda64d06e5_x97cd1wadevstack@QuobyteHD {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:06:45 devstack sudo[85481]: pam_unix(sudo:session): session closed for user root Apr 16 15:06:45 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-4d3658b3-7ff9-4b27-8eef-84c9eed3384a tempest-VolumeQuotasAdminTestJSON-1728164091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-383b2d71-04d4-4c8f-8e6d-3764812435ca" returned: 0 in 0.894s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:06:45 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-4d3658b3-7ff9-4b27-8eef-84c9eed3384a tempest-VolumeQuotasAdminTestJSON-1728164091 None] Lock "cinder-quobyte-383b2d71-04d4-4c8f-8e6d-3764812435ca" released by "delete_volume" :: held 1.828s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:06:45 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-4d3658b3-7ff9-4b27-8eef-84c9eed3384a tempest-VolumeQuotasAdminTestJSON-1728164091 None] Created reservations ['421c7503-524a-4768-b33f-5f2555e524a6', 'c180a6fc-bc4e-4984-a1b5-7078b62647d3', '78f17a99-110c-44a4-a430-582ba08749c5', '19d83fbe-8871-48b8-948d-1a6ff54612be'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:06:45 devstack sudo[85484]: pam_unix(sudo:session): session closed for user root Apr 16 15:06:45 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-904c4e3b-f04b-446a-bb86-c934e663421d tempest-VolumesImageMetadata-1639441407 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c3c35e06-524e-4f22-8d64-255fe16ad660" returned: 0 in 0.775s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:06:45 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-904c4e3b-f04b-446a-bb86-c934e663421d tempest-VolumesImageMetadata-1639441407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c3c35e06-524e-4f22-8d64-255fe16ad660 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:06:45 devstack sudo[85492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5f01913-4ea7-4cdb-8c76-10fda64d06e5_x97cd1wadevstack@QuobyteHD Apr 16 15:06:45 devstack sudo[85492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:06:45 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-4d3658b3-7ff9-4b27-8eef-84c9eed3384a tempest-VolumeQuotasAdminTestJSON-1728164091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:06:45 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-4d3658b3-7ff9-4b27-8eef-84c9eed3384a tempest-VolumeQuotasAdminTestJSON-1728164091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:06:45 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-4d3658b3-7ff9-4b27-8eef-84c9eed3384a tempest-VolumeQuotasAdminTestJSON-1728164091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:06:45 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-4d3658b3-7ff9-4b27-8eef-84c9eed3384a tempest-VolumeQuotasAdminTestJSON-1728164091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:06:45 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-4d3658b3-7ff9-4b27-8eef-84c9eed3384a tempest-VolumeQuotasAdminTestJSON-1728164091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:06:45 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-4d3658b3-7ff9-4b27-8eef-84c9eed3384a tempest-VolumeQuotasAdminTestJSON-1728164091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:06:45 devstack sudo[85495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:06:45 devstack sudo[85495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:06:45 devstack sudo[85493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c3c35e06-524e-4f22-8d64-255fe16ad660 Apr 16 15:06:45 devstack sudo[85493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:06:45 devstack sudo[85495]: pam_unix(sudo:session): session closed for user root Apr 16 15:06:45 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-4d3658b3-7ff9-4b27-8eef-84c9eed3384a tempest-VolumeQuotasAdminTestJSON-1728164091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.703s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:06:45 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-4d3658b3-7ff9-4b27-8eef-84c9eed3384a tempest-VolumeQuotasAdminTestJSON-1728164091 None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:06:45 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-4d3658b3-7ff9-4b27-8eef-84c9eed3384a tempest-VolumeQuotasAdminTestJSON-1728164091 None] Deleted volume successfully. Apr 16 15:06:45 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-4d3658b3-7ff9-4b27-8eef-84c9eed3384a tempest-VolumeQuotasAdminTestJSON-1728164091 None] Lock "cinder-383b2d71-04d4-4c8f-8e6d-3764812435ca-delete_volume" released by "delete_volume" :: held 2.754s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:06:46 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [None req-4be5e6ee-7652-401e-9453-00d23a3450f6 tempest-VolumeQuotasAdminTestJSON-1728164091 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82756) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 15:06:46 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-4be5e6ee-7652-401e-9453-00d23a3450f6 tempest-VolumeQuotasAdminTestJSON-1728164091 None] Flow 'volume_create_manager' (77845ce0-cfe5-4281-a00f-b5392c695f53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:06:46 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-4be5e6ee-7652-401e-9453-00d23a3450f6 tempest-VolumeQuotasAdminTestJSON-1728164091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15d12ea2-f026-4097-afcf-8507530ce837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:06:46 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-4be5e6ee-7652-401e-9453-00d23a3450f6 tempest-VolumeQuotasAdminTestJSON-1728164091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15d12ea2-f026-4097-afcf-8507530ce837) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:06:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-978150090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a24671c-4e26-443f-952c-b7fb91cb024e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d86d100506964f1395060c57d24b5817',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:06:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:06:46Z,use_quota=True,user_id='5109835013844a70a8dffbadfcbb0846',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:06:46 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-4be5e6ee-7652-401e-9453-00d23a3450f6 tempest-VolumeQuotasAdminTestJSON-1728164091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16be2ce0-1bd6-4399-a743-5de2956f65d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:06:46 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-4be5e6ee-7652-401e-9453-00d23a3450f6 tempest-VolumeQuotasAdminTestJSON-1728164091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16be2ce0-1bd6-4399-a743-5de2956f65d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:06:46 devstack sudo[85492]: pam_unix(sudo:session): session closed for user root Apr 16 15:06:46 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-4be5e6ee-7652-401e-9453-00d23a3450f6 tempest-VolumeQuotasAdminTestJSON-1728164091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3368ed24-b7f1-4abd-b4f9-8a40508c70d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:06:46 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-4be5e6ee-7652-401e-9453-00d23a3450f6 tempest-VolumeQuotasAdminTestJSON-1728164091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3368ed24-b7f1-4abd-b4f9-8a40508c70d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a24671c-4e26-443f-952c-b7fb91cb024e', 'volume_name': 'volume-0a24671c-4e26-443f-952c-b7fb91cb024e', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:06:46 devstack sudo[85493]: pam_unix(sudo:session): session closed for user root Apr 16 15:06:46 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-4be5e6ee-7652-401e-9453-00d23a3450f6 tempest-VolumeQuotasAdminTestJSON-1728164091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44bfff88-79e2-4e9e-8b5f-dfcd73506422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:06:46 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-4be5e6ee-7652-401e-9453-00d23a3450f6 tempest-VolumeQuotasAdminTestJSON-1728164091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44bfff88-79e2-4e9e-8b5f-dfcd73506422) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:06:46 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-4be5e6ee-7652-401e-9453-00d23a3450f6 tempest-VolumeQuotasAdminTestJSON-1728164091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb2b83fd-8109-43b4-b26d-83edd294f361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:06:46 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-4be5e6ee-7652-401e-9453-00d23a3450f6 tempest-VolumeQuotasAdminTestJSON-1728164091 None] Volume 0a24671c-4e26-443f-952c-b7fb91cb024e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a24671c-4e26-443f-952c-b7fb91cb024e', 'volume_size': 1} Apr 16 15:06:46 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-4be5e6ee-7652-401e-9453-00d23a3450f6 tempest-VolumeQuotasAdminTestJSON-1728164091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:06:46 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-4be5e6ee-7652-401e-9453-00d23a3450f6 tempest-VolumeQuotasAdminTestJSON-1728164091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:06:46 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-4be5e6ee-7652-401e-9453-00d23a3450f6 tempest-VolumeQuotasAdminTestJSON-1728164091 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:06:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-978150090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a24671c-4e26-443f-952c-b7fb91cb024e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d86d100506964f1395060c57d24b5817',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:06:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:06:46Z,use_quota=True,user_id='5109835013844a70a8dffbadfcbb0846',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)}" {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 15:06:46 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-4be5e6ee-7652-401e-9453-00d23a3450f6 tempest-VolumeQuotasAdminTestJSON-1728164091 None] Creating volume 0a24671c-4e26-443f-952c-b7fb91cb024e {{(pid=82756) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 15:06:46 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-4be5e6ee-7652-401e-9453-00d23a3450f6 tempest-VolumeQuotasAdminTestJSON-1728164091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:06:46 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-4be5e6ee-7652-401e-9453-00d23a3450f6 tempest-VolumeQuotasAdminTestJSON-1728164091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:06:46 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-4be5e6ee-7652-401e-9453-00d23a3450f6 tempest-VolumeQuotasAdminTestJSON-1728164091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:06:46 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-4be5e6ee-7652-401e-9453-00d23a3450f6 tempest-VolumeQuotasAdminTestJSON-1728164091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:06:46 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-4be5e6ee-7652-401e-9453-00d23a3450f6 tempest-VolumeQuotasAdminTestJSON-1728164091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:06:46 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-4be5e6ee-7652-401e-9453-00d23a3450f6 tempest-VolumeQuotasAdminTestJSON-1728164091 None] Selected osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 as target Quobyte volume. {{(pid=82756) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 15:06:46 devstack cinder-volume[82756]: INFO cinder.volume.drivers.remotefs [None req-4be5e6ee-7652-401e-9453-00d23a3450f6 tempest-VolumeQuotasAdminTestJSON-1728164091 None] casted to osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 Apr 16 15:06:46 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-4be5e6ee-7652-401e-9453-00d23a3450f6 tempest-VolumeQuotasAdminTestJSON-1728164091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-0a24671c-4e26-443f-952c-b7fb91cb024e 1073741824 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:06:46 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [req-248793ba-b58c-4302-891c-7aa49bae2822 req-1fa1fd88-efd4-4e07-a00f-48eb4b7675e6 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5f01913-4ea7-4cdb-8c76-10fda64d06e5_x97cd1wadevstack@QuobyteHD" returned: 0 in 1.187s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:06:46 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-904c4e3b-f04b-446a-bb86-c934e663421d tempest-VolumesImageMetadata-1639441407 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c3c35e06-524e-4f22-8d64-255fe16ad660" returned: 1 in 1.069s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:06:46 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-904c4e3b-f04b-446a-bb86-c934e663421d tempest-VolumesImageMetadata-1639441407 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c3c35e06-524e-4f22-8d64-255fe16ad660' failed. Not Retrying. {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 16 15:06:46 devstack cinder-volume[82756]: DEBUG cinder.image.image_utils [req-248793ba-b58c-4302-891c-7aa49bae2822 req-1fa1fd88-efd4-4e07-a00f-48eb4b7675e6 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] b5f01913-4ea7-4cdb-8c76-10fda64d06e5 was qcow2, converting to raw {{(pid=82756) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 16 15:06:46 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [req-248793ba-b58c-4302-891c-7aa49bae2822 req-1fa1fd88-efd4-4e07-a00f-48eb4b7675e6 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b5f01913-4ea7-4cdb-8c76-10fda64d06e5_x97cd1wadevstack@QuobyteHD /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-203917d0-9fc3-4949-81b0-fe0872b639f0 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:06:46 devstack sudo[85505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-0a24671c-4e26-443f-952c-b7fb91cb024e 1073741824 Apr 16 15:06:46 devstack sudo[85505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:06:46 devstack cinder-volume[82756]: DEBUG cinder.volume.volume_utils [None req-904c4e3b-f04b-446a-bb86-c934e663421d tempest-VolumesImageMetadata-1639441407 None] Downloaded image b5f01913-4ea7-4cdb-8c76-10fda64d06e5 ((None, [{'url': 'file:///opt/stack/data/glance/images/b5f01913-4ea7-4cdb-8c76-10fda64d06e5', 'metadata': {}}])) to volume c3c35e06-524e-4f22-8d64-255fe16ad660 successfully. {{(pid=82756) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 16 15:06:46 devstack cinder-volume[82756]: DEBUG cinder.image.image_utils [None req-904c4e3b-f04b-446a-bb86-c934e663421d tempest-VolumesImageMetadata-1639441407 None] Temporary image b5f01913-4ea7-4cdb-8c76-10fda64d06e5 for user 712ff7e43dac4592b223a8a2be5a4339 is deleted. {{(pid=82756) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 16 15:06:46 devstack cinder-volume[82756]: DEBUG cinder.volume.volume_utils [None req-904c4e3b-f04b-446a-bb86-c934e663421d tempest-VolumesImageMetadata-1639441407 None] Marking volume c3c35e06-524e-4f22-8d64-255fe16ad660 as bootable. {{(pid=82756) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 16 15:06:46 devstack sudo[85506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b5f01913-4ea7-4cdb-8c76-10fda64d06e5_x97cd1wadevstack@QuobyteHD /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-203917d0-9fc3-4949-81b0-fe0872b639f0 Apr 16 15:06:46 devstack sudo[85506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:06:46 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [None req-904c4e3b-f04b-446a-bb86-c934e663421d tempest-VolumesImageMetadata-1639441407 None] Copying metadata from image b5f01913-4ea7-4cdb-8c76-10fda64d06e5 to c3c35e06-524e-4f22-8d64-255fe16ad660. {{(pid=82756) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 16 15:06:46 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [None req-904c4e3b-f04b-446a-bb86-c934e663421d tempest-VolumesImageMetadata-1639441407 None] Creating volume glance metadata for volume c3c35e06-524e-4f22-8d64-255fe16ad660 backed by image b5f01913-4ea7-4cdb-8c76-10fda64d06e5 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b5f01913-4ea7-4cdb-8c76-10fda64d06e5', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82756) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 16 15:06:46 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-904c4e3b-f04b-446a-bb86-c934e663421d tempest-VolumesImageMetadata-1639441407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b558dc35-ea85-4d57-85fc-d1a4e966cd9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3c35e06-524e-4f22-8d64-255fe16ad660', 'volume_size': 1, 'image_id': 'b5f01913-4ea7-4cdb-8c76-10fda64d06e5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b5f01913-4ea7-4cdb-8c76-10fda64d06e5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '42394d2631114f428489519b24c78a03', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b5f01913-4ea7-4cdb-8c76-10fda64d06e5', 'created_at': datetime.datetime(2026, 4, 16, 13, 0, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 16, 13, 0, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b5f01913-4ea7-4cdb-8c76-10fda64d06e5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:06:46 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-904c4e3b-f04b-446a-bb86-c934e663421d tempest-VolumesImageMetadata-1639441407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67fa369a-bb6f-4698-8ea3-7f4734f9c34e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:06:46 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-904c4e3b-f04b-446a-bb86-c934e663421d tempest-VolumesImageMetadata-1639441407 None] Volume volume-c3c35e06-524e-4f22-8d64-255fe16ad660 (c3c35e06-524e-4f22-8d64-255fe16ad660): created successfully Apr 16 15:06:46 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-904c4e3b-f04b-446a-bb86-c934e663421d tempest-VolumesImageMetadata-1639441407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67fa369a-bb6f-4698-8ea3-7f4734f9c34e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:06:46 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-904c4e3b-f04b-446a-bb86-c934e663421d tempest-VolumesImageMetadata-1639441407 None] Flow 'volume_create_manager' (db2d2857-3d16-427b-9650-3d249eeaf962) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:06:46 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-904c4e3b-f04b-446a-bb86-c934e663421d tempest-VolumesImageMetadata-1639441407 None] Created volume successfully. Apr 16 15:06:47 devstack sudo[85505]: pam_unix(sudo:session): session closed for user root Apr 16 15:06:47 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-4be5e6ee-7652-401e-9453-00d23a3450f6 tempest-VolumeQuotasAdminTestJSON-1728164091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-0a24671c-4e26-443f-952c-b7fb91cb024e 1073741824" returned: 0 in 0.829s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:06:47 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-c6cf15dc-d127-4ffc-a293-1f8ff15200f3 tempest-VolumesImageMetadata-1639441407 None] Acquiring lock "cinder-c3c35e06-524e-4f22-8d64-255fe16ad660-delete_volume" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:06:47 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-4be5e6ee-7652-401e-9453-00d23a3450f6 tempest-VolumeQuotasAdminTestJSON-1728164091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-0a24671c-4e26-443f-952c-b7fb91cb024e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:06:47 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-c6cf15dc-d127-4ffc-a293-1f8ff15200f3 tempest-VolumesImageMetadata-1639441407 None] Lock "cinder-c3c35e06-524e-4f22-8d64-255fe16ad660-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:06:47 devstack sudo[85518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-0a24671c-4e26-443f-952c-b7fb91cb024e Apr 16 15:06:47 devstack sudo[85518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:06:47 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-c6cf15dc-d127-4ffc-a293-1f8ff15200f3 tempest-VolumesImageMetadata-1639441407 None] Acquiring lock "cinder-quobyte-c3c35e06-524e-4f22-8d64-255fe16ad660" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:06:47 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-c6cf15dc-d127-4ffc-a293-1f8ff15200f3 tempest-VolumesImageMetadata-1639441407 None] Lock "cinder-quobyte-c3c35e06-524e-4f22-8d64-255fe16ad660" acquired by "delete_volume" :: waited 0.030s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:06:47 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[293d31e2-e586-41ee-878a-f33859599ae7]: (4, 'raw') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:06:47 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-c6cf15dc-d127-4ffc-a293-1f8ff15200f3 tempest-VolumesImageMetadata-1639441407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c3c35e06-524e-4f22-8d64-255fe16ad660 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:06:47 devstack sudo[85520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c3c35e06-524e-4f22-8d64-255fe16ad660 Apr 16 15:06:47 devstack sudo[85520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:06:47 devstack sudo[85506]: pam_unix(sudo:session): session closed for user root Apr 16 15:06:47 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [req-248793ba-b58c-4302-891c-7aa49bae2822 req-1fa1fd88-efd4-4e07-a00f-48eb4b7675e6 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b5f01913-4ea7-4cdb-8c76-10fda64d06e5_x97cd1wadevstack@QuobyteHD /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-203917d0-9fc3-4949-81b0-fe0872b639f0" returned: 0 in 1.283s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:06:47 devstack cinder-volume[82756]: DEBUG cinder.image.image_utils [req-248793ba-b58c-4302-891c-7aa49bae2822 req-1fa1fd88-efd4-4e07-a00f-48eb4b7675e6 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b5f01913-4ea7-4cdb-8c76-10fda64d06e5_x97cd1wadevstack@QuobyteHD, size 112.00 MB, duration 1.28 sec, destination /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-203917d0-9fc3-4949-81b0-fe0872b639f0 {{(pid=82756) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 15:06:47 devstack cinder-volume[82756]: INFO cinder.image.image_utils [req-248793ba-b58c-4302-891c-7aa49bae2822 req-1fa1fd88-efd4-4e07-a00f-48eb4b7675e6 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Converted 112.00 MB image at 87.17 MB/s Apr 16 15:06:47 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [req-248793ba-b58c-4302-891c-7aa49bae2822 req-1fa1fd88-efd4-4e07-a00f-48eb4b7675e6 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-203917d0-9fc3-4949-81b0-fe0872b639f0 1G {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:06:47 devstack sudo[85522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-203917d0-9fc3-4949-81b0-fe0872b639f0 1G Apr 16 15:06:47 devstack sudo[85522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:06:47 devstack sudo[85518]: pam_unix(sudo:session): session closed for user root Apr 16 15:06:47 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-4be5e6ee-7652-401e-9453-00d23a3450f6 tempest-VolumeQuotasAdminTestJSON-1728164091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-0a24671c-4e26-443f-952c-b7fb91cb024e" returned: 0 in 0.669s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:06:47 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-4be5e6ee-7652-401e-9453-00d23a3450f6 tempest-VolumeQuotasAdminTestJSON-1728164091 None] <== create_volume: return (1587ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'} {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 15:06:47 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-4be5e6ee-7652-401e-9453-00d23a3450f6 tempest-VolumeQuotasAdminTestJSON-1728164091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.591s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:06:47 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-4be5e6ee-7652-401e-9453-00d23a3450f6 tempest-VolumeQuotasAdminTestJSON-1728164091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb2b83fd-8109-43b4-b26d-83edd294f361) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a24671c-4e26-443f-952c-b7fb91cb024e', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:06:47 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-4be5e6ee-7652-401e-9453-00d23a3450f6 tempest-VolumeQuotasAdminTestJSON-1728164091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (283d2774-c1db-4119-bb74-d77d2a6619be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:06:47 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-4be5e6ee-7652-401e-9453-00d23a3450f6 tempest-VolumeQuotasAdminTestJSON-1728164091 None] Volume volume-0a24671c-4e26-443f-952c-b7fb91cb024e (0a24671c-4e26-443f-952c-b7fb91cb024e): created successfully Apr 16 15:06:47 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-4be5e6ee-7652-401e-9453-00d23a3450f6 tempest-VolumeQuotasAdminTestJSON-1728164091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (283d2774-c1db-4119-bb74-d77d2a6619be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:06:47 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-4be5e6ee-7652-401e-9453-00d23a3450f6 tempest-VolumeQuotasAdminTestJSON-1728164091 None] Flow 'volume_create_manager' (77845ce0-cfe5-4281-a00f-b5392c695f53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:06:47 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-4be5e6ee-7652-401e-9453-00d23a3450f6 tempest-VolumeQuotasAdminTestJSON-1728164091 None] Created volume successfully. Apr 16 15:06:48 devstack sudo[85520]: pam_unix(sudo:session): session closed for user root Apr 16 15:06:48 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-c6cf15dc-d127-4ffc-a293-1f8ff15200f3 tempest-VolumesImageMetadata-1639441407 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c3c35e06-524e-4f22-8d64-255fe16ad660" returned: 0 in 0.746s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:06:48 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-c6cf15dc-d127-4ffc-a293-1f8ff15200f3 tempest-VolumesImageMetadata-1639441407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c3c35e06-524e-4f22-8d64-255fe16ad660 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:06:48 devstack sudo[85522]: pam_unix(sudo:session): session closed for user root Apr 16 15:06:48 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [req-248793ba-b58c-4302-891c-7aa49bae2822 req-1fa1fd88-efd4-4e07-a00f-48eb4b7675e6 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-203917d0-9fc3-4949-81b0-fe0872b639f0 1G" returned: 0 in 0.630s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:06:48 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[e01a07ee-c87e-430b-bce0-047d5f1bb617]: (4, 'raw') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:06:48 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [req-248793ba-b58c-4302-891c-7aa49bae2822 req-1fa1fd88-efd4-4e07-a00f-48eb4b7675e6 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-203917d0-9fc3-4949-81b0-fe0872b639f0 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:06:48 devstack sudo[85530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c3c35e06-524e-4f22-8d64-255fe16ad660 Apr 16 15:06:48 devstack sudo[85530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:06:48 devstack sudo[85531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-203917d0-9fc3-4949-81b0-fe0872b639f0 Apr 16 15:06:48 devstack sudo[85531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:06:48 devstack sudo[85530]: pam_unix(sudo:session): session closed for user root Apr 16 15:06:48 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-c6cf15dc-d127-4ffc-a293-1f8ff15200f3 tempest-VolumesImageMetadata-1639441407 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c3c35e06-524e-4f22-8d64-255fe16ad660" returned: 1 in 0.672s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:06:48 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-c6cf15dc-d127-4ffc-a293-1f8ff15200f3 tempest-VolumesImageMetadata-1639441407 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c3c35e06-524e-4f22-8d64-255fe16ad660' failed. Not Retrying. {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 16 15:06:48 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-c6cf15dc-d127-4ffc-a293-1f8ff15200f3 tempest-VolumesImageMetadata-1639441407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c3c35e06-524e-4f22-8d64-255fe16ad660 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:06:48 devstack sudo[85537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c3c35e06-524e-4f22-8d64-255fe16ad660 Apr 16 15:06:48 devstack sudo[85537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:06:49 devstack sudo[85537]: pam_unix(sudo:session): session closed for user root Apr 16 15:06:49 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-c6cf15dc-d127-4ffc-a293-1f8ff15200f3 tempest-VolumesImageMetadata-1639441407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c3c35e06-524e-4f22-8d64-255fe16ad660" returned: 0 in 0.473s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:06:49 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-c6cf15dc-d127-4ffc-a293-1f8ff15200f3 tempest-VolumesImageMetadata-1639441407 None] Lock "cinder-quobyte-c3c35e06-524e-4f22-8d64-255fe16ad660" released by "delete_volume" :: held 1.950s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:06:49 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-c6cf15dc-d127-4ffc-a293-1f8ff15200f3 tempest-VolumesImageMetadata-1639441407 None] Created reservations ['a9bd5228-2277-4606-94d2-fba8265b4ef8', 'f030be5a-eadb-4986-9ca9-c41087744a59', '27526853-089a-47c8-999a-c4fd9950926c', '0dfc8508-5ac3-45d3-b54b-66a7c489c203'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:06:49 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-b5589813-136d-4df3-b552-a9a800f2dece tempest-VolumeQuotasAdminTestJSON-1399188652 None] Transfer volume completed successfully. Apr 16 15:06:49 devstack sudo[85531]: pam_unix(sudo:session): session closed for user root Apr 16 15:06:49 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [req-248793ba-b58c-4302-891c-7aa49bae2822 req-1fa1fd88-efd4-4e07-a00f-48eb4b7675e6 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-203917d0-9fc3-4949-81b0-fe0872b639f0" returned: 0 in 1.125s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:06:49 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [req-248793ba-b58c-4302-891c-7aa49bae2822 req-1fa1fd88-efd4-4e07-a00f-48eb4b7675e6 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-203917d0-9fc3-4949-81b0-fe0872b639f0 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:06:49 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-c6cf15dc-d127-4ffc-a293-1f8ff15200f3 tempest-VolumesImageMetadata-1639441407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:06:49 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-c6cf15dc-d127-4ffc-a293-1f8ff15200f3 tempest-VolumesImageMetadata-1639441407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:06:49 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-c6cf15dc-d127-4ffc-a293-1f8ff15200f3 tempest-VolumesImageMetadata-1639441407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:06:49 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-c6cf15dc-d127-4ffc-a293-1f8ff15200f3 tempest-VolumesImageMetadata-1639441407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:06:49 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-c6cf15dc-d127-4ffc-a293-1f8ff15200f3 tempest-VolumesImageMetadata-1639441407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:06:49 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-c6cf15dc-d127-4ffc-a293-1f8ff15200f3 tempest-VolumesImageMetadata-1639441407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:06:49 devstack sudo[85543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:06:49 devstack sudo[85543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:06:49 devstack sudo[85542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-203917d0-9fc3-4949-81b0-fe0872b639f0 Apr 16 15:06:49 devstack sudo[85542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:06:49 devstack sudo[85543]: pam_unix(sudo:session): session closed for user root Apr 16 15:06:49 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-c6cf15dc-d127-4ffc-a293-1f8ff15200f3 tempest-VolumesImageMetadata-1639441407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.574s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:06:49 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-c6cf15dc-d127-4ffc-a293-1f8ff15200f3 tempest-VolumesImageMetadata-1639441407 None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:06:49 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-c6cf15dc-d127-4ffc-a293-1f8ff15200f3 tempest-VolumesImageMetadata-1639441407 None] Deleted volume successfully. Apr 16 15:06:49 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-c6cf15dc-d127-4ffc-a293-1f8ff15200f3 tempest-VolumesImageMetadata-1639441407 None] Lock "cinder-c3c35e06-524e-4f22-8d64-255fe16ad660-delete_volume" released by "delete_volume" :: held 2.759s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:06:50 devstack sudo[85542]: pam_unix(sudo:session): session closed for user root Apr 16 15:06:50 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [req-248793ba-b58c-4302-891c-7aa49bae2822 req-1fa1fd88-efd4-4e07-a00f-48eb4b7675e6 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-203917d0-9fc3-4949-81b0-fe0872b639f0" returned: 1 in 0.847s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:06:50 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [req-248793ba-b58c-4302-891c-7aa49bae2822 req-1fa1fd88-efd4-4e07-a00f-48eb4b7675e6 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-203917d0-9fc3-4949-81b0-fe0872b639f0' failed. Not Retrying. {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 16 15:06:50 devstack cinder-volume[82756]: DEBUG cinder.volume.volume_utils [req-248793ba-b58c-4302-891c-7aa49bae2822 req-1fa1fd88-efd4-4e07-a00f-48eb4b7675e6 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Downloaded image b5f01913-4ea7-4cdb-8c76-10fda64d06e5 ((None, [{'url': 'file:///opt/stack/data/glance/images/b5f01913-4ea7-4cdb-8c76-10fda64d06e5', 'metadata': {}}])) to volume 203917d0-9fc3-4949-81b0-fe0872b639f0 successfully. {{(pid=82756) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 16 15:06:50 devstack cinder-volume[82756]: DEBUG cinder.image.image_utils [req-248793ba-b58c-4302-891c-7aa49bae2822 req-1fa1fd88-efd4-4e07-a00f-48eb4b7675e6 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Temporary image b5f01913-4ea7-4cdb-8c76-10fda64d06e5 for user faeeca99fa814c848e8eba16aa72cb29 is deleted. {{(pid=82756) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 16 15:06:50 devstack cinder-volume[82756]: DEBUG cinder.volume.volume_utils [req-248793ba-b58c-4302-891c-7aa49bae2822 req-1fa1fd88-efd4-4e07-a00f-48eb4b7675e6 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Marking volume 203917d0-9fc3-4949-81b0-fe0872b639f0 as bootable. {{(pid=82756) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 16 15:06:50 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [req-248793ba-b58c-4302-891c-7aa49bae2822 req-1fa1fd88-efd4-4e07-a00f-48eb4b7675e6 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Copying metadata from image b5f01913-4ea7-4cdb-8c76-10fda64d06e5 to 203917d0-9fc3-4949-81b0-fe0872b639f0. {{(pid=82756) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 16 15:06:50 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [req-248793ba-b58c-4302-891c-7aa49bae2822 req-1fa1fd88-efd4-4e07-a00f-48eb4b7675e6 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Creating volume glance metadata for volume 203917d0-9fc3-4949-81b0-fe0872b639f0 backed by image b5f01913-4ea7-4cdb-8c76-10fda64d06e5 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b5f01913-4ea7-4cdb-8c76-10fda64d06e5', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82756) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 16 15:06:50 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [req-248793ba-b58c-4302-891c-7aa49bae2822 req-1fa1fd88-efd4-4e07-a00f-48eb4b7675e6 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (baacc947-c071-44d8-ba13-0d8c09794874) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-203917d0-9fc3-4949-81b0-fe0872b639f0', 'volume_size': 1, 'image_id': 'b5f01913-4ea7-4cdb-8c76-10fda64d06e5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b5f01913-4ea7-4cdb-8c76-10fda64d06e5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '42394d2631114f428489519b24c78a03', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b5f01913-4ea7-4cdb-8c76-10fda64d06e5', 'created_at': datetime.datetime(2026, 4, 16, 13, 0, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 16, 13, 0, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b5f01913-4ea7-4cdb-8c76-10fda64d06e5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:06:50 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [req-248793ba-b58c-4302-891c-7aa49bae2822 req-1fa1fd88-efd4-4e07-a00f-48eb4b7675e6 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5f809bd-041c-424c-ae6c-352ca58d88b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:06:50 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [req-248793ba-b58c-4302-891c-7aa49bae2822 req-1fa1fd88-efd4-4e07-a00f-48eb4b7675e6 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Volume volume-203917d0-9fc3-4949-81b0-fe0872b639f0 (203917d0-9fc3-4949-81b0-fe0872b639f0): created successfully Apr 16 15:06:50 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [req-248793ba-b58c-4302-891c-7aa49bae2822 req-1fa1fd88-efd4-4e07-a00f-48eb4b7675e6 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5f809bd-041c-424c-ae6c-352ca58d88b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:06:50 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [req-248793ba-b58c-4302-891c-7aa49bae2822 req-1fa1fd88-efd4-4e07-a00f-48eb4b7675e6 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Flow 'volume_create_manager' (5ebd84b8-0a6b-4a88-b7f3-1d4eebd0c0a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:06:50 devstack cinder-volume[82756]: INFO cinder.volume.manager [req-248793ba-b58c-4302-891c-7aa49bae2822 req-1fa1fd88-efd4-4e07-a00f-48eb4b7675e6 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Created volume successfully. Apr 16 15:06:50 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-0fb7e9ab-2bd0-4e88-92e3-06382ca73b4f tempest-VolumeQuotasAdminTestJSON-668943173 None] Acquiring lock "cinder-0a24671c-4e26-443f-952c-b7fb91cb024e-delete_volume" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:06:50 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-0fb7e9ab-2bd0-4e88-92e3-06382ca73b4f tempest-VolumeQuotasAdminTestJSON-668943173 None] Lock "cinder-0a24671c-4e26-443f-952c-b7fb91cb024e-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:06:50 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-0fb7e9ab-2bd0-4e88-92e3-06382ca73b4f tempest-VolumeQuotasAdminTestJSON-668943173 None] Acquiring lock "cinder-quobyte-0a24671c-4e26-443f-952c-b7fb91cb024e" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:06:50 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-0fb7e9ab-2bd0-4e88-92e3-06382ca73b4f tempest-VolumeQuotasAdminTestJSON-668943173 None] Lock "cinder-quobyte-0a24671c-4e26-443f-952c-b7fb91cb024e" acquired by "delete_volume" :: waited 0.016s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:06:50 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[89df451e-b870-4ec7-bec0-05ff212d58d7]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:06:50 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-0fb7e9ab-2bd0-4e88-92e3-06382ca73b4f tempest-VolumeQuotasAdminTestJSON-668943173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-0a24671c-4e26-443f-952c-b7fb91cb024e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:06:50 devstack sudo[85550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-0a24671c-4e26-443f-952c-b7fb91cb024e Apr 16 15:06:50 devstack sudo[85550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:06:51 devstack sudo[85550]: pam_unix(sudo:session): session closed for user root Apr 16 15:06:51 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-0fb7e9ab-2bd0-4e88-92e3-06382ca73b4f tempest-VolumeQuotasAdminTestJSON-668943173 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-0a24671c-4e26-443f-952c-b7fb91cb024e" returned: 0 in 0.733s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:06:51 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-0fb7e9ab-2bd0-4e88-92e3-06382ca73b4f tempest-VolumeQuotasAdminTestJSON-668943173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-0a24671c-4e26-443f-952c-b7fb91cb024e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:06:51 devstack sudo[85555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-0a24671c-4e26-443f-952c-b7fb91cb024e Apr 16 15:06:51 devstack sudo[85555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:06:51 devstack sudo[85555]: pam_unix(sudo:session): session closed for user root Apr 16 15:06:51 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-0fb7e9ab-2bd0-4e88-92e3-06382ca73b4f tempest-VolumeQuotasAdminTestJSON-668943173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-0a24671c-4e26-443f-952c-b7fb91cb024e" returned: 0 in 0.571s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:06:51 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-0fb7e9ab-2bd0-4e88-92e3-06382ca73b4f tempest-VolumeQuotasAdminTestJSON-668943173 None] Lock "cinder-quobyte-0a24671c-4e26-443f-952c-b7fb91cb024e" released by "delete_volume" :: held 1.334s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:06:51 devstack cinder-volume[82756]: DEBUG oslo_service.periodic_task [None req-9570f02d-5ef9-412b-993f-520a9e5bfa81 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82756) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 16 15:06:51 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-9570f02d-5ef9-412b-993f-520a9e5bfa81 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:06:51 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-9570f02d-5ef9-412b-993f-520a9e5bfa81 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:06:51 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-9570f02d-5ef9-412b-993f-520a9e5bfa81 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:06:51 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-9570f02d-5ef9-412b-993f-520a9e5bfa81 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:06:51 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-9570f02d-5ef9-412b-993f-520a9e5bfa81 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:06:51 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-9570f02d-5ef9-412b-993f-520a9e5bfa81 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:06:51 devstack sudo[85558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:06:51 devstack sudo[85558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:06:51 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-0fb7e9ab-2bd0-4e88-92e3-06382ca73b4f tempest-VolumeQuotasAdminTestJSON-668943173 None] Created reservations ['381ef97f-34fb-497f-9c0d-c020baf4fb6d', '63696fa3-64b9-46d8-b8ea-14f016b7cc0f', '190ef5fb-d64a-4e32-ac24-f3673f7fb38e', 'f0d43e51-a67c-4ea4-b5a5-9f05014fa8a8'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:06:51 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-0fb7e9ab-2bd0-4e88-92e3-06382ca73b4f tempest-VolumeQuotasAdminTestJSON-668943173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:06:51 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-0fb7e9ab-2bd0-4e88-92e3-06382ca73b4f tempest-VolumeQuotasAdminTestJSON-668943173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:06:51 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-0fb7e9ab-2bd0-4e88-92e3-06382ca73b4f tempest-VolumeQuotasAdminTestJSON-668943173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:06:51 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-0fb7e9ab-2bd0-4e88-92e3-06382ca73b4f tempest-VolumeQuotasAdminTestJSON-668943173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:06:51 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-0fb7e9ab-2bd0-4e88-92e3-06382ca73b4f tempest-VolumeQuotasAdminTestJSON-668943173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:06:51 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-0fb7e9ab-2bd0-4e88-92e3-06382ca73b4f tempest-VolumeQuotasAdminTestJSON-668943173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:06:51 devstack sudo[85560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:06:51 devstack sudo[85560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:06:52 devstack sudo[85558]: pam_unix(sudo:session): session closed for user root Apr 16 15:06:52 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-9570f02d-5ef9-412b-993f-520a9e5bfa81 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.560s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:06:52 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-9570f02d-5ef9-412b-993f-520a9e5bfa81 None None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:06:52 devstack sudo[85560]: pam_unix(sudo:session): session closed for user root Apr 16 15:06:52 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-0fb7e9ab-2bd0-4e88-92e3-06382ca73b4f tempest-VolumeQuotasAdminTestJSON-668943173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.565s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:06:52 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-0fb7e9ab-2bd0-4e88-92e3-06382ca73b4f tempest-VolumeQuotasAdminTestJSON-668943173 None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:06:52 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-0fb7e9ab-2bd0-4e88-92e3-06382ca73b4f tempest-VolumeQuotasAdminTestJSON-668943173 None] Deleted volume successfully. Apr 16 15:06:52 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-0fb7e9ab-2bd0-4e88-92e3-06382ca73b4f tempest-VolumeQuotasAdminTestJSON-668943173 None] Lock "cinder-0a24671c-4e26-443f-952c-b7fb91cb024e-delete_volume" released by "delete_volume" :: held 2.107s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:06:52 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [req-248793ba-b58c-4302-891c-7aa49bae2822 req-24aef58c-4d3e-4287-b8cf-a14540f10a27 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:06:52 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [req-248793ba-b58c-4302-891c-7aa49bae2822 req-24aef58c-4d3e-4287-b8cf-a14540f10a27 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:06:52 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b0422d8-1844-4af2-a121-073514e7ac50]: (4, 'raw') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:06:52 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [req-248793ba-b58c-4302-891c-7aa49bae2822 req-24aef58c-4d3e-4287-b8cf-a14540f10a27 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-203917d0-9fc3-4949-81b0-fe0872b639f0 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:06:52 devstack sudo[85572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-203917d0-9fc3-4949-81b0-fe0872b639f0 Apr 16 15:06:52 devstack sudo[85572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:06:52 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [None req-5dba01f9-c603-4e58-bcac-ed9dc8f1da23 tempest-SnapshotMetadataTestJSON-380074759 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82756) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 15:06:52 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-5dba01f9-c603-4e58-bcac-ed9dc8f1da23 tempest-SnapshotMetadataTestJSON-380074759 None] Flow 'volume_create_manager' (622c08cc-7d70-49c3-8769-71b77bbed656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:06:52 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-5dba01f9-c603-4e58-bcac-ed9dc8f1da23 tempest-SnapshotMetadataTestJSON-380074759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99ea16df-2577-4bc6-ac3f-ac5823a303df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:06:53 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-5dba01f9-c603-4e58-bcac-ed9dc8f1da23 tempest-SnapshotMetadataTestJSON-380074759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99ea16df-2577-4bc6-ac3f-ac5823a303df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:06:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1525724150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d360ec4d-6d3e-43c3-b7ca-8a1000eb89dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f7c812291d846aaa65dd516fd0b3c87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:06:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:06:53Z,use_quota=True,user_id='6ed960627e8e46baa7426a55d461b0f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:06:53 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-5dba01f9-c603-4e58-bcac-ed9dc8f1da23 tempest-SnapshotMetadataTestJSON-380074759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a227e890-cf26-4901-8a69-47041e6c85f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:06:53 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-5dba01f9-c603-4e58-bcac-ed9dc8f1da23 tempest-SnapshotMetadataTestJSON-380074759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a227e890-cf26-4901-8a69-47041e6c85f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:06:53 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-5dba01f9-c603-4e58-bcac-ed9dc8f1da23 tempest-SnapshotMetadataTestJSON-380074759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d78095c-f636-4d2a-9ec1-227870ebf8e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:06:53 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-5dba01f9-c603-4e58-bcac-ed9dc8f1da23 tempest-SnapshotMetadataTestJSON-380074759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d78095c-f636-4d2a-9ec1-227870ebf8e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd360ec4d-6d3e-43c3-b7ca-8a1000eb89dd', 'volume_name': 'volume-d360ec4d-6d3e-43c3-b7ca-8a1000eb89dd', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:06:53 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-5dba01f9-c603-4e58-bcac-ed9dc8f1da23 tempest-SnapshotMetadataTestJSON-380074759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43cc8bc5-928d-469e-b4b4-822aac19d311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:06:53 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-5dba01f9-c603-4e58-bcac-ed9dc8f1da23 tempest-SnapshotMetadataTestJSON-380074759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43cc8bc5-928d-469e-b4b4-822aac19d311) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:06:53 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-5dba01f9-c603-4e58-bcac-ed9dc8f1da23 tempest-SnapshotMetadataTestJSON-380074759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb9d95fe-668f-4c56-a774-d95215899985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:06:53 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-5dba01f9-c603-4e58-bcac-ed9dc8f1da23 tempest-SnapshotMetadataTestJSON-380074759 None] Volume d360ec4d-6d3e-43c3-b7ca-8a1000eb89dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d360ec4d-6d3e-43c3-b7ca-8a1000eb89dd', 'volume_size': 1} Apr 16 15:06:53 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-5dba01f9-c603-4e58-bcac-ed9dc8f1da23 tempest-SnapshotMetadataTestJSON-380074759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:06:53 devstack sudo[85572]: pam_unix(sudo:session): session closed for user root Apr 16 15:06:53 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [req-248793ba-b58c-4302-891c-7aa49bae2822 req-24aef58c-4d3e-4287-b8cf-a14540f10a27 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-203917d0-9fc3-4949-81b0-fe0872b639f0" returned: 0 in 0.681s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:06:53 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [req-248793ba-b58c-4302-891c-7aa49bae2822 req-24aef58c-4d3e-4287-b8cf-a14540f10a27 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-203917d0-9fc3-4949-81b0-fe0872b639f0 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:06:53 devstack sudo[85576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-203917d0-9fc3-4949-81b0-fe0872b639f0 Apr 16 15:06:53 devstack sudo[85576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:06:53 devstack sudo[85576]: pam_unix(sudo:session): session closed for user root Apr 16 15:06:53 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [req-248793ba-b58c-4302-891c-7aa49bae2822 req-24aef58c-4d3e-4287-b8cf-a14540f10a27 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-203917d0-9fc3-4949-81b0-fe0872b639f0" returned: 1 in 0.579s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:06:53 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [req-248793ba-b58c-4302-891c-7aa49bae2822 req-24aef58c-4d3e-4287-b8cf-a14540f10a27 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-203917d0-9fc3-4949-81b0-fe0872b639f0' failed. Not Retrying. {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 16 15:06:53 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [req-248793ba-b58c-4302-891c-7aa49bae2822 req-24aef58c-4d3e-4287-b8cf-a14540f10a27 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.289s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:06:53 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-5dba01f9-c603-4e58-bcac-ed9dc8f1da23 tempest-SnapshotMetadataTestJSON-380074759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.745s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:06:53 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-5dba01f9-c603-4e58-bcac-ed9dc8f1da23 tempest-SnapshotMetadataTestJSON-380074759 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:06:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1525724150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d360ec4d-6d3e-43c3-b7ca-8a1000eb89dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f7c812291d846aaa65dd516fd0b3c87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:06:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:06:53Z,use_quota=True,user_id='6ed960627e8e46baa7426a55d461b0f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)}" {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 15:06:53 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-5dba01f9-c603-4e58-bcac-ed9dc8f1da23 tempest-SnapshotMetadataTestJSON-380074759 None] Creating volume d360ec4d-6d3e-43c3-b7ca-8a1000eb89dd {{(pid=82756) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 15:06:53 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-5dba01f9-c603-4e58-bcac-ed9dc8f1da23 tempest-SnapshotMetadataTestJSON-380074759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:06:53 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-5dba01f9-c603-4e58-bcac-ed9dc8f1da23 tempest-SnapshotMetadataTestJSON-380074759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:06:53 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-5dba01f9-c603-4e58-bcac-ed9dc8f1da23 tempest-SnapshotMetadataTestJSON-380074759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:06:53 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-5dba01f9-c603-4e58-bcac-ed9dc8f1da23 tempest-SnapshotMetadataTestJSON-380074759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:06:53 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-5dba01f9-c603-4e58-bcac-ed9dc8f1da23 tempest-SnapshotMetadataTestJSON-380074759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:06:53 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-5dba01f9-c603-4e58-bcac-ed9dc8f1da23 tempest-SnapshotMetadataTestJSON-380074759 None] Selected osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 as target Quobyte volume. {{(pid=82756) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 15:06:53 devstack cinder-volume[82756]: INFO cinder.volume.drivers.remotefs [None req-5dba01f9-c603-4e58-bcac-ed9dc8f1da23 tempest-SnapshotMetadataTestJSON-380074759 None] casted to osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 Apr 16 15:06:53 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-5dba01f9-c603-4e58-bcac-ed9dc8f1da23 tempest-SnapshotMetadataTestJSON-380074759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-d360ec4d-6d3e-43c3-b7ca-8a1000eb89dd 1073741824 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:06:53 devstack sudo[85582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-d360ec4d-6d3e-43c3-b7ca-8a1000eb89dd 1073741824 Apr 16 15:06:53 devstack sudo[85582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:06:53 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [req-248793ba-b58c-4302-891c-7aa49bae2822 req-24aef58c-4d3e-4287-b8cf-a14540f10a27 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781', 'name': 'volume-203917d0-9fc3-4949-81b0-fe0872b639f0', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5e80d9e5-f970-467a-b155-0357767dbc39', 'enforce_multipath': True} {{(pid=82756) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 16 15:06:53 devstack cinder-volume[82756]: INFO cinder.volume.manager [req-248793ba-b58c-4302-891c-7aa49bae2822 req-24aef58c-4d3e-4287-b8cf-a14540f10a27 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] attachment_update completed successfully. Apr 16 15:06:54 devstack sudo[85582]: pam_unix(sudo:session): session closed for user root Apr 16 15:06:54 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-5dba01f9-c603-4e58-bcac-ed9dc8f1da23 tempest-SnapshotMetadataTestJSON-380074759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-d360ec4d-6d3e-43c3-b7ca-8a1000eb89dd 1073741824" returned: 0 in 0.819s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:06:54 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-5dba01f9-c603-4e58-bcac-ed9dc8f1da23 tempest-SnapshotMetadataTestJSON-380074759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-d360ec4d-6d3e-43c3-b7ca-8a1000eb89dd {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:06:54 devstack sudo[85587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-d360ec4d-6d3e-43c3-b7ca-8a1000eb89dd Apr 16 15:06:54 devstack sudo[85587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:06:55 devstack sudo[85587]: pam_unix(sudo:session): session closed for user root Apr 16 15:06:55 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-5dba01f9-c603-4e58-bcac-ed9dc8f1da23 tempest-SnapshotMetadataTestJSON-380074759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-d360ec4d-6d3e-43c3-b7ca-8a1000eb89dd" returned: 0 in 0.564s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:06:55 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-5dba01f9-c603-4e58-bcac-ed9dc8f1da23 tempest-SnapshotMetadataTestJSON-380074759 None] <== create_volume: return (1418ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'} {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 15:06:55 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-5dba01f9-c603-4e58-bcac-ed9dc8f1da23 tempest-SnapshotMetadataTestJSON-380074759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.422s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:06:55 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-5dba01f9-c603-4e58-bcac-ed9dc8f1da23 tempest-SnapshotMetadataTestJSON-380074759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb9d95fe-668f-4c56-a774-d95215899985) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d360ec4d-6d3e-43c3-b7ca-8a1000eb89dd', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:06:55 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-5dba01f9-c603-4e58-bcac-ed9dc8f1da23 tempest-SnapshotMetadataTestJSON-380074759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b13a7c07-eae0-4e18-adab-f5020f935665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:06:55 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-5dba01f9-c603-4e58-bcac-ed9dc8f1da23 tempest-SnapshotMetadataTestJSON-380074759 None] Volume volume-d360ec4d-6d3e-43c3-b7ca-8a1000eb89dd (d360ec4d-6d3e-43c3-b7ca-8a1000eb89dd): created successfully Apr 16 15:06:55 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-5dba01f9-c603-4e58-bcac-ed9dc8f1da23 tempest-SnapshotMetadataTestJSON-380074759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b13a7c07-eae0-4e18-adab-f5020f935665) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:06:55 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-5dba01f9-c603-4e58-bcac-ed9dc8f1da23 tempest-SnapshotMetadataTestJSON-380074759 None] Flow 'volume_create_manager' (622c08cc-7d70-49c3-8769-71b77bbed656) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:06:55 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-5dba01f9-c603-4e58-bcac-ed9dc8f1da23 tempest-SnapshotMetadataTestJSON-380074759 None] Created volume successfully. Apr 16 15:06:56 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-c12e9100-93a0-413b-9eed-5358488b1123 tempest-SnapshotMetadataTestJSON-380074759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:06:56 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-c12e9100-93a0-413b-9eed-5358488b1123 tempest-SnapshotMetadataTestJSON-380074759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:06:56 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-c12e9100-93a0-413b-9eed-5358488b1123 tempest-SnapshotMetadataTestJSON-380074759 None] Creating offline snapshot b662e123-44af-4695-bd0a-67bd842cb42b of volume d360ec4d-6d3e-43c3-b7ca-8a1000eb89dd {{(pid=82756) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 16 15:06:56 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa860eaf-ec6e-4c29-a72e-82692ad536d3]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:06:56 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-c12e9100-93a0-413b-9eed-5358488b1123 tempest-SnapshotMetadataTestJSON-380074759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-d360ec4d-6d3e-43c3-b7ca-8a1000eb89dd {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:06:56 devstack sudo[85590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-d360ec4d-6d3e-43c3-b7ca-8a1000eb89dd Apr 16 15:06:56 devstack sudo[85590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:06:57 devstack sudo[85590]: pam_unix(sudo:session): session closed for user root Apr 16 15:06:57 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-c12e9100-93a0-413b-9eed-5358488b1123 tempest-SnapshotMetadataTestJSON-380074759 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-d360ec4d-6d3e-43c3-b7ca-8a1000eb89dd" returned: 0 in 0.676s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:06:57 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-c12e9100-93a0-413b-9eed-5358488b1123 tempest-SnapshotMetadataTestJSON-380074759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-d360ec4d-6d3e-43c3-b7ca-8a1000eb89dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-d360ec4d-6d3e-43c3-b7ca-8a1000eb89dd.b662e123-44af-4695-bd0a-67bd842cb42b 1G {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:06:57 devstack sudo[85598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-d360ec4d-6d3e-43c3-b7ca-8a1000eb89dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-d360ec4d-6d3e-43c3-b7ca-8a1000eb89dd.b662e123-44af-4695-bd0a-67bd842cb42b 1G Apr 16 15:06:57 devstack sudo[85598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:06:57 devstack sudo[85598]: pam_unix(sudo:session): session closed for user root Apr 16 15:06:57 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-c12e9100-93a0-413b-9eed-5358488b1123 tempest-SnapshotMetadataTestJSON-380074759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-d360ec4d-6d3e-43c3-b7ca-8a1000eb89dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-d360ec4d-6d3e-43c3-b7ca-8a1000eb89dd.b662e123-44af-4695-bd0a-67bd842cb42b 1G" returned: 0 in 0.774s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:06:57 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-c12e9100-93a0-413b-9eed-5358488b1123 tempest-SnapshotMetadataTestJSON-380074759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d360ec4d-6d3e-43c3-b7ca-8a1000eb89dd -F qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-d360ec4d-6d3e-43c3-b7ca-8a1000eb89dd.b662e123-44af-4695-bd0a-67bd842cb42b {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:06:57 devstack sudo[85603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d360ec4d-6d3e-43c3-b7ca-8a1000eb89dd -F qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-d360ec4d-6d3e-43c3-b7ca-8a1000eb89dd.b662e123-44af-4695-bd0a-67bd842cb42b Apr 16 15:06:57 devstack sudo[85603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:06:58 devstack sudo[85603]: pam_unix(sudo:session): session closed for user root Apr 16 15:06:58 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-c12e9100-93a0-413b-9eed-5358488b1123 tempest-SnapshotMetadataTestJSON-380074759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d360ec4d-6d3e-43c3-b7ca-8a1000eb89dd -F qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-d360ec4d-6d3e-43c3-b7ca-8a1000eb89dd.b662e123-44af-4695-bd0a-67bd842cb42b" returned: 0 in 0.842s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:06:58 devstack cinder-volume[82756]: WARNING cinder.volume.drivers.remotefs [None req-c12e9100-93a0-413b-9eed-5358488b1123 tempest-SnapshotMetadataTestJSON-380074759 None] /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-d360ec4d-6d3e-43c3-b7ca-8a1000eb89dd.b662e123-44af-4695-bd0a-67bd842cb42b is being set with open permissions: ugo+rw Apr 16 15:06:58 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-c12e9100-93a0-413b-9eed-5358488b1123 tempest-SnapshotMetadataTestJSON-380074759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-d360ec4d-6d3e-43c3-b7ca-8a1000eb89dd.b662e123-44af-4695-bd0a-67bd842cb42b {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:06:58 devstack sudo[85633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-d360ec4d-6d3e-43c3-b7ca-8a1000eb89dd.b662e123-44af-4695-bd0a-67bd842cb42b Apr 16 15:06:58 devstack sudo[85633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:06:59 devstack sudo[85633]: pam_unix(sudo:session): session closed for user root Apr 16 15:06:59 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-c12e9100-93a0-413b-9eed-5358488b1123 tempest-SnapshotMetadataTestJSON-380074759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-d360ec4d-6d3e-43c3-b7ca-8a1000eb89dd.b662e123-44af-4695-bd0a-67bd842cb42b" returned: 0 in 0.989s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:06:59 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-c12e9100-93a0-413b-9eed-5358488b1123 tempest-SnapshotMetadataTestJSON-380074759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-d360ec4d-6d3e-43c3-b7ca-8a1000eb89dd.info {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:06:59 devstack sudo[85672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-d360ec4d-6d3e-43c3-b7ca-8a1000eb89dd.info Apr 16 15:06:59 devstack sudo[85672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:06:59 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [None req-97290065-c496-47c7-8033-8245c0b9358b tempest-VolumesServicesTestJSON-2083079276 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82756) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 15:06:59 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-97290065-c496-47c7-8033-8245c0b9358b tempest-VolumesServicesTestJSON-2083079276 None] Flow 'volume_create_manager' (72beca62-5b55-4f6c-bebf-bc382bede0a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:06:59 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-97290065-c496-47c7-8033-8245c0b9358b tempest-VolumesServicesTestJSON-2083079276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e1c0f20-69c7-4c11-9a57-57f407771e45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:06:59 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-97290065-c496-47c7-8033-8245c0b9358b tempest-VolumesServicesTestJSON-2083079276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e1c0f20-69c7-4c11-9a57-57f407771e45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:06:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1605762356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=515b4c81-9764-4802-921d-97b6584b2829,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3ebcb692df14a85b943887423a3101b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:07:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:07:00Z,use_quota=True,user_id='8ff6fbe6836c459aac3d446cb645e219',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:06:59 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-97290065-c496-47c7-8033-8245c0b9358b tempest-VolumesServicesTestJSON-2083079276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c35a2ed-ef95-422b-94ee-8dacf27123d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:06:59 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-97290065-c496-47c7-8033-8245c0b9358b tempest-VolumesServicesTestJSON-2083079276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c35a2ed-ef95-422b-94ee-8dacf27123d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:06:59 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-97290065-c496-47c7-8033-8245c0b9358b tempest-VolumesServicesTestJSON-2083079276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (764c161c-2a98-45a9-a54e-f49816aca697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:06:59 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-97290065-c496-47c7-8033-8245c0b9358b tempest-VolumesServicesTestJSON-2083079276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (764c161c-2a98-45a9-a54e-f49816aca697) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '515b4c81-9764-4802-921d-97b6584b2829', 'volume_name': 'volume-515b4c81-9764-4802-921d-97b6584b2829', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:06:59 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-97290065-c496-47c7-8033-8245c0b9358b tempest-VolumesServicesTestJSON-2083079276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8664c3a1-f712-4e26-a218-7c5e390ea801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:06:59 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-97290065-c496-47c7-8033-8245c0b9358b tempest-VolumesServicesTestJSON-2083079276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8664c3a1-f712-4e26-a218-7c5e390ea801) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:06:59 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-97290065-c496-47c7-8033-8245c0b9358b tempest-VolumesServicesTestJSON-2083079276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f897a3d-6e13-4388-8bc8-cec89cfaa118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:06:59 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-97290065-c496-47c7-8033-8245c0b9358b tempest-VolumesServicesTestJSON-2083079276 None] Volume 515b4c81-9764-4802-921d-97b6584b2829: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-515b4c81-9764-4802-921d-97b6584b2829', 'volume_size': 1} Apr 16 15:06:59 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-97290065-c496-47c7-8033-8245c0b9358b tempest-VolumesServicesTestJSON-2083079276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:07:00 devstack sudo[85672]: pam_unix(sudo:session): session closed for user root Apr 16 15:07:00 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-c12e9100-93a0-413b-9eed-5358488b1123 tempest-SnapshotMetadataTestJSON-380074759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-d360ec4d-6d3e-43c3-b7ca-8a1000eb89dd.info" returned: 0 in 0.644s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:07:00 devstack cinder-volume[82756]: WARNING cinder.volume.drivers.remotefs [None req-c12e9100-93a0-413b-9eed-5358488b1123 tempest-SnapshotMetadataTestJSON-380074759 None] /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-d360ec4d-6d3e-43c3-b7ca-8a1000eb89dd.info is being set with open permissions: ugo+rw Apr 16 15:07:00 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-c12e9100-93a0-413b-9eed-5358488b1123 tempest-SnapshotMetadataTestJSON-380074759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-d360ec4d-6d3e-43c3-b7ca-8a1000eb89dd.info {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:07:00 devstack sudo[85677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-d360ec4d-6d3e-43c3-b7ca-8a1000eb89dd.info Apr 16 15:07:00 devstack sudo[85677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:07:01 devstack sudo[85677]: pam_unix(sudo:session): session closed for user root Apr 16 15:07:01 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-c12e9100-93a0-413b-9eed-5358488b1123 tempest-SnapshotMetadataTestJSON-380074759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-d360ec4d-6d3e-43c3-b7ca-8a1000eb89dd.info" returned: 0 in 0.672s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:07:01 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-c12e9100-93a0-413b-9eed-5358488b1123 tempest-SnapshotMetadataTestJSON-380074759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.701s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:07:01 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-97290065-c496-47c7-8033-8245c0b9358b tempest-VolumesServicesTestJSON-2083079276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.205s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:07:01 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-97290065-c496-47c7-8033-8245c0b9358b tempest-VolumesServicesTestJSON-2083079276 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:06:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1605762356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=515b4c81-9764-4802-921d-97b6584b2829,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3ebcb692df14a85b943887423a3101b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:07:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:07:00Z,use_quota=True,user_id='8ff6fbe6836c459aac3d446cb645e219',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)}" {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 15:07:01 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-97290065-c496-47c7-8033-8245c0b9358b tempest-VolumesServicesTestJSON-2083079276 None] Creating volume 515b4c81-9764-4802-921d-97b6584b2829 {{(pid=82756) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 15:07:01 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-97290065-c496-47c7-8033-8245c0b9358b tempest-VolumesServicesTestJSON-2083079276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:07:01 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-97290065-c496-47c7-8033-8245c0b9358b tempest-VolumesServicesTestJSON-2083079276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:07:01 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-97290065-c496-47c7-8033-8245c0b9358b tempest-VolumesServicesTestJSON-2083079276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:07:01 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-97290065-c496-47c7-8033-8245c0b9358b tempest-VolumesServicesTestJSON-2083079276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:07:01 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-97290065-c496-47c7-8033-8245c0b9358b tempest-VolumesServicesTestJSON-2083079276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:07:01 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-97290065-c496-47c7-8033-8245c0b9358b tempest-VolumesServicesTestJSON-2083079276 None] Selected osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 as target Quobyte volume. {{(pid=82756) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 15:07:01 devstack cinder-volume[82756]: INFO cinder.volume.drivers.remotefs [None req-97290065-c496-47c7-8033-8245c0b9358b tempest-VolumesServicesTestJSON-2083079276 None] casted to osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 Apr 16 15:07:01 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-97290065-c496-47c7-8033-8245c0b9358b tempest-VolumesServicesTestJSON-2083079276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-515b4c81-9764-4802-921d-97b6584b2829 1073741824 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:07:01 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-c12e9100-93a0-413b-9eed-5358488b1123 tempest-SnapshotMetadataTestJSON-380074759 None] Create snapshot completed successfully Apr 16 15:07:01 devstack sudo[85681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-515b4c81-9764-4802-921d-97b6584b2829 1073741824 Apr 16 15:07:01 devstack sudo[85681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:07:02 devstack sudo[85681]: pam_unix(sudo:session): session closed for user root Apr 16 15:07:02 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-97290065-c496-47c7-8033-8245c0b9358b tempest-VolumesServicesTestJSON-2083079276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-515b4c81-9764-4802-921d-97b6584b2829 1073741824" returned: 0 in 1.083s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:07:02 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-97290065-c496-47c7-8033-8245c0b9358b tempest-VolumesServicesTestJSON-2083079276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-515b4c81-9764-4802-921d-97b6584b2829 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:07:02 devstack sudo[85693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-515b4c81-9764-4802-921d-97b6584b2829 Apr 16 15:07:02 devstack sudo[85693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:07:02 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-77974dfd-a6bb-4782-8296-11afe4b614e3 tempest-SnapshotMetadataTestJSON-380074759 None] Acquiring lock "cinder-b662e123-44af-4695-bd0a-67bd842cb42b-delete_snapshot" by "delete_snapshot" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:07:02 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-77974dfd-a6bb-4782-8296-11afe4b614e3 tempest-SnapshotMetadataTestJSON-380074759 None] Lock "cinder-b662e123-44af-4695-bd0a-67bd842cb42b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:07:02 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-77974dfd-a6bb-4782-8296-11afe4b614e3 tempest-SnapshotMetadataTestJSON-380074759 None] Acquiring lock "cinder-quobyte-d360ec4d-6d3e-43c3-b7ca-8a1000eb89dd" by "delete_snapshot" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:07:02 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-77974dfd-a6bb-4782-8296-11afe4b614e3 tempest-SnapshotMetadataTestJSON-380074759 None] Lock "cinder-quobyte-d360ec4d-6d3e-43c3-b7ca-8a1000eb89dd" acquired by "delete_snapshot" :: waited 0.026s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:07:02 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-77974dfd-a6bb-4782-8296-11afe4b614e3 tempest-SnapshotMetadataTestJSON-380074759 None] Acquiring lock "cinder-quobyte-b662e123-44af-4695-bd0a-67bd842cb42b" by "_delete_snapshot" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:07:02 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-77974dfd-a6bb-4782-8296-11afe4b614e3 tempest-SnapshotMetadataTestJSON-380074759 None] Lock "cinder-quobyte-b662e123-44af-4695-bd0a-67bd842cb42b" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:07:02 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-77974dfd-a6bb-4782-8296-11afe4b614e3 tempest-SnapshotMetadataTestJSON-380074759 None] Deleting offline snapshot b662e123-44af-4695-bd0a-67bd842cb42b of volume d360ec4d-6d3e-43c3-b7ca-8a1000eb89dd {{(pid=82756) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 15:07:02 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-77974dfd-a6bb-4782-8296-11afe4b614e3 tempest-SnapshotMetadataTestJSON-380074759 None] snapshot_file for this snap is: volume-d360ec4d-6d3e-43c3-b7ca-8a1000eb89dd.b662e123-44af-4695-bd0a-67bd842cb42b {{(pid=82756) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 15:07:02 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[dff44d0b-b66a-4671-9519-3e087bc3a8c1]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:07:02 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-77974dfd-a6bb-4782-8296-11afe4b614e3 tempest-SnapshotMetadataTestJSON-380074759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-d360ec4d-6d3e-43c3-b7ca-8a1000eb89dd.b662e123-44af-4695-bd0a-67bd842cb42b {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:07:02 devstack sudo[85695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-d360ec4d-6d3e-43c3-b7ca-8a1000eb89dd.b662e123-44af-4695-bd0a-67bd842cb42b Apr 16 15:07:02 devstack sudo[85695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:07:02 devstack sudo[85693]: pam_unix(sudo:session): session closed for user root Apr 16 15:07:02 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-97290065-c496-47c7-8033-8245c0b9358b tempest-VolumesServicesTestJSON-2083079276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-515b4c81-9764-4802-921d-97b6584b2829" returned: 0 in 0.667s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:07:02 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-97290065-c496-47c7-8033-8245c0b9358b tempest-VolumesServicesTestJSON-2083079276 None] <== create_volume: return (1783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'} {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 15:07:02 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-97290065-c496-47c7-8033-8245c0b9358b tempest-VolumesServicesTestJSON-2083079276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.787s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:07:02 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-97290065-c496-47c7-8033-8245c0b9358b tempest-VolumesServicesTestJSON-2083079276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f897a3d-6e13-4388-8bc8-cec89cfaa118) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-515b4c81-9764-4802-921d-97b6584b2829', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:07:02 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-97290065-c496-47c7-8033-8245c0b9358b tempest-VolumesServicesTestJSON-2083079276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b9b9a10-d10d-4a27-9d31-c7d87ed90e6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:07:02 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-97290065-c496-47c7-8033-8245c0b9358b tempest-VolumesServicesTestJSON-2083079276 None] Volume volume-515b4c81-9764-4802-921d-97b6584b2829 (515b4c81-9764-4802-921d-97b6584b2829): created successfully Apr 16 15:07:02 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-97290065-c496-47c7-8033-8245c0b9358b tempest-VolumesServicesTestJSON-2083079276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b9b9a10-d10d-4a27-9d31-c7d87ed90e6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:07:02 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-97290065-c496-47c7-8033-8245c0b9358b tempest-VolumesServicesTestJSON-2083079276 None] Flow 'volume_create_manager' (72beca62-5b55-4f6c-bebf-bc382bede0a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:07:02 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-97290065-c496-47c7-8033-8245c0b9358b tempest-VolumesServicesTestJSON-2083079276 None] Created volume successfully. Apr 16 15:07:03 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-bfea1c6f-b382-4419-912a-bab8df14455a tempest-VolumesServicesTestJSON-2083079276 None] Acquiring lock "cinder-515b4c81-9764-4802-921d-97b6584b2829-delete_volume" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:07:03 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-bfea1c6f-b382-4419-912a-bab8df14455a tempest-VolumesServicesTestJSON-2083079276 None] Lock "cinder-515b4c81-9764-4802-921d-97b6584b2829-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:07:03 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-bfea1c6f-b382-4419-912a-bab8df14455a tempest-VolumesServicesTestJSON-2083079276 None] Acquiring lock "cinder-quobyte-515b4c81-9764-4802-921d-97b6584b2829" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:07:03 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-bfea1c6f-b382-4419-912a-bab8df14455a tempest-VolumesServicesTestJSON-2083079276 None] Lock "cinder-quobyte-515b4c81-9764-4802-921d-97b6584b2829" acquired by "delete_volume" :: waited 0.009s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:07:03 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b4189db-e27c-4208-a25d-74e93341921c]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:07:03 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-bfea1c6f-b382-4419-912a-bab8df14455a tempest-VolumesServicesTestJSON-2083079276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-515b4c81-9764-4802-921d-97b6584b2829 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:07:03 devstack sudo[85700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-515b4c81-9764-4802-921d-97b6584b2829 Apr 16 15:07:03 devstack sudo[85700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:07:03 devstack sudo[85695]: pam_unix(sudo:session): session closed for user root Apr 16 15:07:03 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-77974dfd-a6bb-4782-8296-11afe4b614e3 tempest-SnapshotMetadataTestJSON-380074759 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-d360ec4d-6d3e-43c3-b7ca-8a1000eb89dd.b662e123-44af-4695-bd0a-67bd842cb42b" returned: 0 in 0.886s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:07:03 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-77974dfd-a6bb-4782-8296-11afe4b614e3 tempest-SnapshotMetadataTestJSON-380074759 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d360ec4d-6d3e-43c3-b7ca-8a1000eb89dd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82756) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 15:07:03 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[6abbd15f-fb31-43ac-a310-56a63b818a86]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:07:03 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-77974dfd-a6bb-4782-8296-11afe4b614e3 tempest-SnapshotMetadataTestJSON-380074759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-d360ec4d-6d3e-43c3-b7ca-8a1000eb89dd {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:07:03 devstack sudo[85704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-d360ec4d-6d3e-43c3-b7ca-8a1000eb89dd Apr 16 15:07:03 devstack sudo[85704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:07:03 devstack sudo[85700]: pam_unix(sudo:session): session closed for user root Apr 16 15:07:03 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-bfea1c6f-b382-4419-912a-bab8df14455a tempest-VolumesServicesTestJSON-2083079276 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-515b4c81-9764-4802-921d-97b6584b2829" returned: 0 in 0.672s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:07:03 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-bfea1c6f-b382-4419-912a-bab8df14455a tempest-VolumesServicesTestJSON-2083079276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-515b4c81-9764-4802-921d-97b6584b2829 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:07:03 devstack sudo[85709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-515b4c81-9764-4802-921d-97b6584b2829 Apr 16 15:07:03 devstack sudo[85709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:07:04 devstack sudo[85704]: pam_unix(sudo:session): session closed for user root Apr 16 15:07:04 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-77974dfd-a6bb-4782-8296-11afe4b614e3 tempest-SnapshotMetadataTestJSON-380074759 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-d360ec4d-6d3e-43c3-b7ca-8a1000eb89dd" returned: 0 in 0.719s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:07:04 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-77974dfd-a6bb-4782-8296-11afe4b614e3 tempest-SnapshotMetadataTestJSON-380074759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-d360ec4d-6d3e-43c3-b7ca-8a1000eb89dd.b662e123-44af-4695-bd0a-67bd842cb42b {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:07:04 devstack sudo[85714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-d360ec4d-6d3e-43c3-b7ca-8a1000eb89dd.b662e123-44af-4695-bd0a-67bd842cb42b Apr 16 15:07:04 devstack sudo[85714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:07:04 devstack sudo[85709]: pam_unix(sudo:session): session closed for user root Apr 16 15:07:04 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-bfea1c6f-b382-4419-912a-bab8df14455a tempest-VolumesServicesTestJSON-2083079276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-515b4c81-9764-4802-921d-97b6584b2829" returned: 0 in 0.464s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:07:04 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-bfea1c6f-b382-4419-912a-bab8df14455a tempest-VolumesServicesTestJSON-2083079276 None] Lock "cinder-quobyte-515b4c81-9764-4802-921d-97b6584b2829" released by "delete_volume" :: held 1.160s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:07:04 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-bfea1c6f-b382-4419-912a-bab8df14455a tempest-VolumesServicesTestJSON-2083079276 None] Created reservations ['32df107d-5edf-40ca-85b5-a7da2071932a', '8133e400-b7fc-42b3-82f9-6498e85fcfdb', 'ed23e16a-29c2-4b40-a7e6-7618317c4703', '20888267-05ee-4d4f-8ca0-dc1b233158f5'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:07:04 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-bfea1c6f-b382-4419-912a-bab8df14455a tempest-VolumesServicesTestJSON-2083079276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:07:04 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-bfea1c6f-b382-4419-912a-bab8df14455a tempest-VolumesServicesTestJSON-2083079276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:07:04 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-bfea1c6f-b382-4419-912a-bab8df14455a tempest-VolumesServicesTestJSON-2083079276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:07:04 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-bfea1c6f-b382-4419-912a-bab8df14455a tempest-VolumesServicesTestJSON-2083079276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:07:04 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-bfea1c6f-b382-4419-912a-bab8df14455a tempest-VolumesServicesTestJSON-2083079276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:07:04 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-bfea1c6f-b382-4419-912a-bab8df14455a tempest-VolumesServicesTestJSON-2083079276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:07:04 devstack sudo[85717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:07:04 devstack sudo[85717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:07:04 devstack sudo[85714]: pam_unix(sudo:session): session closed for user root Apr 16 15:07:04 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-77974dfd-a6bb-4782-8296-11afe4b614e3 tempest-SnapshotMetadataTestJSON-380074759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-d360ec4d-6d3e-43c3-b7ca-8a1000eb89dd.b662e123-44af-4695-bd0a-67bd842cb42b" returned: 0 in 0.721s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:07:04 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-77974dfd-a6bb-4782-8296-11afe4b614e3 tempest-SnapshotMetadataTestJSON-380074759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-d360ec4d-6d3e-43c3-b7ca-8a1000eb89dd.b662e123-44af-4695-bd0a-67bd842cb42b {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:07:04 devstack sudo[85722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-d360ec4d-6d3e-43c3-b7ca-8a1000eb89dd.b662e123-44af-4695-bd0a-67bd842cb42b Apr 16 15:07:04 devstack sudo[85722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:07:05 devstack sudo[85717]: pam_unix(sudo:session): session closed for user root Apr 16 15:07:05 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-bfea1c6f-b382-4419-912a-bab8df14455a tempest-VolumesServicesTestJSON-2083079276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.584s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:07:05 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-bfea1c6f-b382-4419-912a-bab8df14455a tempest-VolumesServicesTestJSON-2083079276 None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:07:05 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-bfea1c6f-b382-4419-912a-bab8df14455a tempest-VolumesServicesTestJSON-2083079276 None] Deleted volume successfully. Apr 16 15:07:05 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-bfea1c6f-b382-4419-912a-bab8df14455a tempest-VolumesServicesTestJSON-2083079276 None] Lock "cinder-515b4c81-9764-4802-921d-97b6584b2829-delete_volume" released by "delete_volume" :: held 1.937s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:07:05 devstack sudo[85722]: pam_unix(sudo:session): session closed for user root Apr 16 15:07:05 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-77974dfd-a6bb-4782-8296-11afe4b614e3 tempest-SnapshotMetadataTestJSON-380074759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-d360ec4d-6d3e-43c3-b7ca-8a1000eb89dd.b662e123-44af-4695-bd0a-67bd842cb42b" returned: 0 in 0.557s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:07:05 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-77974dfd-a6bb-4782-8296-11afe4b614e3 tempest-SnapshotMetadataTestJSON-380074759 None] Lock "cinder-quobyte-b662e123-44af-4695-bd0a-67bd842cb42b" released by "_delete_snapshot" :: held 2.996s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:07:05 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-77974dfd-a6bb-4782-8296-11afe4b614e3 tempest-SnapshotMetadataTestJSON-380074759 None] Lock "cinder-quobyte-d360ec4d-6d3e-43c3-b7ca-8a1000eb89dd" released by "delete_snapshot" :: held 3.013s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:07:05 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-77974dfd-a6bb-4782-8296-11afe4b614e3 tempest-SnapshotMetadataTestJSON-380074759 None] Created reservations ['e25ae4b9-96fb-4076-903f-fa8149664293', 'ede3c198-8e9d-494b-8aa5-475dc5ac3961', 'adca3364-7f6b-4a8e-b96d-457266a62d5d', '8fa2d606-e2d1-48ce-bb86-6f31a7653f1f'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:07:05 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-77974dfd-a6bb-4782-8296-11afe4b614e3 tempest-SnapshotMetadataTestJSON-380074759 None] Delete snapshot completed successfully. Apr 16 15:07:05 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-77974dfd-a6bb-4782-8296-11afe4b614e3 tempest-SnapshotMetadataTestJSON-380074759 None] Lock "cinder-b662e123-44af-4695-bd0a-67bd842cb42b-delete_snapshot" released by "delete_snapshot" :: held 3.131s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:07:05 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-6f1f3eac-e25a-4609-b45b-11b5c0296069 tempest-SnapshotMetadataTestJSON-380074759 None] Acquiring lock "cinder-d360ec4d-6d3e-43c3-b7ca-8a1000eb89dd-delete_volume" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:07:05 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-6f1f3eac-e25a-4609-b45b-11b5c0296069 tempest-SnapshotMetadataTestJSON-380074759 None] Lock "cinder-d360ec4d-6d3e-43c3-b7ca-8a1000eb89dd-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:07:05 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-6f1f3eac-e25a-4609-b45b-11b5c0296069 tempest-SnapshotMetadataTestJSON-380074759 None] Acquiring lock "cinder-quobyte-d360ec4d-6d3e-43c3-b7ca-8a1000eb89dd" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:07:05 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-6f1f3eac-e25a-4609-b45b-11b5c0296069 tempest-SnapshotMetadataTestJSON-380074759 None] Lock "cinder-quobyte-d360ec4d-6d3e-43c3-b7ca-8a1000eb89dd" acquired by "delete_volume" :: waited 0.009s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:07:05 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddaa6155-f764-41ad-8f4e-c920b64a2acb]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:07:05 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-6f1f3eac-e25a-4609-b45b-11b5c0296069 tempest-SnapshotMetadataTestJSON-380074759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-d360ec4d-6d3e-43c3-b7ca-8a1000eb89dd {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:07:05 devstack sudo[85750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-d360ec4d-6d3e-43c3-b7ca-8a1000eb89dd Apr 16 15:07:05 devstack sudo[85750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:07:06 devstack sudo[85750]: pam_unix(sudo:session): session closed for user root Apr 16 15:07:06 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-6f1f3eac-e25a-4609-b45b-11b5c0296069 tempest-SnapshotMetadataTestJSON-380074759 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-d360ec4d-6d3e-43c3-b7ca-8a1000eb89dd" returned: 0 in 0.556s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:07:06 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-6f1f3eac-e25a-4609-b45b-11b5c0296069 tempest-SnapshotMetadataTestJSON-380074759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-d360ec4d-6d3e-43c3-b7ca-8a1000eb89dd {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:07:06 devstack sudo[85755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-d360ec4d-6d3e-43c3-b7ca-8a1000eb89dd Apr 16 15:07:06 devstack sudo[85755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:07:06 devstack sudo[85755]: pam_unix(sudo:session): session closed for user root Apr 16 15:07:06 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-6f1f3eac-e25a-4609-b45b-11b5c0296069 tempest-SnapshotMetadataTestJSON-380074759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-d360ec4d-6d3e-43c3-b7ca-8a1000eb89dd" returned: 0 in 0.605s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:07:06 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-6f1f3eac-e25a-4609-b45b-11b5c0296069 tempest-SnapshotMetadataTestJSON-380074759 None] Lock "cinder-quobyte-d360ec4d-6d3e-43c3-b7ca-8a1000eb89dd" released by "delete_volume" :: held 1.201s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:07:07 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-6f1f3eac-e25a-4609-b45b-11b5c0296069 tempest-SnapshotMetadataTestJSON-380074759 None] Created reservations ['aff7e4e1-b2f0-4836-b9af-291346432dea', 'cf097977-bd43-4116-ae93-60edd783fc2d', 'fe710fda-17a3-4bd6-8529-ff5806002033', 'a5899ddf-dfe8-4b49-a16b-2556fac5bcfb'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:07:07 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-6f1f3eac-e25a-4609-b45b-11b5c0296069 tempest-SnapshotMetadataTestJSON-380074759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:07:07 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-6f1f3eac-e25a-4609-b45b-11b5c0296069 tempest-SnapshotMetadataTestJSON-380074759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:07:07 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-6f1f3eac-e25a-4609-b45b-11b5c0296069 tempest-SnapshotMetadataTestJSON-380074759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:07:07 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-6f1f3eac-e25a-4609-b45b-11b5c0296069 tempest-SnapshotMetadataTestJSON-380074759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:07:07 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-6f1f3eac-e25a-4609-b45b-11b5c0296069 tempest-SnapshotMetadataTestJSON-380074759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:07:07 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-6f1f3eac-e25a-4609-b45b-11b5c0296069 tempest-SnapshotMetadataTestJSON-380074759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:07:07 devstack sudo[85765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:07:07 devstack sudo[85765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:07:07 devstack sudo[85765]: pam_unix(sudo:session): session closed for user root Apr 16 15:07:07 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-6f1f3eac-e25a-4609-b45b-11b5c0296069 tempest-SnapshotMetadataTestJSON-380074759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.581s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:07:07 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-6f1f3eac-e25a-4609-b45b-11b5c0296069 tempest-SnapshotMetadataTestJSON-380074759 None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:07:07 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-6f1f3eac-e25a-4609-b45b-11b5c0296069 tempest-SnapshotMetadataTestJSON-380074759 None] Deleted volume successfully. Apr 16 15:07:07 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-6f1f3eac-e25a-4609-b45b-11b5c0296069 tempest-SnapshotMetadataTestJSON-380074759 None] Lock "cinder-d360ec4d-6d3e-43c3-b7ca-8a1000eb89dd-delete_volume" released by "delete_volume" :: held 1.939s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:07:09 devstack cinder-volume[82756]: DEBUG dbcounter [-] [82756] Writing DB stats cinder:SELECT=129,cinder:UPDATE=142,cinder:INSERT=45,cinder:DELETE=5 {{(pid=82756) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 15:07:09 devstack cinder-volume[82756]: DEBUG dbcounter [-] [82756] Writing DB stats cinder:SELECT=145,cinder:UPDATE=147,cinder:INSERT=45,cinder:DELETE=10 {{(pid=82756) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 15:07:09 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [None req-df0c9c9a-ba1d-4cf6-8762-b883831f017e tempest-VolumeSnapshotQuotasNegativeTestJSON-676884634 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82756) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 15:07:09 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-df0c9c9a-ba1d-4cf6-8762-b883831f017e tempest-VolumeSnapshotQuotasNegativeTestJSON-676884634 None] Flow 'volume_create_manager' (091456ce-7050-493a-96a2-92b3109fe2d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:07:09 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-df0c9c9a-ba1d-4cf6-8762-b883831f017e tempest-VolumeSnapshotQuotasNegativeTestJSON-676884634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cbfc630-0737-4cc4-81a6-d5d3bd739a96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:07:09 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-df0c9c9a-ba1d-4cf6-8762-b883831f017e tempest-VolumeSnapshotQuotasNegativeTestJSON-676884634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cbfc630-0737-4cc4-81a6-d5d3bd739a96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:07:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1046206920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa3793ca-d686-430b-bce8-9224109d425b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fb1c466db234616ab7c848371cb6cbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:07:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:07:09Z,use_quota=True,user_id='6bee6969d54e41678f3663d3b7b33447',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:07:09 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-df0c9c9a-ba1d-4cf6-8762-b883831f017e tempest-VolumeSnapshotQuotasNegativeTestJSON-676884634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74398a07-f371-4310-ba72-7885ef6f2c35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:07:09 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-df0c9c9a-ba1d-4cf6-8762-b883831f017e tempest-VolumeSnapshotQuotasNegativeTestJSON-676884634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74398a07-f371-4310-ba72-7885ef6f2c35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:07:09 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-df0c9c9a-ba1d-4cf6-8762-b883831f017e tempest-VolumeSnapshotQuotasNegativeTestJSON-676884634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (833eed94-11d9-4f74-b5af-67c40a4d25a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:07:09 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-df0c9c9a-ba1d-4cf6-8762-b883831f017e tempest-VolumeSnapshotQuotasNegativeTestJSON-676884634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (833eed94-11d9-4f74-b5af-67c40a4d25a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa3793ca-d686-430b-bce8-9224109d425b', 'volume_name': 'volume-fa3793ca-d686-430b-bce8-9224109d425b', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:07:09 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-df0c9c9a-ba1d-4cf6-8762-b883831f017e tempest-VolumeSnapshotQuotasNegativeTestJSON-676884634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7255b930-0916-491b-861b-a8fc0841d263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:07:09 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-df0c9c9a-ba1d-4cf6-8762-b883831f017e tempest-VolumeSnapshotQuotasNegativeTestJSON-676884634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7255b930-0916-491b-861b-a8fc0841d263) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:07:09 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-df0c9c9a-ba1d-4cf6-8762-b883831f017e tempest-VolumeSnapshotQuotasNegativeTestJSON-676884634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cd3559e-c268-4383-a4b9-aee33f50560c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:07:09 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-df0c9c9a-ba1d-4cf6-8762-b883831f017e tempest-VolumeSnapshotQuotasNegativeTestJSON-676884634 None] Volume fa3793ca-d686-430b-bce8-9224109d425b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa3793ca-d686-430b-bce8-9224109d425b', 'volume_size': 1} Apr 16 15:07:09 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-df0c9c9a-ba1d-4cf6-8762-b883831f017e tempest-VolumeSnapshotQuotasNegativeTestJSON-676884634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:07:09 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-df0c9c9a-ba1d-4cf6-8762-b883831f017e tempest-VolumeSnapshotQuotasNegativeTestJSON-676884634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:07:09 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-df0c9c9a-ba1d-4cf6-8762-b883831f017e tempest-VolumeSnapshotQuotasNegativeTestJSON-676884634 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:07:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1046206920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa3793ca-d686-430b-bce8-9224109d425b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fb1c466db234616ab7c848371cb6cbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:07:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:07:09Z,use_quota=True,user_id='6bee6969d54e41678f3663d3b7b33447',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)}" {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 15:07:09 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-df0c9c9a-ba1d-4cf6-8762-b883831f017e tempest-VolumeSnapshotQuotasNegativeTestJSON-676884634 None] Creating volume fa3793ca-d686-430b-bce8-9224109d425b {{(pid=82756) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 15:07:09 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-df0c9c9a-ba1d-4cf6-8762-b883831f017e tempest-VolumeSnapshotQuotasNegativeTestJSON-676884634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:07:09 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-df0c9c9a-ba1d-4cf6-8762-b883831f017e tempest-VolumeSnapshotQuotasNegativeTestJSON-676884634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:07:09 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-df0c9c9a-ba1d-4cf6-8762-b883831f017e tempest-VolumeSnapshotQuotasNegativeTestJSON-676884634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:07:09 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-df0c9c9a-ba1d-4cf6-8762-b883831f017e tempest-VolumeSnapshotQuotasNegativeTestJSON-676884634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:07:09 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-df0c9c9a-ba1d-4cf6-8762-b883831f017e tempest-VolumeSnapshotQuotasNegativeTestJSON-676884634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:07:09 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-df0c9c9a-ba1d-4cf6-8762-b883831f017e tempest-VolumeSnapshotQuotasNegativeTestJSON-676884634 None] Selected osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 as target Quobyte volume. {{(pid=82756) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 15:07:09 devstack cinder-volume[82756]: INFO cinder.volume.drivers.remotefs [None req-df0c9c9a-ba1d-4cf6-8762-b883831f017e tempest-VolumeSnapshotQuotasNegativeTestJSON-676884634 None] casted to osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 Apr 16 15:07:09 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-df0c9c9a-ba1d-4cf6-8762-b883831f017e tempest-VolumeSnapshotQuotasNegativeTestJSON-676884634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-fa3793ca-d686-430b-bce8-9224109d425b 1073741824 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:07:09 devstack sudo[85778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-fa3793ca-d686-430b-bce8-9224109d425b 1073741824 Apr 16 15:07:09 devstack sudo[85778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:07:10 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [None req-592721d3-870e-4b51-b08e-d770d41d6e63 tempest-VolumesDeleteCascade-1685423249 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82756) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 15:07:10 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-592721d3-870e-4b51-b08e-d770d41d6e63 tempest-VolumesDeleteCascade-1685423249 None] Flow 'volume_create_manager' (6d15dd3d-1adc-4bc7-b14c-e3b4bac27453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:07:10 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-592721d3-870e-4b51-b08e-d770d41d6e63 tempest-VolumesDeleteCascade-1685423249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8987ee8c-7b0e-4a63-b965-c9e4c3287ea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:07:10 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-592721d3-870e-4b51-b08e-d770d41d6e63 tempest-VolumesDeleteCascade-1685423249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8987ee8c-7b0e-4a63-b965-c9e4c3287ea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:07:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2015898601',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c094148b-93da-4fb4-98a0-02d6209cbae2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ca70da607504e9b9bdcfc1193b266be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:07:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:07:10Z,use_quota=True,user_id='f6ed217abc8e463a91e2dc03ed09aa03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:07:10 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-592721d3-870e-4b51-b08e-d770d41d6e63 tempest-VolumesDeleteCascade-1685423249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54a3f382-e9dd-458e-b7f4-be8f8c38d474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:07:10 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-592721d3-870e-4b51-b08e-d770d41d6e63 tempest-VolumesDeleteCascade-1685423249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54a3f382-e9dd-458e-b7f4-be8f8c38d474) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:07:10 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-592721d3-870e-4b51-b08e-d770d41d6e63 tempest-VolumesDeleteCascade-1685423249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44b1c1c2-b134-47e3-928c-e26fab78c4e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:07:10 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-592721d3-870e-4b51-b08e-d770d41d6e63 tempest-VolumesDeleteCascade-1685423249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44b1c1c2-b134-47e3-928c-e26fab78c4e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c094148b-93da-4fb4-98a0-02d6209cbae2', 'volume_name': 'volume-c094148b-93da-4fb4-98a0-02d6209cbae2', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:07:10 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-592721d3-870e-4b51-b08e-d770d41d6e63 tempest-VolumesDeleteCascade-1685423249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7449ab4f-b0c6-45ad-aac8-79b27e595a32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:07:10 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-592721d3-870e-4b51-b08e-d770d41d6e63 tempest-VolumesDeleteCascade-1685423249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7449ab4f-b0c6-45ad-aac8-79b27e595a32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:07:10 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-592721d3-870e-4b51-b08e-d770d41d6e63 tempest-VolumesDeleteCascade-1685423249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (842ec8a3-e5a7-42ef-a54f-74a0ebeed07f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:07:10 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-592721d3-870e-4b51-b08e-d770d41d6e63 tempest-VolumesDeleteCascade-1685423249 None] Volume c094148b-93da-4fb4-98a0-02d6209cbae2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c094148b-93da-4fb4-98a0-02d6209cbae2', 'volume_size': 1} Apr 16 15:07:10 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-592721d3-870e-4b51-b08e-d770d41d6e63 tempest-VolumesDeleteCascade-1685423249 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:07:10 devstack sudo[85778]: pam_unix(sudo:session): session closed for user root Apr 16 15:07:10 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-df0c9c9a-ba1d-4cf6-8762-b883831f017e tempest-VolumeSnapshotQuotasNegativeTestJSON-676884634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-fa3793ca-d686-430b-bce8-9224109d425b 1073741824" returned: 0 in 0.739s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:07:10 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-df0c9c9a-ba1d-4cf6-8762-b883831f017e tempest-VolumeSnapshotQuotasNegativeTestJSON-676884634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-fa3793ca-d686-430b-bce8-9224109d425b {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:07:10 devstack sudo[85784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-fa3793ca-d686-430b-bce8-9224109d425b Apr 16 15:07:10 devstack sudo[85784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:07:10 devstack sudo[85784]: pam_unix(sudo:session): session closed for user root Apr 16 15:07:10 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-df0c9c9a-ba1d-4cf6-8762-b883831f017e tempest-VolumeSnapshotQuotasNegativeTestJSON-676884634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-fa3793ca-d686-430b-bce8-9224109d425b" returned: 0 in 0.450s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:07:10 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-df0c9c9a-ba1d-4cf6-8762-b883831f017e tempest-VolumeSnapshotQuotasNegativeTestJSON-676884634 None] <== create_volume: return (1211ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'} {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 15:07:10 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-df0c9c9a-ba1d-4cf6-8762-b883831f017e tempest-VolumeSnapshotQuotasNegativeTestJSON-676884634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.213s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:07:10 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-592721d3-870e-4b51-b08e-d770d41d6e63 tempest-VolumesDeleteCascade-1685423249 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.492s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:07:10 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-592721d3-870e-4b51-b08e-d770d41d6e63 tempest-VolumesDeleteCascade-1685423249 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:07:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2015898601',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c094148b-93da-4fb4-98a0-02d6209cbae2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ca70da607504e9b9bdcfc1193b266be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:07:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:07:10Z,use_quota=True,user_id='f6ed217abc8e463a91e2dc03ed09aa03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)}" {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 15:07:10 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-592721d3-870e-4b51-b08e-d770d41d6e63 tempest-VolumesDeleteCascade-1685423249 None] Creating volume c094148b-93da-4fb4-98a0-02d6209cbae2 {{(pid=82756) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 15:07:10 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-592721d3-870e-4b51-b08e-d770d41d6e63 tempest-VolumesDeleteCascade-1685423249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:07:10 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-592721d3-870e-4b51-b08e-d770d41d6e63 tempest-VolumesDeleteCascade-1685423249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:07:10 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-592721d3-870e-4b51-b08e-d770d41d6e63 tempest-VolumesDeleteCascade-1685423249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:07:10 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-592721d3-870e-4b51-b08e-d770d41d6e63 tempest-VolumesDeleteCascade-1685423249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:07:10 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-592721d3-870e-4b51-b08e-d770d41d6e63 tempest-VolumesDeleteCascade-1685423249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:07:10 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-592721d3-870e-4b51-b08e-d770d41d6e63 tempest-VolumesDeleteCascade-1685423249 None] Selected osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 as target Quobyte volume. {{(pid=82756) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 15:07:10 devstack cinder-volume[82756]: INFO cinder.volume.drivers.remotefs [None req-592721d3-870e-4b51-b08e-d770d41d6e63 tempest-VolumesDeleteCascade-1685423249 None] casted to osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 Apr 16 15:07:10 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-592721d3-870e-4b51-b08e-d770d41d6e63 tempest-VolumesDeleteCascade-1685423249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c094148b-93da-4fb4-98a0-02d6209cbae2 1073741824 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:07:10 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-df0c9c9a-ba1d-4cf6-8762-b883831f017e tempest-VolumeSnapshotQuotasNegativeTestJSON-676884634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cd3559e-c268-4383-a4b9-aee33f50560c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa3793ca-d686-430b-bce8-9224109d425b', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:07:10 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-df0c9c9a-ba1d-4cf6-8762-b883831f017e tempest-VolumeSnapshotQuotasNegativeTestJSON-676884634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ffd93aa-3e28-4c5a-b6a6-0a979a074ef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:07:10 devstack sudo[85787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c094148b-93da-4fb4-98a0-02d6209cbae2 1073741824 Apr 16 15:07:10 devstack sudo[85787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:07:10 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-df0c9c9a-ba1d-4cf6-8762-b883831f017e tempest-VolumeSnapshotQuotasNegativeTestJSON-676884634 None] Volume volume-fa3793ca-d686-430b-bce8-9224109d425b (fa3793ca-d686-430b-bce8-9224109d425b): created successfully Apr 16 15:07:10 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-df0c9c9a-ba1d-4cf6-8762-b883831f017e tempest-VolumeSnapshotQuotasNegativeTestJSON-676884634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ffd93aa-3e28-4c5a-b6a6-0a979a074ef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:07:10 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-df0c9c9a-ba1d-4cf6-8762-b883831f017e tempest-VolumeSnapshotQuotasNegativeTestJSON-676884634 None] Flow 'volume_create_manager' (091456ce-7050-493a-96a2-92b3109fe2d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:07:10 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-df0c9c9a-ba1d-4cf6-8762-b883831f017e tempest-VolumeSnapshotQuotasNegativeTestJSON-676884634 None] Created volume successfully. Apr 16 15:07:11 devstack sudo[85787]: pam_unix(sudo:session): session closed for user root Apr 16 15:07:11 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-592721d3-870e-4b51-b08e-d770d41d6e63 tempest-VolumesDeleteCascade-1685423249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c094148b-93da-4fb4-98a0-02d6209cbae2 1073741824" returned: 0 in 0.582s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:07:11 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-592721d3-870e-4b51-b08e-d770d41d6e63 tempest-VolumesDeleteCascade-1685423249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c094148b-93da-4fb4-98a0-02d6209cbae2 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:07:11 devstack sudo[85796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c094148b-93da-4fb4-98a0-02d6209cbae2 Apr 16 15:07:11 devstack sudo[85796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:07:11 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-c2fef812-69bb-48d6-9b10-30395b925621 tempest-VolumeSnapshotQuotasNegativeTestJSON-676884634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:07:12 devstack sudo[85796]: pam_unix(sudo:session): session closed for user root Apr 16 15:07:12 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-592721d3-870e-4b51-b08e-d770d41d6e63 tempest-VolumesDeleteCascade-1685423249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c094148b-93da-4fb4-98a0-02d6209cbae2" returned: 0 in 0.782s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:07:12 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-592721d3-870e-4b51-b08e-d770d41d6e63 tempest-VolumesDeleteCascade-1685423249 None] <== create_volume: return (1389ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'} {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 15:07:12 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-592721d3-870e-4b51-b08e-d770d41d6e63 tempest-VolumesDeleteCascade-1685423249 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.392s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:07:12 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-c2fef812-69bb-48d6-9b10-30395b925621 tempest-VolumeSnapshotQuotasNegativeTestJSON-676884634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.278s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:07:12 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-c2fef812-69bb-48d6-9b10-30395b925621 tempest-VolumeSnapshotQuotasNegativeTestJSON-676884634 None] Creating offline snapshot b7a4b530-ef91-4b15-b5ba-8b366db77aad of volume fa3793ca-d686-430b-bce8-9224109d425b {{(pid=82756) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 16 15:07:12 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-592721d3-870e-4b51-b08e-d770d41d6e63 tempest-VolumesDeleteCascade-1685423249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (842ec8a3-e5a7-42ef-a54f-74a0ebeed07f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c094148b-93da-4fb4-98a0-02d6209cbae2', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:07:12 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-592721d3-870e-4b51-b08e-d770d41d6e63 tempest-VolumesDeleteCascade-1685423249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb03d20c-9e48-4f52-b9a6-b3b9f693d90f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:07:12 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[02274369-8c16-4b21-acfa-ee7eedef8146]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:07:12 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-c2fef812-69bb-48d6-9b10-30395b925621 tempest-VolumeSnapshotQuotasNegativeTestJSON-676884634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-fa3793ca-d686-430b-bce8-9224109d425b {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:07:12 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-592721d3-870e-4b51-b08e-d770d41d6e63 tempest-VolumesDeleteCascade-1685423249 None] Volume volume-c094148b-93da-4fb4-98a0-02d6209cbae2 (c094148b-93da-4fb4-98a0-02d6209cbae2): created successfully Apr 16 15:07:12 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-592721d3-870e-4b51-b08e-d770d41d6e63 tempest-VolumesDeleteCascade-1685423249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb03d20c-9e48-4f52-b9a6-b3b9f693d90f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:07:12 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-592721d3-870e-4b51-b08e-d770d41d6e63 tempest-VolumesDeleteCascade-1685423249 None] Flow 'volume_create_manager' (6d15dd3d-1adc-4bc7-b14c-e3b4bac27453) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:07:12 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-592721d3-870e-4b51-b08e-d770d41d6e63 tempest-VolumesDeleteCascade-1685423249 None] Created volume successfully. Apr 16 15:07:12 devstack sudo[85824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-fa3793ca-d686-430b-bce8-9224109d425b Apr 16 15:07:12 devstack sudo[85824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:07:12 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [None req-822d2be9-1dc6-4c08-8aab-e8b6bb97dada tempest-VolumesTransfersV355Test-1747303235 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82756) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 15:07:12 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-822d2be9-1dc6-4c08-8aab-e8b6bb97dada tempest-VolumesTransfersV355Test-1747303235 None] Flow 'volume_create_manager' (59fc7633-317c-4181-b17b-c89d8f4570f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:07:12 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-822d2be9-1dc6-4c08-8aab-e8b6bb97dada tempest-VolumesTransfersV355Test-1747303235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62f56f6c-ece0-4205-924a-3462163faace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:07:12 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-822d2be9-1dc6-4c08-8aab-e8b6bb97dada tempest-VolumesTransfersV355Test-1747303235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62f56f6c-ece0-4205-924a-3462163faace) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:07:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1085425132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36c05056-fb8c-4036-b2e2-9eb36452853d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1af277c948a44872b99ed104afaa5cb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:07:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:07:12Z,use_quota=True,user_id='a7034d789cf64420966cbbd006bec2f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:07:12 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-822d2be9-1dc6-4c08-8aab-e8b6bb97dada tempest-VolumesTransfersV355Test-1747303235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1b92ff9-fe19-452e-9256-140641fc80d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:07:12 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-822d2be9-1dc6-4c08-8aab-e8b6bb97dada tempest-VolumesTransfersV355Test-1747303235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1b92ff9-fe19-452e-9256-140641fc80d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:07:12 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-822d2be9-1dc6-4c08-8aab-e8b6bb97dada tempest-VolumesTransfersV355Test-1747303235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32e46b88-cad6-42a9-a868-e9274594ac2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:07:12 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-822d2be9-1dc6-4c08-8aab-e8b6bb97dada tempest-VolumesTransfersV355Test-1747303235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32e46b88-cad6-42a9-a868-e9274594ac2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36c05056-fb8c-4036-b2e2-9eb36452853d', 'volume_name': 'volume-36c05056-fb8c-4036-b2e2-9eb36452853d', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:07:12 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-822d2be9-1dc6-4c08-8aab-e8b6bb97dada tempest-VolumesTransfersV355Test-1747303235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7670c63f-4c43-4ee2-a3ca-455c14d7cee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:07:12 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-822d2be9-1dc6-4c08-8aab-e8b6bb97dada tempest-VolumesTransfersV355Test-1747303235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7670c63f-4c43-4ee2-a3ca-455c14d7cee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:07:12 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-822d2be9-1dc6-4c08-8aab-e8b6bb97dada tempest-VolumesTransfersV355Test-1747303235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cd96d6e-83e9-48e5-bd90-1223b2e2ab08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:07:12 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-822d2be9-1dc6-4c08-8aab-e8b6bb97dada tempest-VolumesTransfersV355Test-1747303235 None] Volume 36c05056-fb8c-4036-b2e2-9eb36452853d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36c05056-fb8c-4036-b2e2-9eb36452853d', 'volume_size': 1} Apr 16 15:07:12 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-822d2be9-1dc6-4c08-8aab-e8b6bb97dada tempest-VolumesTransfersV355Test-1747303235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:07:12 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-4c2c679d-636e-41c1-aecd-05b2c0765692 tempest-VolumesDeleteCascade-1685423249 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:07:12 devstack sudo[85824]: pam_unix(sudo:session): session closed for user root Apr 16 15:07:12 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-c2fef812-69bb-48d6-9b10-30395b925621 tempest-VolumeSnapshotQuotasNegativeTestJSON-676884634 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-fa3793ca-d686-430b-bce8-9224109d425b" returned: 0 in 0.689s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:07:12 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-c2fef812-69bb-48d6-9b10-30395b925621 tempest-VolumeSnapshotQuotasNegativeTestJSON-676884634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-fa3793ca-d686-430b-bce8-9224109d425b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-fa3793ca-d686-430b-bce8-9224109d425b.b7a4b530-ef91-4b15-b5ba-8b366db77aad 1G {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:07:12 devstack sudo[85830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-fa3793ca-d686-430b-bce8-9224109d425b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-fa3793ca-d686-430b-bce8-9224109d425b.b7a4b530-ef91-4b15-b5ba-8b366db77aad 1G Apr 16 15:07:12 devstack sudo[85830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:07:13 devstack sudo[85830]: pam_unix(sudo:session): session closed for user root Apr 16 15:07:13 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-c2fef812-69bb-48d6-9b10-30395b925621 tempest-VolumeSnapshotQuotasNegativeTestJSON-676884634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-fa3793ca-d686-430b-bce8-9224109d425b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-fa3793ca-d686-430b-bce8-9224109d425b.b7a4b530-ef91-4b15-b5ba-8b366db77aad 1G" returned: 0 in 0.569s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:07:13 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-c2fef812-69bb-48d6-9b10-30395b925621 tempest-VolumeSnapshotQuotasNegativeTestJSON-676884634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa3793ca-d686-430b-bce8-9224109d425b -F qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-fa3793ca-d686-430b-bce8-9224109d425b.b7a4b530-ef91-4b15-b5ba-8b366db77aad {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:07:13 devstack sudo[85836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa3793ca-d686-430b-bce8-9224109d425b -F qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-fa3793ca-d686-430b-bce8-9224109d425b.b7a4b530-ef91-4b15-b5ba-8b366db77aad Apr 16 15:07:13 devstack sudo[85836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:07:14 devstack sudo[85836]: pam_unix(sudo:session): session closed for user root Apr 16 15:07:14 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-c2fef812-69bb-48d6-9b10-30395b925621 tempest-VolumeSnapshotQuotasNegativeTestJSON-676884634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa3793ca-d686-430b-bce8-9224109d425b -F qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-fa3793ca-d686-430b-bce8-9224109d425b.b7a4b530-ef91-4b15-b5ba-8b366db77aad" returned: 0 in 0.543s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:07:14 devstack cinder-volume[82756]: WARNING cinder.volume.drivers.remotefs [None req-c2fef812-69bb-48d6-9b10-30395b925621 tempest-VolumeSnapshotQuotasNegativeTestJSON-676884634 None] /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-fa3793ca-d686-430b-bce8-9224109d425b.b7a4b530-ef91-4b15-b5ba-8b366db77aad is being set with open permissions: ugo+rw Apr 16 15:07:14 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-c2fef812-69bb-48d6-9b10-30395b925621 tempest-VolumeSnapshotQuotasNegativeTestJSON-676884634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-fa3793ca-d686-430b-bce8-9224109d425b.b7a4b530-ef91-4b15-b5ba-8b366db77aad {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:07:14 devstack sudo[85842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-fa3793ca-d686-430b-bce8-9224109d425b.b7a4b530-ef91-4b15-b5ba-8b366db77aad Apr 16 15:07:14 devstack sudo[85842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:07:14 devstack sudo[85842]: pam_unix(sudo:session): session closed for user root Apr 16 15:07:14 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-c2fef812-69bb-48d6-9b10-30395b925621 tempest-VolumeSnapshotQuotasNegativeTestJSON-676884634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-fa3793ca-d686-430b-bce8-9224109d425b.b7a4b530-ef91-4b15-b5ba-8b366db77aad" returned: 0 in 0.447s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:07:14 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-c2fef812-69bb-48d6-9b10-30395b925621 tempest-VolumeSnapshotQuotasNegativeTestJSON-676884634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-fa3793ca-d686-430b-bce8-9224109d425b.info {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:07:14 devstack sudo[85845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-fa3793ca-d686-430b-bce8-9224109d425b.info Apr 16 15:07:14 devstack sudo[85845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:07:15 devstack sudo[85845]: pam_unix(sudo:session): session closed for user root Apr 16 15:07:15 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-c2fef812-69bb-48d6-9b10-30395b925621 tempest-VolumeSnapshotQuotasNegativeTestJSON-676884634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-fa3793ca-d686-430b-bce8-9224109d425b.info" returned: 0 in 0.456s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:07:15 devstack cinder-volume[82756]: WARNING cinder.volume.drivers.remotefs [None req-c2fef812-69bb-48d6-9b10-30395b925621 tempest-VolumeSnapshotQuotasNegativeTestJSON-676884634 None] /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-fa3793ca-d686-430b-bce8-9224109d425b.info is being set with open permissions: ugo+rw Apr 16 15:07:15 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-c2fef812-69bb-48d6-9b10-30395b925621 tempest-VolumeSnapshotQuotasNegativeTestJSON-676884634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-fa3793ca-d686-430b-bce8-9224109d425b.info {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:07:15 devstack sudo[85848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-fa3793ca-d686-430b-bce8-9224109d425b.info Apr 16 15:07:15 devstack sudo[85848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:07:15 devstack sudo[85848]: pam_unix(sudo:session): session closed for user root Apr 16 15:07:15 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-c2fef812-69bb-48d6-9b10-30395b925621 tempest-VolumeSnapshotQuotasNegativeTestJSON-676884634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-fa3793ca-d686-430b-bce8-9224109d425b.info" returned: 0 in 0.431s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:07:15 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-c2fef812-69bb-48d6-9b10-30395b925621 tempest-VolumeSnapshotQuotasNegativeTestJSON-676884634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.240s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:07:15 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-822d2be9-1dc6-4c08-8aab-e8b6bb97dada tempest-VolumesTransfersV355Test-1747303235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.862s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:07:15 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-822d2be9-1dc6-4c08-8aab-e8b6bb97dada tempest-VolumesTransfersV355Test-1747303235 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:07:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1085425132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36c05056-fb8c-4036-b2e2-9eb36452853d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1af277c948a44872b99ed104afaa5cb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:07:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:07:12Z,use_quota=True,user_id='a7034d789cf64420966cbbd006bec2f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)}" {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 15:07:15 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-822d2be9-1dc6-4c08-8aab-e8b6bb97dada tempest-VolumesTransfersV355Test-1747303235 None] Creating volume 36c05056-fb8c-4036-b2e2-9eb36452853d {{(pid=82756) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 15:07:15 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-822d2be9-1dc6-4c08-8aab-e8b6bb97dada tempest-VolumesTransfersV355Test-1747303235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:07:15 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-822d2be9-1dc6-4c08-8aab-e8b6bb97dada tempest-VolumesTransfersV355Test-1747303235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:07:15 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-822d2be9-1dc6-4c08-8aab-e8b6bb97dada tempest-VolumesTransfersV355Test-1747303235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:07:15 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-822d2be9-1dc6-4c08-8aab-e8b6bb97dada tempest-VolumesTransfersV355Test-1747303235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:07:15 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-822d2be9-1dc6-4c08-8aab-e8b6bb97dada tempest-VolumesTransfersV355Test-1747303235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:07:15 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-822d2be9-1dc6-4c08-8aab-e8b6bb97dada tempest-VolumesTransfersV355Test-1747303235 None] Selected osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 as target Quobyte volume. {{(pid=82756) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 15:07:15 devstack cinder-volume[82756]: INFO cinder.volume.drivers.remotefs [None req-822d2be9-1dc6-4c08-8aab-e8b6bb97dada tempest-VolumesTransfersV355Test-1747303235 None] casted to osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 Apr 16 15:07:15 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-822d2be9-1dc6-4c08-8aab-e8b6bb97dada tempest-VolumesTransfersV355Test-1747303235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-36c05056-fb8c-4036-b2e2-9eb36452853d 1073741824 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:07:15 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-c2fef812-69bb-48d6-9b10-30395b925621 tempest-VolumeSnapshotQuotasNegativeTestJSON-676884634 None] Create snapshot completed successfully Apr 16 15:07:15 devstack sudo[85857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-36c05056-fb8c-4036-b2e2-9eb36452853d 1073741824 Apr 16 15:07:15 devstack sudo[85857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:07:16 devstack sudo[85857]: pam_unix(sudo:session): session closed for user root Apr 16 15:07:16 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-822d2be9-1dc6-4c08-8aab-e8b6bb97dada tempest-VolumesTransfersV355Test-1747303235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-36c05056-fb8c-4036-b2e2-9eb36452853d 1073741824" returned: 0 in 0.689s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:07:16 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-822d2be9-1dc6-4c08-8aab-e8b6bb97dada tempest-VolumesTransfersV355Test-1747303235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-36c05056-fb8c-4036-b2e2-9eb36452853d {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:07:16 devstack sudo[85893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-36c05056-fb8c-4036-b2e2-9eb36452853d Apr 16 15:07:16 devstack sudo[85893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:07:16 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-8ca7d148-e435-4119-b6bb-2abf78d55c4e tempest-VolumeSnapshotQuotasNegativeTestJSON-676884634 None] Acquiring lock "cinder-b7a4b530-ef91-4b15-b5ba-8b366db77aad-delete_snapshot" by "delete_snapshot" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:07:16 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-8ca7d148-e435-4119-b6bb-2abf78d55c4e tempest-VolumeSnapshotQuotasNegativeTestJSON-676884634 None] Lock "cinder-b7a4b530-ef91-4b15-b5ba-8b366db77aad-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:07:16 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-8ca7d148-e435-4119-b6bb-2abf78d55c4e tempest-VolumeSnapshotQuotasNegativeTestJSON-676884634 None] Acquiring lock "cinder-quobyte-fa3793ca-d686-430b-bce8-9224109d425b" by "delete_snapshot" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:07:16 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-8ca7d148-e435-4119-b6bb-2abf78d55c4e tempest-VolumeSnapshotQuotasNegativeTestJSON-676884634 None] Lock "cinder-quobyte-fa3793ca-d686-430b-bce8-9224109d425b" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:07:16 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-8ca7d148-e435-4119-b6bb-2abf78d55c4e tempest-VolumeSnapshotQuotasNegativeTestJSON-676884634 None] Acquiring lock "cinder-quobyte-b7a4b530-ef91-4b15-b5ba-8b366db77aad" by "_delete_snapshot" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:07:16 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-8ca7d148-e435-4119-b6bb-2abf78d55c4e tempest-VolumeSnapshotQuotasNegativeTestJSON-676884634 None] Lock "cinder-quobyte-b7a4b530-ef91-4b15-b5ba-8b366db77aad" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:07:16 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-8ca7d148-e435-4119-b6bb-2abf78d55c4e tempest-VolumeSnapshotQuotasNegativeTestJSON-676884634 None] Deleting offline snapshot b7a4b530-ef91-4b15-b5ba-8b366db77aad of volume fa3793ca-d686-430b-bce8-9224109d425b {{(pid=82756) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 15:07:16 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-8ca7d148-e435-4119-b6bb-2abf78d55c4e tempest-VolumeSnapshotQuotasNegativeTestJSON-676884634 None] snapshot_file for this snap is: volume-fa3793ca-d686-430b-bce8-9224109d425b.b7a4b530-ef91-4b15-b5ba-8b366db77aad {{(pid=82756) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 15:07:16 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fe74702-8f51-4cc2-96a3-5e6f7857b246]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:07:16 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-8ca7d148-e435-4119-b6bb-2abf78d55c4e tempest-VolumeSnapshotQuotasNegativeTestJSON-676884634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-fa3793ca-d686-430b-bce8-9224109d425b.b7a4b530-ef91-4b15-b5ba-8b366db77aad {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:07:16 devstack sudo[85903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-fa3793ca-d686-430b-bce8-9224109d425b.b7a4b530-ef91-4b15-b5ba-8b366db77aad Apr 16 15:07:16 devstack sudo[85903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:07:16 devstack sudo[85893]: pam_unix(sudo:session): session closed for user root Apr 16 15:07:16 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-822d2be9-1dc6-4c08-8aab-e8b6bb97dada tempest-VolumesTransfersV355Test-1747303235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-36c05056-fb8c-4036-b2e2-9eb36452853d" returned: 0 in 0.623s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:07:16 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-822d2be9-1dc6-4c08-8aab-e8b6bb97dada tempest-VolumesTransfersV355Test-1747303235 None] <== create_volume: return (1363ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'} {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 15:07:16 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-822d2be9-1dc6-4c08-8aab-e8b6bb97dada tempest-VolumesTransfersV355Test-1747303235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.367s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:07:16 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-4c2c679d-636e-41c1-aecd-05b2c0765692 tempest-VolumesDeleteCascade-1685423249 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.216s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:07:16 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-822d2be9-1dc6-4c08-8aab-e8b6bb97dada tempest-VolumesTransfersV355Test-1747303235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cd96d6e-83e9-48e5-bd90-1223b2e2ab08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36c05056-fb8c-4036-b2e2-9eb36452853d', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:07:16 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-822d2be9-1dc6-4c08-8aab-e8b6bb97dada tempest-VolumesTransfersV355Test-1747303235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fa36cfc-5458-42ae-8174-ef084a16ffd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:07:16 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-4c2c679d-636e-41c1-aecd-05b2c0765692 tempest-VolumesDeleteCascade-1685423249 None] Creating offline snapshot 7eb754d2-8f70-4537-89ad-0b1a9cc212ee of volume c094148b-93da-4fb4-98a0-02d6209cbae2 {{(pid=82756) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 16 15:07:16 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-822d2be9-1dc6-4c08-8aab-e8b6bb97dada tempest-VolumesTransfersV355Test-1747303235 None] Volume volume-36c05056-fb8c-4036-b2e2-9eb36452853d (36c05056-fb8c-4036-b2e2-9eb36452853d): created successfully Apr 16 15:07:16 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-822d2be9-1dc6-4c08-8aab-e8b6bb97dada tempest-VolumesTransfersV355Test-1747303235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fa36cfc-5458-42ae-8174-ef084a16ffd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:07:16 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-822d2be9-1dc6-4c08-8aab-e8b6bb97dada tempest-VolumesTransfersV355Test-1747303235 None] Flow 'volume_create_manager' (59fc7633-317c-4181-b17b-c89d8f4570f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:07:16 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4407401-7b28-4403-bd01-b729dc005101]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:07:16 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-4c2c679d-636e-41c1-aecd-05b2c0765692 tempest-VolumesDeleteCascade-1685423249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c094148b-93da-4fb4-98a0-02d6209cbae2 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:07:16 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-822d2be9-1dc6-4c08-8aab-e8b6bb97dada tempest-VolumesTransfersV355Test-1747303235 None] Created volume successfully. Apr 16 15:07:17 devstack sudo[85908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c094148b-93da-4fb4-98a0-02d6209cbae2 Apr 16 15:07:17 devstack sudo[85908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:07:17 devstack sudo[85903]: pam_unix(sudo:session): session closed for user root Apr 16 15:07:17 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-8ca7d148-e435-4119-b6bb-2abf78d55c4e tempest-VolumeSnapshotQuotasNegativeTestJSON-676884634 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-fa3793ca-d686-430b-bce8-9224109d425b.b7a4b530-ef91-4b15-b5ba-8b366db77aad" returned: 0 in 0.712s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:07:17 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-8ca7d148-e435-4119-b6bb-2abf78d55c4e tempest-VolumeSnapshotQuotasNegativeTestJSON-676884634 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fa3793ca-d686-430b-bce8-9224109d425b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82756) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 15:07:17 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba79dc69-325a-4c00-af4a-e12f4eb526ab]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:07:17 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-8ca7d148-e435-4119-b6bb-2abf78d55c4e tempest-VolumeSnapshotQuotasNegativeTestJSON-676884634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-fa3793ca-d686-430b-bce8-9224109d425b {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:07:17 devstack sudo[85915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-fa3793ca-d686-430b-bce8-9224109d425b Apr 16 15:07:17 devstack sudo[85915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:07:17 devstack sudo[85908]: pam_unix(sudo:session): session closed for user root Apr 16 15:07:17 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-4c2c679d-636e-41c1-aecd-05b2c0765692 tempest-VolumesDeleteCascade-1685423249 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c094148b-93da-4fb4-98a0-02d6209cbae2" returned: 0 in 0.667s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:07:17 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-4c2c679d-636e-41c1-aecd-05b2c0765692 tempest-VolumesDeleteCascade-1685423249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c094148b-93da-4fb4-98a0-02d6209cbae2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c094148b-93da-4fb4-98a0-02d6209cbae2.7eb754d2-8f70-4537-89ad-0b1a9cc212ee 1G {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:07:17 devstack sudo[85920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c094148b-93da-4fb4-98a0-02d6209cbae2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c094148b-93da-4fb4-98a0-02d6209cbae2.7eb754d2-8f70-4537-89ad-0b1a9cc212ee 1G Apr 16 15:07:17 devstack sudo[85920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:07:18 devstack sudo[85915]: pam_unix(sudo:session): session closed for user root Apr 16 15:07:18 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-8ca7d148-e435-4119-b6bb-2abf78d55c4e tempest-VolumeSnapshotQuotasNegativeTestJSON-676884634 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-fa3793ca-d686-430b-bce8-9224109d425b" returned: 0 in 0.738s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:07:18 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-8ca7d148-e435-4119-b6bb-2abf78d55c4e tempest-VolumeSnapshotQuotasNegativeTestJSON-676884634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-fa3793ca-d686-430b-bce8-9224109d425b.b7a4b530-ef91-4b15-b5ba-8b366db77aad {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:07:18 devstack sudo[85930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-fa3793ca-d686-430b-bce8-9224109d425b.b7a4b530-ef91-4b15-b5ba-8b366db77aad Apr 16 15:07:18 devstack sudo[85930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:07:18 devstack sudo[85920]: pam_unix(sudo:session): session closed for user root Apr 16 15:07:18 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-4c2c679d-636e-41c1-aecd-05b2c0765692 tempest-VolumesDeleteCascade-1685423249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c094148b-93da-4fb4-98a0-02d6209cbae2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c094148b-93da-4fb4-98a0-02d6209cbae2.7eb754d2-8f70-4537-89ad-0b1a9cc212ee 1G" returned: 0 in 0.610s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:07:18 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-4c2c679d-636e-41c1-aecd-05b2c0765692 tempest-VolumesDeleteCascade-1685423249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c094148b-93da-4fb4-98a0-02d6209cbae2 -F qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c094148b-93da-4fb4-98a0-02d6209cbae2.7eb754d2-8f70-4537-89ad-0b1a9cc212ee {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:07:18 devstack sudo[85932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c094148b-93da-4fb4-98a0-02d6209cbae2 -F qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c094148b-93da-4fb4-98a0-02d6209cbae2.7eb754d2-8f70-4537-89ad-0b1a9cc212ee Apr 16 15:07:18 devstack sudo[85932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:07:18 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-a1f76396-dbde-435e-9ba4-d4f1d6f0e719 tempest-VolumesTransfersV355Test-349881812 None] Transfer volume completed successfully. Apr 16 15:07:18 devstack sudo[85930]: pam_unix(sudo:session): session closed for user root Apr 16 15:07:18 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-8ca7d148-e435-4119-b6bb-2abf78d55c4e tempest-VolumeSnapshotQuotasNegativeTestJSON-676884634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-fa3793ca-d686-430b-bce8-9224109d425b.b7a4b530-ef91-4b15-b5ba-8b366db77aad" returned: 0 in 0.700s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:07:18 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-8ca7d148-e435-4119-b6bb-2abf78d55c4e tempest-VolumeSnapshotQuotasNegativeTestJSON-676884634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-fa3793ca-d686-430b-bce8-9224109d425b.b7a4b530-ef91-4b15-b5ba-8b366db77aad {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:07:18 devstack sudo[85932]: pam_unix(sudo:session): session closed for user root Apr 16 15:07:18 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-4c2c679d-636e-41c1-aecd-05b2c0765692 tempest-VolumesDeleteCascade-1685423249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c094148b-93da-4fb4-98a0-02d6209cbae2 -F qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c094148b-93da-4fb4-98a0-02d6209cbae2.7eb754d2-8f70-4537-89ad-0b1a9cc212ee" returned: 0 in 0.656s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:07:18 devstack cinder-volume[82756]: WARNING cinder.volume.drivers.remotefs [None req-4c2c679d-636e-41c1-aecd-05b2c0765692 tempest-VolumesDeleteCascade-1685423249 None] /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c094148b-93da-4fb4-98a0-02d6209cbae2.7eb754d2-8f70-4537-89ad-0b1a9cc212ee is being set with open permissions: ugo+rw Apr 16 15:07:18 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-4c2c679d-636e-41c1-aecd-05b2c0765692 tempest-VolumesDeleteCascade-1685423249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c094148b-93da-4fb4-98a0-02d6209cbae2.7eb754d2-8f70-4537-89ad-0b1a9cc212ee {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:07:18 devstack sudo[85941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-fa3793ca-d686-430b-bce8-9224109d425b.b7a4b530-ef91-4b15-b5ba-8b366db77aad Apr 16 15:07:18 devstack sudo[85941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:07:18 devstack sudo[85943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c094148b-93da-4fb4-98a0-02d6209cbae2.7eb754d2-8f70-4537-89ad-0b1a9cc212ee Apr 16 15:07:18 devstack sudo[85943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:07:19 devstack sudo[85941]: pam_unix(sudo:session): session closed for user root Apr 16 15:07:19 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-8ca7d148-e435-4119-b6bb-2abf78d55c4e tempest-VolumeSnapshotQuotasNegativeTestJSON-676884634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-fa3793ca-d686-430b-bce8-9224109d425b.b7a4b530-ef91-4b15-b5ba-8b366db77aad" returned: 0 in 0.509s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:07:19 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-8ca7d148-e435-4119-b6bb-2abf78d55c4e tempest-VolumeSnapshotQuotasNegativeTestJSON-676884634 None] Lock "cinder-quobyte-b7a4b530-ef91-4b15-b5ba-8b366db77aad" released by "_delete_snapshot" :: held 2.763s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:07:19 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-8ca7d148-e435-4119-b6bb-2abf78d55c4e tempest-VolumeSnapshotQuotasNegativeTestJSON-676884634 None] Lock "cinder-quobyte-fa3793ca-d686-430b-bce8-9224109d425b" released by "delete_snapshot" :: held 2.789s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:07:19 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-8ca7d148-e435-4119-b6bb-2abf78d55c4e tempest-VolumeSnapshotQuotasNegativeTestJSON-676884634 None] Created reservations ['3173f421-4e62-41c6-904b-baa161ab3f00', '2afbaba7-fa5e-41b7-92e3-f48bf548606f', 'beabe97d-769f-4e23-8dcc-a3a163c4095d', 'ca1d64d1-9dff-4ccc-908a-cd7391caab63'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:07:19 devstack sudo[85943]: pam_unix(sudo:session): session closed for user root Apr 16 15:07:19 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-4c2c679d-636e-41c1-aecd-05b2c0765692 tempest-VolumesDeleteCascade-1685423249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c094148b-93da-4fb4-98a0-02d6209cbae2.7eb754d2-8f70-4537-89ad-0b1a9cc212ee" returned: 0 in 0.555s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:07:19 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-52fd750c-d723-4bb4-a380-62478a9ecd6d tempest-VolumesTransfersV355Test-1277892080 None] Acquiring lock "cinder-36c05056-fb8c-4036-b2e2-9eb36452853d-delete_volume" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:07:19 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-4c2c679d-636e-41c1-aecd-05b2c0765692 tempest-VolumesDeleteCascade-1685423249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c094148b-93da-4fb4-98a0-02d6209cbae2.info {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:07:19 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-52fd750c-d723-4bb4-a380-62478a9ecd6d tempest-VolumesTransfersV355Test-1277892080 None] Lock "cinder-36c05056-fb8c-4036-b2e2-9eb36452853d-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:07:19 devstack sudo[85947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c094148b-93da-4fb4-98a0-02d6209cbae2.info Apr 16 15:07:19 devstack sudo[85947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:07:19 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-8ca7d148-e435-4119-b6bb-2abf78d55c4e tempest-VolumeSnapshotQuotasNegativeTestJSON-676884634 None] Delete snapshot completed successfully. Apr 16 15:07:19 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-8ca7d148-e435-4119-b6bb-2abf78d55c4e tempest-VolumeSnapshotQuotasNegativeTestJSON-676884634 None] Lock "cinder-b7a4b530-ef91-4b15-b5ba-8b366db77aad-delete_snapshot" released by "delete_snapshot" :: held 2.925s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:07:19 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-52fd750c-d723-4bb4-a380-62478a9ecd6d tempest-VolumesTransfersV355Test-1277892080 None] Acquiring lock "cinder-quobyte-36c05056-fb8c-4036-b2e2-9eb36452853d" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:07:19 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-52fd750c-d723-4bb4-a380-62478a9ecd6d tempest-VolumesTransfersV355Test-1277892080 None] Lock "cinder-quobyte-36c05056-fb8c-4036-b2e2-9eb36452853d" acquired by "delete_volume" :: waited 0.007s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:07:19 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b54f061-b9d8-4b17-8ae7-22d575665a2a]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:07:19 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-52fd750c-d723-4bb4-a380-62478a9ecd6d tempest-VolumesTransfersV355Test-1277892080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-36c05056-fb8c-4036-b2e2-9eb36452853d {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:07:19 devstack sudo[85949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-36c05056-fb8c-4036-b2e2-9eb36452853d Apr 16 15:07:19 devstack sudo[85949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:07:19 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-ec262e53-e41b-4559-b168-a473243d7c4e tempest-VolumeSnapshotQuotasNegativeTestJSON-676884634 None] Acquiring lock "cinder-fa3793ca-d686-430b-bce8-9224109d425b-delete_volume" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:07:19 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-ec262e53-e41b-4559-b168-a473243d7c4e tempest-VolumeSnapshotQuotasNegativeTestJSON-676884634 None] Lock "cinder-fa3793ca-d686-430b-bce8-9224109d425b-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:07:19 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-ec262e53-e41b-4559-b168-a473243d7c4e tempest-VolumeSnapshotQuotasNegativeTestJSON-676884634 None] Acquiring lock "cinder-quobyte-fa3793ca-d686-430b-bce8-9224109d425b" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:07:19 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-ec262e53-e41b-4559-b168-a473243d7c4e tempest-VolumeSnapshotQuotasNegativeTestJSON-676884634 None] Lock "cinder-quobyte-fa3793ca-d686-430b-bce8-9224109d425b" acquired by "delete_volume" :: waited 0.008s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:07:19 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[a17eb41b-e390-4339-960c-294ea8c1fbd4]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:07:19 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-ec262e53-e41b-4559-b168-a473243d7c4e tempest-VolumeSnapshotQuotasNegativeTestJSON-676884634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-fa3793ca-d686-430b-bce8-9224109d425b {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:07:19 devstack sudo[85947]: pam_unix(sudo:session): session closed for user root Apr 16 15:07:19 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-4c2c679d-636e-41c1-aecd-05b2c0765692 tempest-VolumesDeleteCascade-1685423249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c094148b-93da-4fb4-98a0-02d6209cbae2.info" returned: 0 in 0.567s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:07:19 devstack cinder-volume[82756]: WARNING cinder.volume.drivers.remotefs [None req-4c2c679d-636e-41c1-aecd-05b2c0765692 tempest-VolumesDeleteCascade-1685423249 None] /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c094148b-93da-4fb4-98a0-02d6209cbae2.info is being set with open permissions: ugo+rw Apr 16 15:07:19 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-4c2c679d-636e-41c1-aecd-05b2c0765692 tempest-VolumesDeleteCascade-1685423249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c094148b-93da-4fb4-98a0-02d6209cbae2.info {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:07:20 devstack sudo[85974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c094148b-93da-4fb4-98a0-02d6209cbae2.info Apr 16 15:07:20 devstack sudo[85974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:07:20 devstack sudo[85956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-fa3793ca-d686-430b-bce8-9224109d425b Apr 16 15:07:20 devstack sudo[85956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:07:20 devstack sudo[85949]: pam_unix(sudo:session): session closed for user root Apr 16 15:07:20 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-52fd750c-d723-4bb4-a380-62478a9ecd6d tempest-VolumesTransfersV355Test-1277892080 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-36c05056-fb8c-4036-b2e2-9eb36452853d" returned: 0 in 0.751s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:07:20 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-52fd750c-d723-4bb4-a380-62478a9ecd6d tempest-VolumesTransfersV355Test-1277892080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-36c05056-fb8c-4036-b2e2-9eb36452853d {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:07:20 devstack sudo[85982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-36c05056-fb8c-4036-b2e2-9eb36452853d Apr 16 15:07:20 devstack sudo[85982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:07:20 devstack sudo[85974]: pam_unix(sudo:session): session closed for user root Apr 16 15:07:20 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-4c2c679d-636e-41c1-aecd-05b2c0765692 tempest-VolumesDeleteCascade-1685423249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c094148b-93da-4fb4-98a0-02d6209cbae2.info" returned: 0 in 0.496s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:07:20 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-4c2c679d-636e-41c1-aecd-05b2c0765692 tempest-VolumesDeleteCascade-1685423249 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.675s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:07:20 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-4c2c679d-636e-41c1-aecd-05b2c0765692 tempest-VolumesDeleteCascade-1685423249 None] Create snapshot completed successfully Apr 16 15:07:20 devstack sudo[85956]: pam_unix(sudo:session): session closed for user root Apr 16 15:07:20 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-ec262e53-e41b-4559-b168-a473243d7c4e tempest-VolumeSnapshotQuotasNegativeTestJSON-676884634 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-fa3793ca-d686-430b-bce8-9224109d425b" returned: 0 in 0.717s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:07:20 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-ec262e53-e41b-4559-b168-a473243d7c4e tempest-VolumeSnapshotQuotasNegativeTestJSON-676884634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-fa3793ca-d686-430b-bce8-9224109d425b {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:07:20 devstack sudo[85990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-fa3793ca-d686-430b-bce8-9224109d425b Apr 16 15:07:20 devstack sudo[85990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:07:20 devstack sudo[85982]: pam_unix(sudo:session): session closed for user root Apr 16 15:07:20 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-52fd750c-d723-4bb4-a380-62478a9ecd6d tempest-VolumesTransfersV355Test-1277892080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-36c05056-fb8c-4036-b2e2-9eb36452853d" returned: 0 in 0.509s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:07:20 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-52fd750c-d723-4bb4-a380-62478a9ecd6d tempest-VolumesTransfersV355Test-1277892080 None] Lock "cinder-quobyte-36c05056-fb8c-4036-b2e2-9eb36452853d" released by "delete_volume" :: held 1.282s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:07:20 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-52fd750c-d723-4bb4-a380-62478a9ecd6d tempest-VolumesTransfersV355Test-1277892080 None] Created reservations ['398bfb3e-33d6-4671-bebb-f63393eb8a23', 'd32136dc-3de9-409f-a333-91aa3261bece', 'efc40758-564e-4454-ae1d-7f75c640bc6e', '32432c87-5dac-4f10-92e4-14999b77e7b5'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:07:20 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-52fd750c-d723-4bb4-a380-62478a9ecd6d tempest-VolumesTransfersV355Test-1277892080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:07:20 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-52fd750c-d723-4bb4-a380-62478a9ecd6d tempest-VolumesTransfersV355Test-1277892080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:07:20 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-52fd750c-d723-4bb4-a380-62478a9ecd6d tempest-VolumesTransfersV355Test-1277892080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:07:20 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-52fd750c-d723-4bb4-a380-62478a9ecd6d tempest-VolumesTransfersV355Test-1277892080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:07:20 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-52fd750c-d723-4bb4-a380-62478a9ecd6d tempest-VolumesTransfersV355Test-1277892080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:07:20 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-52fd750c-d723-4bb4-a380-62478a9ecd6d tempest-VolumesTransfersV355Test-1277892080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:07:20 devstack sudo[85993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:07:20 devstack sudo[85993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:07:21 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-8ada12a2-3a34-486e-a641-0531fc5a29ba tempest-VolumesDeleteCascade-1685423249 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:07:21 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-8ada12a2-3a34-486e-a641-0531fc5a29ba tempest-VolumesDeleteCascade-1685423249 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:07:21 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-8ada12a2-3a34-486e-a641-0531fc5a29ba tempest-VolumesDeleteCascade-1685423249 None] Creating offline snapshot bd1267d3-deae-4603-ad18-659487a36843 of volume c094148b-93da-4fb4-98a0-02d6209cbae2 {{(pid=82756) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 16 15:07:21 devstack sudo[85990]: pam_unix(sudo:session): session closed for user root Apr 16 15:07:21 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-ec262e53-e41b-4559-b168-a473243d7c4e tempest-VolumeSnapshotQuotasNegativeTestJSON-676884634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-fa3793ca-d686-430b-bce8-9224109d425b" returned: 0 in 0.460s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:07:21 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3c9a748-2045-4c6a-bf22-c0b03c3614bd]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:07:21 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-8ada12a2-3a34-486e-a641-0531fc5a29ba tempest-VolumesDeleteCascade-1685423249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c094148b-93da-4fb4-98a0-02d6209cbae2.7eb754d2-8f70-4537-89ad-0b1a9cc212ee {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:07:21 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-ec262e53-e41b-4559-b168-a473243d7c4e tempest-VolumeSnapshotQuotasNegativeTestJSON-676884634 None] Lock "cinder-quobyte-fa3793ca-d686-430b-bce8-9224109d425b" released by "delete_volume" :: held 1.214s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:07:21 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-ec262e53-e41b-4559-b168-a473243d7c4e tempest-VolumeSnapshotQuotasNegativeTestJSON-676884634 None] Created reservations ['d6734765-d3a1-4503-bfdd-314e9b4d451e', 'b01d6ced-8cc9-41c5-875c-e124a25d0cb1', '508e231d-be05-4dd8-a629-66f424f83613', '3e72c719-baec-459e-bff9-2310be73fd83'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:07:21 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-ec262e53-e41b-4559-b168-a473243d7c4e tempest-VolumeSnapshotQuotasNegativeTestJSON-676884634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:07:21 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-ec262e53-e41b-4559-b168-a473243d7c4e tempest-VolumeSnapshotQuotasNegativeTestJSON-676884634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:07:21 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-ec262e53-e41b-4559-b168-a473243d7c4e tempest-VolumeSnapshotQuotasNegativeTestJSON-676884634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:07:21 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-ec262e53-e41b-4559-b168-a473243d7c4e tempest-VolumeSnapshotQuotasNegativeTestJSON-676884634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:07:21 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-ec262e53-e41b-4559-b168-a473243d7c4e tempest-VolumeSnapshotQuotasNegativeTestJSON-676884634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:07:21 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-ec262e53-e41b-4559-b168-a473243d7c4e tempest-VolumeSnapshotQuotasNegativeTestJSON-676884634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:07:21 devstack sudo[85997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c094148b-93da-4fb4-98a0-02d6209cbae2.7eb754d2-8f70-4537-89ad-0b1a9cc212ee Apr 16 15:07:21 devstack sudo[85997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:07:21 devstack sudo[85999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:07:21 devstack sudo[85999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:07:21 devstack sudo[85993]: pam_unix(sudo:session): session closed for user root Apr 16 15:07:21 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-52fd750c-d723-4bb4-a380-62478a9ecd6d tempest-VolumesTransfersV355Test-1277892080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.481s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:07:21 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-52fd750c-d723-4bb4-a380-62478a9ecd6d tempest-VolumesTransfersV355Test-1277892080 None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:07:21 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-52fd750c-d723-4bb4-a380-62478a9ecd6d tempest-VolumesTransfersV355Test-1277892080 None] Deleted volume successfully. Apr 16 15:07:21 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-52fd750c-d723-4bb4-a380-62478a9ecd6d tempest-VolumesTransfersV355Test-1277892080 None] Lock "cinder-36c05056-fb8c-4036-b2e2-9eb36452853d-delete_volume" released by "delete_volume" :: held 1.886s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:07:21 devstack sudo[85999]: pam_unix(sudo:session): session closed for user root Apr 16 15:07:21 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-ec262e53-e41b-4559-b168-a473243d7c4e tempest-VolumeSnapshotQuotasNegativeTestJSON-676884634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.494s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:07:21 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-ec262e53-e41b-4559-b168-a473243d7c4e tempest-VolumeSnapshotQuotasNegativeTestJSON-676884634 None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:07:21 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-ec262e53-e41b-4559-b168-a473243d7c4e tempest-VolumeSnapshotQuotasNegativeTestJSON-676884634 None] Deleted volume successfully. Apr 16 15:07:21 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-ec262e53-e41b-4559-b168-a473243d7c4e tempest-VolumeSnapshotQuotasNegativeTestJSON-676884634 None] Lock "cinder-fa3793ca-d686-430b-bce8-9224109d425b-delete_volume" released by "delete_volume" :: held 1.833s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:07:21 devstack sudo[85997]: pam_unix(sudo:session): session closed for user root Apr 16 15:07:21 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-8ada12a2-3a34-486e-a641-0531fc5a29ba tempest-VolumesDeleteCascade-1685423249 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c094148b-93da-4fb4-98a0-02d6209cbae2.7eb754d2-8f70-4537-89ad-0b1a9cc212ee" returned: 0 in 0.643s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:07:21 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-8ada12a2-3a34-486e-a641-0531fc5a29ba tempest-VolumesDeleteCascade-1685423249 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c094148b-93da-4fb4-98a0-02d6209cbae2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82756) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 15:07:21 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-8ada12a2-3a34-486e-a641-0531fc5a29ba tempest-VolumesDeleteCascade-1685423249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c094148b-93da-4fb4-98a0-02d6209cbae2.7eb754d2-8f70-4537-89ad-0b1a9cc212ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c094148b-93da-4fb4-98a0-02d6209cbae2.bd1267d3-deae-4603-ad18-659487a36843 1G {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:07:21 devstack sudo[86007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c094148b-93da-4fb4-98a0-02d6209cbae2.7eb754d2-8f70-4537-89ad-0b1a9cc212ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c094148b-93da-4fb4-98a0-02d6209cbae2.bd1267d3-deae-4603-ad18-659487a36843 1G Apr 16 15:07:21 devstack sudo[86007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:07:21 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [None req-e34804d6-7024-42f0-bdcd-61e0f1f8615c tempest-VolumesTransfersV355Test-1747303235 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82756) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 15:07:21 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-e34804d6-7024-42f0-bdcd-61e0f1f8615c tempest-VolumesTransfersV355Test-1747303235 None] Flow 'volume_create_manager' (c36abf1b-7f7c-4aab-b63c-1bd17abdf434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:07:21 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-e34804d6-7024-42f0-bdcd-61e0f1f8615c tempest-VolumesTransfersV355Test-1747303235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87661af6-cc38-4ac9-b67a-ad7cda7b88a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:07:21 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-e34804d6-7024-42f0-bdcd-61e0f1f8615c tempest-VolumesTransfersV355Test-1747303235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87661af6-cc38-4ac9-b67a-ad7cda7b88a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:07:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-850938330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1bd9430-24f1-43ed-bc69-5216b29ec1d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1af277c948a44872b99ed104afaa5cb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:07:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:07:22Z,use_quota=True,user_id='a7034d789cf64420966cbbd006bec2f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:07:21 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-e34804d6-7024-42f0-bdcd-61e0f1f8615c tempest-VolumesTransfersV355Test-1747303235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8286d79-e781-487e-8b26-a3d8f7999cf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:07:21 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-e34804d6-7024-42f0-bdcd-61e0f1f8615c tempest-VolumesTransfersV355Test-1747303235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8286d79-e781-487e-8b26-a3d8f7999cf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:07:21 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-e34804d6-7024-42f0-bdcd-61e0f1f8615c tempest-VolumesTransfersV355Test-1747303235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5b7d563-ee6f-426b-83e3-07dfb0b59a9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:07:21 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-e34804d6-7024-42f0-bdcd-61e0f1f8615c tempest-VolumesTransfersV355Test-1747303235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5b7d563-ee6f-426b-83e3-07dfb0b59a9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1bd9430-24f1-43ed-bc69-5216b29ec1d6', 'volume_name': 'volume-b1bd9430-24f1-43ed-bc69-5216b29ec1d6', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:07:21 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-e34804d6-7024-42f0-bdcd-61e0f1f8615c tempest-VolumesTransfersV355Test-1747303235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39705e9f-abbe-4640-a4bc-3f2e2fd3b147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:07:21 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-e34804d6-7024-42f0-bdcd-61e0f1f8615c tempest-VolumesTransfersV355Test-1747303235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39705e9f-abbe-4640-a4bc-3f2e2fd3b147) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:07:21 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-e34804d6-7024-42f0-bdcd-61e0f1f8615c tempest-VolumesTransfersV355Test-1747303235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f2236b3-b451-43ac-a342-4bc55e774f65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:07:21 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-e34804d6-7024-42f0-bdcd-61e0f1f8615c tempest-VolumesTransfersV355Test-1747303235 None] Volume b1bd9430-24f1-43ed-bc69-5216b29ec1d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1bd9430-24f1-43ed-bc69-5216b29ec1d6', 'volume_size': 1} Apr 16 15:07:21 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-e34804d6-7024-42f0-bdcd-61e0f1f8615c tempest-VolumesTransfersV355Test-1747303235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:07:22 devstack sudo[86007]: pam_unix(sudo:session): session closed for user root Apr 16 15:07:22 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-8ada12a2-3a34-486e-a641-0531fc5a29ba tempest-VolumesDeleteCascade-1685423249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c094148b-93da-4fb4-98a0-02d6209cbae2.7eb754d2-8f70-4537-89ad-0b1a9cc212ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c094148b-93da-4fb4-98a0-02d6209cbae2.bd1267d3-deae-4603-ad18-659487a36843 1G" returned: 0 in 0.581s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:07:22 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-8ada12a2-3a34-486e-a641-0531fc5a29ba tempest-VolumesDeleteCascade-1685423249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c094148b-93da-4fb4-98a0-02d6209cbae2.7eb754d2-8f70-4537-89ad-0b1a9cc212ee -F qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c094148b-93da-4fb4-98a0-02d6209cbae2.bd1267d3-deae-4603-ad18-659487a36843 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:07:22 devstack sudo[86013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c094148b-93da-4fb4-98a0-02d6209cbae2.7eb754d2-8f70-4537-89ad-0b1a9cc212ee -F qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c094148b-93da-4fb4-98a0-02d6209cbae2.bd1267d3-deae-4603-ad18-659487a36843 Apr 16 15:07:22 devstack sudo[86013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:07:22 devstack cinder-volume[82756]: INFO cinder.volume.manager [req-f4bc2a31-4760-4cf6-bc86-c63772737e1e req-3275b11f-d70d-4237-823b-694d305cb121 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Terminate volume connection completed successfully. Apr 16 15:07:22 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [req-f4bc2a31-4760-4cf6-bc86-c63772737e1e req-3275b11f-d70d-4237-823b-694d305cb121 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Deleting attachment 5e80d9e5-f970-467a-b155-0357767dbc39. {{(pid=82756) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 16 15:07:22 devstack sudo[86013]: pam_unix(sudo:session): session closed for user root Apr 16 15:07:22 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-8ada12a2-3a34-486e-a641-0531fc5a29ba tempest-VolumesDeleteCascade-1685423249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c094148b-93da-4fb4-98a0-02d6209cbae2.7eb754d2-8f70-4537-89ad-0b1a9cc212ee -F qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c094148b-93da-4fb4-98a0-02d6209cbae2.bd1267d3-deae-4603-ad18-659487a36843" returned: 0 in 0.502s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:07:22 devstack cinder-volume[82756]: WARNING cinder.volume.drivers.remotefs [None req-8ada12a2-3a34-486e-a641-0531fc5a29ba tempest-VolumesDeleteCascade-1685423249 None] /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c094148b-93da-4fb4-98a0-02d6209cbae2.bd1267d3-deae-4603-ad18-659487a36843 is being set with open permissions: ugo+rw Apr 16 15:07:22 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-8ada12a2-3a34-486e-a641-0531fc5a29ba tempest-VolumesDeleteCascade-1685423249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c094148b-93da-4fb4-98a0-02d6209cbae2.bd1267d3-deae-4603-ad18-659487a36843 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:07:22 devstack sudo[86018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c094148b-93da-4fb4-98a0-02d6209cbae2.bd1267d3-deae-4603-ad18-659487a36843 Apr 16 15:07:22 devstack sudo[86018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:07:23 devstack sudo[86018]: pam_unix(sudo:session): session closed for user root Apr 16 15:07:23 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-8ada12a2-3a34-486e-a641-0531fc5a29ba tempest-VolumesDeleteCascade-1685423249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c094148b-93da-4fb4-98a0-02d6209cbae2.bd1267d3-deae-4603-ad18-659487a36843" returned: 0 in 0.453s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:07:23 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-8ada12a2-3a34-486e-a641-0531fc5a29ba tempest-VolumesDeleteCascade-1685423249 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.258s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:07:23 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-e34804d6-7024-42f0-bdcd-61e0f1f8615c tempest-VolumesTransfersV355Test-1747303235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.339s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:07:23 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-e34804d6-7024-42f0-bdcd-61e0f1f8615c tempest-VolumesTransfersV355Test-1747303235 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:07:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-850938330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1bd9430-24f1-43ed-bc69-5216b29ec1d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1af277c948a44872b99ed104afaa5cb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:07:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:07:22Z,use_quota=True,user_id='a7034d789cf64420966cbbd006bec2f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)}" {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 15:07:23 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-e34804d6-7024-42f0-bdcd-61e0f1f8615c tempest-VolumesTransfersV355Test-1747303235 None] Creating volume b1bd9430-24f1-43ed-bc69-5216b29ec1d6 {{(pid=82756) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 15:07:23 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-e34804d6-7024-42f0-bdcd-61e0f1f8615c tempest-VolumesTransfersV355Test-1747303235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:07:23 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-e34804d6-7024-42f0-bdcd-61e0f1f8615c tempest-VolumesTransfersV355Test-1747303235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:07:23 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-e34804d6-7024-42f0-bdcd-61e0f1f8615c tempest-VolumesTransfersV355Test-1747303235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:07:23 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-e34804d6-7024-42f0-bdcd-61e0f1f8615c tempest-VolumesTransfersV355Test-1747303235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:07:23 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-e34804d6-7024-42f0-bdcd-61e0f1f8615c tempest-VolumesTransfersV355Test-1747303235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:07:23 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-e34804d6-7024-42f0-bdcd-61e0f1f8615c tempest-VolumesTransfersV355Test-1747303235 None] Selected osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 as target Quobyte volume. {{(pid=82756) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 15:07:23 devstack cinder-volume[82756]: INFO cinder.volume.drivers.remotefs [None req-e34804d6-7024-42f0-bdcd-61e0f1f8615c tempest-VolumesTransfersV355Test-1747303235 None] casted to osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 Apr 16 15:07:23 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-e34804d6-7024-42f0-bdcd-61e0f1f8615c tempest-VolumesTransfersV355Test-1747303235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b1bd9430-24f1-43ed-bc69-5216b29ec1d6 1073741824 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:07:23 devstack sudo[86021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b1bd9430-24f1-43ed-bc69-5216b29ec1d6 1073741824 Apr 16 15:07:23 devstack sudo[86021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:07:23 devstack cinder-volume[82756]: DEBUG cinder.coordination [req-f4bc2a31-4760-4cf6-bc86-c63772737e1e req-388fb984-0b89-42d1-a290-95fc7efcb9f3 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Acquiring lock "cinder-203917d0-9fc3-4949-81b0-fe0872b639f0-delete_volume" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:07:23 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-8ada12a2-3a34-486e-a641-0531fc5a29ba tempest-VolumesDeleteCascade-1685423249 None] Create snapshot completed successfully Apr 16 15:07:23 devstack cinder-volume[82756]: DEBUG cinder.coordination [req-f4bc2a31-4760-4cf6-bc86-c63772737e1e req-388fb984-0b89-42d1-a290-95fc7efcb9f3 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Lock "cinder-203917d0-9fc3-4949-81b0-fe0872b639f0-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:07:23 devstack cinder-volume[82756]: DEBUG cinder.coordination [req-f4bc2a31-4760-4cf6-bc86-c63772737e1e req-388fb984-0b89-42d1-a290-95fc7efcb9f3 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Acquiring lock "cinder-quobyte-203917d0-9fc3-4949-81b0-fe0872b639f0" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:07:23 devstack cinder-volume[82756]: DEBUG cinder.coordination [req-f4bc2a31-4760-4cf6-bc86-c63772737e1e req-388fb984-0b89-42d1-a290-95fc7efcb9f3 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Lock "cinder-quobyte-203917d0-9fc3-4949-81b0-fe0872b639f0" acquired by "delete_volume" :: waited 0.010s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:07:23 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4fe18dc-169f-4d72-9458-0b0d113c5748]: (4, 'raw') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:07:23 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [req-f4bc2a31-4760-4cf6-bc86-c63772737e1e req-388fb984-0b89-42d1-a290-95fc7efcb9f3 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-203917d0-9fc3-4949-81b0-fe0872b639f0 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:07:23 devstack sudo[86024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-203917d0-9fc3-4949-81b0-fe0872b639f0 Apr 16 15:07:23 devstack sudo[86024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:07:23 devstack sudo[86021]: pam_unix(sudo:session): session closed for user root Apr 16 15:07:23 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-e34804d6-7024-42f0-bdcd-61e0f1f8615c tempest-VolumesTransfersV355Test-1747303235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b1bd9430-24f1-43ed-bc69-5216b29ec1d6 1073741824" returned: 0 in 0.633s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:07:23 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-e34804d6-7024-42f0-bdcd-61e0f1f8615c tempest-VolumesTransfersV355Test-1747303235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b1bd9430-24f1-43ed-bc69-5216b29ec1d6 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:07:24 devstack sudo[86031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b1bd9430-24f1-43ed-bc69-5216b29ec1d6 Apr 16 15:07:24 devstack sudo[86031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:07:24 devstack sudo[86024]: pam_unix(sudo:session): session closed for user root Apr 16 15:07:24 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [req-f4bc2a31-4760-4cf6-bc86-c63772737e1e req-388fb984-0b89-42d1-a290-95fc7efcb9f3 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-203917d0-9fc3-4949-81b0-fe0872b639f0" returned: 0 in 0.632s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:07:24 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [req-f4bc2a31-4760-4cf6-bc86-c63772737e1e req-388fb984-0b89-42d1-a290-95fc7efcb9f3 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-203917d0-9fc3-4949-81b0-fe0872b639f0 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:07:24 devstack sudo[86033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-203917d0-9fc3-4949-81b0-fe0872b639f0 Apr 16 15:07:24 devstack sudo[86033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:07:24 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-f1c6616d-f262-49a6-be14-54cba04576e8 tempest-VolumesDeleteCascade-1685423249 None] Acquiring lock "cinder-c094148b-93da-4fb4-98a0-02d6209cbae2-delete_volume" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:07:24 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-f1c6616d-f262-49a6-be14-54cba04576e8 tempest-VolumesDeleteCascade-1685423249 None] Lock "cinder-c094148b-93da-4fb4-98a0-02d6209cbae2-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:07:24 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-f1c6616d-f262-49a6-be14-54cba04576e8 tempest-VolumesDeleteCascade-1685423249 None] Performing cascade delete. {{(pid=82756) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 16 15:07:24 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-f1c6616d-f262-49a6-be14-54cba04576e8 tempest-VolumesDeleteCascade-1685423249 None] Acquiring lock "cinder-7eb754d2-8f70-4537-89ad-0b1a9cc212ee-delete_snapshot" by "delete_snapshot" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:07:24 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-f1c6616d-f262-49a6-be14-54cba04576e8 tempest-VolumesDeleteCascade-1685423249 None] Lock "cinder-7eb754d2-8f70-4537-89ad-0b1a9cc212ee-delete_snapshot" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:07:24 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-f1c6616d-f262-49a6-be14-54cba04576e8 tempest-VolumesDeleteCascade-1685423249 None] Acquiring lock "cinder-quobyte-c094148b-93da-4fb4-98a0-02d6209cbae2" by "delete_snapshot" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:07:24 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-f1c6616d-f262-49a6-be14-54cba04576e8 tempest-VolumesDeleteCascade-1685423249 None] Lock "cinder-quobyte-c094148b-93da-4fb4-98a0-02d6209cbae2" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:07:24 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-f1c6616d-f262-49a6-be14-54cba04576e8 tempest-VolumesDeleteCascade-1685423249 None] Acquiring lock "cinder-quobyte-7eb754d2-8f70-4537-89ad-0b1a9cc212ee" by "_delete_snapshot" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:07:24 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-f1c6616d-f262-49a6-be14-54cba04576e8 tempest-VolumesDeleteCascade-1685423249 None] Lock "cinder-quobyte-7eb754d2-8f70-4537-89ad-0b1a9cc212ee" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:07:24 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-f1c6616d-f262-49a6-be14-54cba04576e8 tempest-VolumesDeleteCascade-1685423249 None] Deleting offline snapshot 7eb754d2-8f70-4537-89ad-0b1a9cc212ee of volume c094148b-93da-4fb4-98a0-02d6209cbae2 {{(pid=82756) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 15:07:24 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-f1c6616d-f262-49a6-be14-54cba04576e8 tempest-VolumesDeleteCascade-1685423249 None] snapshot_file for this snap is: volume-c094148b-93da-4fb4-98a0-02d6209cbae2.7eb754d2-8f70-4537-89ad-0b1a9cc212ee {{(pid=82756) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 15:07:24 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8b9d092-646b-4c39-bdec-543e4ab064b5]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:07:24 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-f1c6616d-f262-49a6-be14-54cba04576e8 tempest-VolumesDeleteCascade-1685423249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c094148b-93da-4fb4-98a0-02d6209cbae2.7eb754d2-8f70-4537-89ad-0b1a9cc212ee {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:07:24 devstack sudo[86035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c094148b-93da-4fb4-98a0-02d6209cbae2.7eb754d2-8f70-4537-89ad-0b1a9cc212ee Apr 16 15:07:24 devstack sudo[86035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:07:24 devstack sudo[86031]: pam_unix(sudo:session): session closed for user root Apr 16 15:07:24 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-e34804d6-7024-42f0-bdcd-61e0f1f8615c tempest-VolumesTransfersV355Test-1747303235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b1bd9430-24f1-43ed-bc69-5216b29ec1d6" returned: 0 in 0.537s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:07:24 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-e34804d6-7024-42f0-bdcd-61e0f1f8615c tempest-VolumesTransfersV355Test-1747303235 None] <== create_volume: return (1211ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'} {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 15:07:24 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-e34804d6-7024-42f0-bdcd-61e0f1f8615c tempest-VolumesTransfersV355Test-1747303235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.214s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:07:24 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-e34804d6-7024-42f0-bdcd-61e0f1f8615c tempest-VolumesTransfersV355Test-1747303235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f2236b3-b451-43ac-a342-4bc55e774f65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1bd9430-24f1-43ed-bc69-5216b29ec1d6', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:07:24 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-e34804d6-7024-42f0-bdcd-61e0f1f8615c tempest-VolumesTransfersV355Test-1747303235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21a1880c-72d1-493c-834d-6ed24f214dc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:07:24 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-e34804d6-7024-42f0-bdcd-61e0f1f8615c tempest-VolumesTransfersV355Test-1747303235 None] Volume volume-b1bd9430-24f1-43ed-bc69-5216b29ec1d6 (b1bd9430-24f1-43ed-bc69-5216b29ec1d6): created successfully Apr 16 15:07:24 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-e34804d6-7024-42f0-bdcd-61e0f1f8615c tempest-VolumesTransfersV355Test-1747303235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21a1880c-72d1-493c-834d-6ed24f214dc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:07:24 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-e34804d6-7024-42f0-bdcd-61e0f1f8615c tempest-VolumesTransfersV355Test-1747303235 None] Flow 'volume_create_manager' (c36abf1b-7f7c-4aab-b63c-1bd17abdf434) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:07:24 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-e34804d6-7024-42f0-bdcd-61e0f1f8615c tempest-VolumesTransfersV355Test-1747303235 None] Created volume successfully. Apr 16 15:07:24 devstack sudo[86033]: pam_unix(sudo:session): session closed for user root Apr 16 15:07:24 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [req-f4bc2a31-4760-4cf6-bc86-c63772737e1e req-388fb984-0b89-42d1-a290-95fc7efcb9f3 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-203917d0-9fc3-4949-81b0-fe0872b639f0" returned: 1 in 0.648s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:07:24 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [req-f4bc2a31-4760-4cf6-bc86-c63772737e1e req-388fb984-0b89-42d1-a290-95fc7efcb9f3 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-203917d0-9fc3-4949-81b0-fe0872b639f0' failed. Not Retrying. {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 16 15:07:24 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [req-f4bc2a31-4760-4cf6-bc86-c63772737e1e req-388fb984-0b89-42d1-a290-95fc7efcb9f3 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-203917d0-9fc3-4949-81b0-fe0872b639f0 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:07:24 devstack sudo[86041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-203917d0-9fc3-4949-81b0-fe0872b639f0 Apr 16 15:07:24 devstack sudo[86041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:07:25 devstack sudo[86035]: pam_unix(sudo:session): session closed for user root Apr 16 15:07:25 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-f1c6616d-f262-49a6-be14-54cba04576e8 tempest-VolumesDeleteCascade-1685423249 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c094148b-93da-4fb4-98a0-02d6209cbae2.7eb754d2-8f70-4537-89ad-0b1a9cc212ee" returned: 0 in 0.701s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:07:25 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-f1c6616d-f262-49a6-be14-54cba04576e8 tempest-VolumesDeleteCascade-1685423249 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c094148b-93da-4fb4-98a0-02d6209cbae2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82756) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 15:07:25 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[19c99f1b-5339-47fc-aa6f-be1ebcb4d5b6]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:07:25 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-f1c6616d-f262-49a6-be14-54cba04576e8 tempest-VolumesDeleteCascade-1685423249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c094148b-93da-4fb4-98a0-02d6209cbae2 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:07:25 devstack sudo[86046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c094148b-93da-4fb4-98a0-02d6209cbae2 Apr 16 15:07:25 devstack sudo[86046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:07:25 devstack sudo[86041]: pam_unix(sudo:session): session closed for user root Apr 16 15:07:25 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [req-f4bc2a31-4760-4cf6-bc86-c63772737e1e req-388fb984-0b89-42d1-a290-95fc7efcb9f3 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-203917d0-9fc3-4949-81b0-fe0872b639f0" returned: 0 in 0.607s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:07:25 devstack cinder-volume[82756]: DEBUG cinder.coordination [req-f4bc2a31-4760-4cf6-bc86-c63772737e1e req-388fb984-0b89-42d1-a290-95fc7efcb9f3 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Lock "cinder-quobyte-203917d0-9fc3-4949-81b0-fe0872b639f0" released by "delete_volume" :: held 1.952s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:07:25 devstack cinder-volume[82756]: DEBUG cinder.quota [req-f4bc2a31-4760-4cf6-bc86-c63772737e1e req-388fb984-0b89-42d1-a290-95fc7efcb9f3 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Created reservations ['aa7d07f6-6fd2-41b4-94b5-58e5d95a90fc', '776b2442-c60c-47c7-b87d-bd15072b6744', '3f7bfe9f-5226-4c6e-8f62-c2016b066859', '11fbaae2-f79f-4814-bd5a-6fb0d8250382'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:07:25 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-8d444375-fb52-4c02-bffa-586e123a31bd tempest-VolumesTransfersV355Test-1277892080 None] Acquiring lock "cinder-b1bd9430-24f1-43ed-bc69-5216b29ec1d6-delete_volume" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:07:25 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-8d444375-fb52-4c02-bffa-586e123a31bd tempest-VolumesTransfersV355Test-1277892080 None] Lock "cinder-b1bd9430-24f1-43ed-bc69-5216b29ec1d6-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:07:25 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [req-f4bc2a31-4760-4cf6-bc86-c63772737e1e req-388fb984-0b89-42d1-a290-95fc7efcb9f3 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:07:25 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [req-f4bc2a31-4760-4cf6-bc86-c63772737e1e req-388fb984-0b89-42d1-a290-95fc7efcb9f3 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:07:25 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [req-f4bc2a31-4760-4cf6-bc86-c63772737e1e req-388fb984-0b89-42d1-a290-95fc7efcb9f3 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:07:25 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [req-f4bc2a31-4760-4cf6-bc86-c63772737e1e req-388fb984-0b89-42d1-a290-95fc7efcb9f3 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:07:25 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [req-f4bc2a31-4760-4cf6-bc86-c63772737e1e req-388fb984-0b89-42d1-a290-95fc7efcb9f3 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:07:25 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [req-f4bc2a31-4760-4cf6-bc86-c63772737e1e req-388fb984-0b89-42d1-a290-95fc7efcb9f3 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:07:25 devstack sudo[86051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:07:25 devstack sudo[86051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:07:25 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-8d444375-fb52-4c02-bffa-586e123a31bd tempest-VolumesTransfersV355Test-1277892080 None] Acquiring lock "cinder-quobyte-b1bd9430-24f1-43ed-bc69-5216b29ec1d6" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:07:25 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-8d444375-fb52-4c02-bffa-586e123a31bd tempest-VolumesTransfersV355Test-1277892080 None] Lock "cinder-quobyte-b1bd9430-24f1-43ed-bc69-5216b29ec1d6" acquired by "delete_volume" :: waited 0.011s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:07:25 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cc4f298-8fe8-47ca-8b0d-b928a5aff2ab]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:07:25 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-8d444375-fb52-4c02-bffa-586e123a31bd tempest-VolumesTransfersV355Test-1277892080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b1bd9430-24f1-43ed-bc69-5216b29ec1d6 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:07:25 devstack sudo[86046]: pam_unix(sudo:session): session closed for user root Apr 16 15:07:25 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-f1c6616d-f262-49a6-be14-54cba04576e8 tempest-VolumesDeleteCascade-1685423249 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c094148b-93da-4fb4-98a0-02d6209cbae2" returned: 0 in 0.614s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:07:25 devstack sudo[86054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b1bd9430-24f1-43ed-bc69-5216b29ec1d6 Apr 16 15:07:25 devstack sudo[86054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:07:25 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1aae280-b767-4f9d-9681-eb54c9a4b169]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:07:25 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-f1c6616d-f262-49a6-be14-54cba04576e8 tempest-VolumesDeleteCascade-1685423249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c094148b-93da-4fb4-98a0-02d6209cbae2.bd1267d3-deae-4603-ad18-659487a36843 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:07:25 devstack sudo[86056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c094148b-93da-4fb4-98a0-02d6209cbae2.bd1267d3-deae-4603-ad18-659487a36843 Apr 16 15:07:25 devstack sudo[86056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:07:26 devstack sudo[86054]: pam_unix(sudo:session): session closed for user root Apr 16 15:07:26 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-8d444375-fb52-4c02-bffa-586e123a31bd tempest-VolumesTransfersV355Test-1277892080 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b1bd9430-24f1-43ed-bc69-5216b29ec1d6" returned: 0 in 0.675s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:07:26 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-8d444375-fb52-4c02-bffa-586e123a31bd tempest-VolumesTransfersV355Test-1277892080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b1bd9430-24f1-43ed-bc69-5216b29ec1d6 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:07:26 devstack sudo[86056]: pam_unix(sudo:session): session closed for user root Apr 16 15:07:26 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-f1c6616d-f262-49a6-be14-54cba04576e8 tempest-VolumesDeleteCascade-1685423249 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c094148b-93da-4fb4-98a0-02d6209cbae2.bd1267d3-deae-4603-ad18-659487a36843" returned: 0 in 0.589s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:07:26 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-f1c6616d-f262-49a6-be14-54cba04576e8 tempest-VolumesDeleteCascade-1685423249 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c094148b-93da-4fb4-98a0-02d6209cbae2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82756) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 15:07:26 devstack sudo[86051]: pam_unix(sudo:session): session closed for user root Apr 16 15:07:26 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [req-f4bc2a31-4760-4cf6-bc86-c63772737e1e req-388fb984-0b89-42d1-a290-95fc7efcb9f3 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.769s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:07:26 devstack cinder-volume[82756]: DEBUG cinder.manager [req-f4bc2a31-4760-4cf6-bc86-c63772737e1e req-388fb984-0b89-42d1-a290-95fc7efcb9f3 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:07:26 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2bf0dbf-df9f-4fb5-886d-c4c84b253d3e]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:07:26 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-f1c6616d-f262-49a6-be14-54cba04576e8 tempest-VolumesDeleteCascade-1685423249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c094148b-93da-4fb4-98a0-02d6209cbae2.7eb754d2-8f70-4537-89ad-0b1a9cc212ee {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:07:26 devstack sudo[86069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b1bd9430-24f1-43ed-bc69-5216b29ec1d6 Apr 16 15:07:26 devstack sudo[86069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:07:26 devstack cinder-volume[82756]: INFO cinder.volume.manager [req-f4bc2a31-4760-4cf6-bc86-c63772737e1e req-388fb984-0b89-42d1-a290-95fc7efcb9f3 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Deleted volume successfully. Apr 16 15:07:26 devstack cinder-volume[82756]: DEBUG cinder.coordination [req-f4bc2a31-4760-4cf6-bc86-c63772737e1e req-388fb984-0b89-42d1-a290-95fc7efcb9f3 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Lock "cinder-203917d0-9fc3-4949-81b0-fe0872b639f0-delete_volume" released by "delete_volume" :: held 2.984s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:07:26 devstack sudo[86071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c094148b-93da-4fb4-98a0-02d6209cbae2.7eb754d2-8f70-4537-89ad-0b1a9cc212ee Apr 16 15:07:26 devstack sudo[86071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:07:26 devstack sudo[86069]: pam_unix(sudo:session): session closed for user root Apr 16 15:07:26 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-8d444375-fb52-4c02-bffa-586e123a31bd tempest-VolumesTransfersV355Test-1277892080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b1bd9430-24f1-43ed-bc69-5216b29ec1d6" returned: 0 in 0.652s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:07:26 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-8d444375-fb52-4c02-bffa-586e123a31bd tempest-VolumesTransfersV355Test-1277892080 None] Lock "cinder-quobyte-b1bd9430-24f1-43ed-bc69-5216b29ec1d6" released by "delete_volume" :: held 1.376s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:07:26 devstack sudo[86071]: pam_unix(sudo:session): session closed for user root Apr 16 15:07:26 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-f1c6616d-f262-49a6-be14-54cba04576e8 tempest-VolumesDeleteCascade-1685423249 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c094148b-93da-4fb4-98a0-02d6209cbae2.7eb754d2-8f70-4537-89ad-0b1a9cc212ee" returned: 0 in 0.660s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:07:26 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-f1c6616d-f262-49a6-be14-54cba04576e8 tempest-VolumesDeleteCascade-1685423249 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c094148b-93da-4fb4-98a0-02d6209cbae2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82756) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 15:07:26 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-8d444375-fb52-4c02-bffa-586e123a31bd tempest-VolumesTransfersV355Test-1277892080 None] Created reservations ['ebcde0f9-43a4-47d9-935e-393279ae8786', '49b35ee5-acca-4fe6-a3bf-8d9ad83dd0da', '3fd8f703-bdb9-4048-8344-77f9bf33d740', '2edb2500-bf87-43ed-b2ad-53c2816a5326'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:07:26 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7d83111-7c94-4daa-94cb-f7a2ab057f8a]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:07:26 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-f1c6616d-f262-49a6-be14-54cba04576e8 tempest-VolumesDeleteCascade-1685423249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c094148b-93da-4fb4-98a0-02d6209cbae2 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:07:27 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-8d444375-fb52-4c02-bffa-586e123a31bd tempest-VolumesTransfersV355Test-1277892080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:07:27 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-8d444375-fb52-4c02-bffa-586e123a31bd tempest-VolumesTransfersV355Test-1277892080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:07:27 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-8d444375-fb52-4c02-bffa-586e123a31bd tempest-VolumesTransfersV355Test-1277892080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:07:27 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-8d444375-fb52-4c02-bffa-586e123a31bd tempest-VolumesTransfersV355Test-1277892080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:07:27 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-8d444375-fb52-4c02-bffa-586e123a31bd tempest-VolumesTransfersV355Test-1277892080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:07:27 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-8d444375-fb52-4c02-bffa-586e123a31bd tempest-VolumesTransfersV355Test-1277892080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:07:27 devstack sudo[86087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c094148b-93da-4fb4-98a0-02d6209cbae2 Apr 16 15:07:27 devstack sudo[86087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:07:27 devstack sudo[86088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:07:27 devstack sudo[86088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:07:27 devstack sudo[86087]: pam_unix(sudo:session): session closed for user root Apr 16 15:07:27 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-f1c6616d-f262-49a6-be14-54cba04576e8 tempest-VolumesDeleteCascade-1685423249 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c094148b-93da-4fb4-98a0-02d6209cbae2" returned: 0 in 0.631s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:07:27 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-f1c6616d-f262-49a6-be14-54cba04576e8 tempest-VolumesDeleteCascade-1685423249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c094148b-93da-4fb4-98a0-02d6209cbae2.7eb754d2-8f70-4537-89ad-0b1a9cc212ee {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:07:27 devstack sudo[86088]: pam_unix(sudo:session): session closed for user root Apr 16 15:07:27 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-8d444375-fb52-4c02-bffa-586e123a31bd tempest-VolumesTransfersV355Test-1277892080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.577s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:07:27 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-8d444375-fb52-4c02-bffa-586e123a31bd tempest-VolumesTransfersV355Test-1277892080 None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:07:27 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-8d444375-fb52-4c02-bffa-586e123a31bd tempest-VolumesTransfersV355Test-1277892080 None] Deleted volume successfully. Apr 16 15:07:27 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-8d444375-fb52-4c02-bffa-586e123a31bd tempest-VolumesTransfersV355Test-1277892080 None] Lock "cinder-b1bd9430-24f1-43ed-bc69-5216b29ec1d6-delete_volume" released by "delete_volume" :: held 2.169s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:07:27 devstack sudo[86101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c094148b-93da-4fb4-98a0-02d6209cbae2.7eb754d2-8f70-4537-89ad-0b1a9cc212ee Apr 16 15:07:27 devstack sudo[86101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:07:28 devstack sudo[86101]: pam_unix(sudo:session): session closed for user root Apr 16 15:07:28 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-f1c6616d-f262-49a6-be14-54cba04576e8 tempest-VolumesDeleteCascade-1685423249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c094148b-93da-4fb4-98a0-02d6209cbae2.7eb754d2-8f70-4537-89ad-0b1a9cc212ee" returned: 0 in 0.740s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:07:28 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-f1c6616d-f262-49a6-be14-54cba04576e8 tempest-VolumesDeleteCascade-1685423249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c094148b-93da-4fb4-98a0-02d6209cbae2.7eb754d2-8f70-4537-89ad-0b1a9cc212ee {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:07:28 devstack sudo[86125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c094148b-93da-4fb4-98a0-02d6209cbae2.7eb754d2-8f70-4537-89ad-0b1a9cc212ee Apr 16 15:07:28 devstack sudo[86125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:07:28 devstack sudo[86125]: pam_unix(sudo:session): session closed for user root Apr 16 15:07:28 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-f1c6616d-f262-49a6-be14-54cba04576e8 tempest-VolumesDeleteCascade-1685423249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c094148b-93da-4fb4-98a0-02d6209cbae2.7eb754d2-8f70-4537-89ad-0b1a9cc212ee" returned: 0 in 0.573s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:07:28 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-f1c6616d-f262-49a6-be14-54cba04576e8 tempest-VolumesDeleteCascade-1685423249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c094148b-93da-4fb4-98a0-02d6209cbae2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c094148b-93da-4fb4-98a0-02d6209cbae2.bd1267d3-deae-4603-ad18-659487a36843 -F qcow2 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:07:28 devstack sudo[86130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c094148b-93da-4fb4-98a0-02d6209cbae2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c094148b-93da-4fb4-98a0-02d6209cbae2.bd1267d3-deae-4603-ad18-659487a36843 -F qcow2 Apr 16 15:07:28 devstack sudo[86130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:07:29 devstack sudo[86130]: pam_unix(sudo:session): session closed for user root Apr 16 15:07:29 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-f1c6616d-f262-49a6-be14-54cba04576e8 tempest-VolumesDeleteCascade-1685423249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c094148b-93da-4fb4-98a0-02d6209cbae2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c094148b-93da-4fb4-98a0-02d6209cbae2.bd1267d3-deae-4603-ad18-659487a36843 -F qcow2" returned: 0 in 0.569s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:07:29 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-f1c6616d-f262-49a6-be14-54cba04576e8 tempest-VolumesDeleteCascade-1685423249 None] Lock "cinder-quobyte-7eb754d2-8f70-4537-89ad-0b1a9cc212ee" released by "_delete_snapshot" :: held 5.202s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:07:29 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-f1c6616d-f262-49a6-be14-54cba04576e8 tempest-VolumesDeleteCascade-1685423249 None] Lock "cinder-quobyte-c094148b-93da-4fb4-98a0-02d6209cbae2" released by "delete_snapshot" :: held 5.214s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:07:29 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-f1c6616d-f262-49a6-be14-54cba04576e8 tempest-VolumesDeleteCascade-1685423249 None] Created reservations ['a54cba90-e0e4-4aaf-8350-a9bfa2bbb87d', 'ca80d62b-5224-4afd-8c83-9263062dd8af', '5f21112a-ca83-48f7-9d0c-2912745e91ba', '1fef8909-2d1d-4cd7-9572-7b8109ba3a21'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:07:29 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-f1c6616d-f262-49a6-be14-54cba04576e8 tempest-VolumesDeleteCascade-1685423249 None] Delete snapshot completed successfully. Apr 16 15:07:29 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-f1c6616d-f262-49a6-be14-54cba04576e8 tempest-VolumesDeleteCascade-1685423249 None] Lock "cinder-7eb754d2-8f70-4537-89ad-0b1a9cc212ee-delete_snapshot" released by "delete_snapshot" :: held 5.358s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:07:29 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-f1c6616d-f262-49a6-be14-54cba04576e8 tempest-VolumesDeleteCascade-1685423249 None] Acquiring lock "cinder-bd1267d3-deae-4603-ad18-659487a36843-delete_snapshot" by "delete_snapshot" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:07:29 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-f1c6616d-f262-49a6-be14-54cba04576e8 tempest-VolumesDeleteCascade-1685423249 None] Lock "cinder-bd1267d3-deae-4603-ad18-659487a36843-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:07:29 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-f1c6616d-f262-49a6-be14-54cba04576e8 tempest-VolumesDeleteCascade-1685423249 None] Acquiring lock "cinder-quobyte-c094148b-93da-4fb4-98a0-02d6209cbae2" by "delete_snapshot" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:07:29 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-f1c6616d-f262-49a6-be14-54cba04576e8 tempest-VolumesDeleteCascade-1685423249 None] Lock "cinder-quobyte-c094148b-93da-4fb4-98a0-02d6209cbae2" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:07:29 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-f1c6616d-f262-49a6-be14-54cba04576e8 tempest-VolumesDeleteCascade-1685423249 None] Acquiring lock "cinder-quobyte-bd1267d3-deae-4603-ad18-659487a36843" by "_delete_snapshot" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:07:29 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-f1c6616d-f262-49a6-be14-54cba04576e8 tempest-VolumesDeleteCascade-1685423249 None] Lock "cinder-quobyte-bd1267d3-deae-4603-ad18-659487a36843" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:07:29 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-f1c6616d-f262-49a6-be14-54cba04576e8 tempest-VolumesDeleteCascade-1685423249 None] Deleting offline snapshot bd1267d3-deae-4603-ad18-659487a36843 of volume c094148b-93da-4fb4-98a0-02d6209cbae2 {{(pid=82756) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 15:07:29 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-f1c6616d-f262-49a6-be14-54cba04576e8 tempest-VolumesDeleteCascade-1685423249 None] snapshot_file for this snap is: volume-c094148b-93da-4fb4-98a0-02d6209cbae2.bd1267d3-deae-4603-ad18-659487a36843 {{(pid=82756) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 15:07:29 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5657158-9daf-4f72-9714-43b0ef9db72e]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:07:29 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-f1c6616d-f262-49a6-be14-54cba04576e8 tempest-VolumesDeleteCascade-1685423249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c094148b-93da-4fb4-98a0-02d6209cbae2.bd1267d3-deae-4603-ad18-659487a36843 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:07:29 devstack sudo[86137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c094148b-93da-4fb4-98a0-02d6209cbae2.bd1267d3-deae-4603-ad18-659487a36843 Apr 16 15:07:29 devstack sudo[86137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:07:30 devstack sudo[86137]: pam_unix(sudo:session): session closed for user root Apr 16 15:07:30 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-f1c6616d-f262-49a6-be14-54cba04576e8 tempest-VolumesDeleteCascade-1685423249 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c094148b-93da-4fb4-98a0-02d6209cbae2.bd1267d3-deae-4603-ad18-659487a36843" returned: 0 in 0.609s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:07:30 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-f1c6616d-f262-49a6-be14-54cba04576e8 tempest-VolumesDeleteCascade-1685423249 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c094148b-93da-4fb4-98a0-02d6209cbae2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82756) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 15:07:30 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[55c43526-b4c1-4e93-89d6-59dca1577dc6]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:07:30 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-f1c6616d-f262-49a6-be14-54cba04576e8 tempest-VolumesDeleteCascade-1685423249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c094148b-93da-4fb4-98a0-02d6209cbae2 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:07:30 devstack sudo[86143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c094148b-93da-4fb4-98a0-02d6209cbae2 Apr 16 15:07:30 devstack sudo[86143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:07:30 devstack sudo[86143]: pam_unix(sudo:session): session closed for user root Apr 16 15:07:30 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-f1c6616d-f262-49a6-be14-54cba04576e8 tempest-VolumesDeleteCascade-1685423249 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c094148b-93da-4fb4-98a0-02d6209cbae2" returned: 0 in 0.595s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:07:30 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-f1c6616d-f262-49a6-be14-54cba04576e8 tempest-VolumesDeleteCascade-1685423249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c094148b-93da-4fb4-98a0-02d6209cbae2.bd1267d3-deae-4603-ad18-659487a36843 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:07:30 devstack sudo[86148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c094148b-93da-4fb4-98a0-02d6209cbae2.bd1267d3-deae-4603-ad18-659487a36843 Apr 16 15:07:30 devstack sudo[86148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:07:31 devstack sudo[86148]: pam_unix(sudo:session): session closed for user root Apr 16 15:07:31 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-f1c6616d-f262-49a6-be14-54cba04576e8 tempest-VolumesDeleteCascade-1685423249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c094148b-93da-4fb4-98a0-02d6209cbae2.bd1267d3-deae-4603-ad18-659487a36843" returned: 0 in 0.588s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:07:31 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-f1c6616d-f262-49a6-be14-54cba04576e8 tempest-VolumesDeleteCascade-1685423249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c094148b-93da-4fb4-98a0-02d6209cbae2.bd1267d3-deae-4603-ad18-659487a36843 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:07:31 devstack sudo[86153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c094148b-93da-4fb4-98a0-02d6209cbae2.bd1267d3-deae-4603-ad18-659487a36843 Apr 16 15:07:31 devstack sudo[86153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:07:32 devstack sudo[86153]: pam_unix(sudo:session): session closed for user root Apr 16 15:07:32 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-f1c6616d-f262-49a6-be14-54cba04576e8 tempest-VolumesDeleteCascade-1685423249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c094148b-93da-4fb4-98a0-02d6209cbae2.bd1267d3-deae-4603-ad18-659487a36843" returned: 0 in 0.609s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:07:32 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-f1c6616d-f262-49a6-be14-54cba04576e8 tempest-VolumesDeleteCascade-1685423249 None] Lock "cinder-quobyte-bd1267d3-deae-4603-ad18-659487a36843" released by "_delete_snapshot" :: held 2.463s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:07:32 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-f1c6616d-f262-49a6-be14-54cba04576e8 tempest-VolumesDeleteCascade-1685423249 None] Lock "cinder-quobyte-c094148b-93da-4fb4-98a0-02d6209cbae2" released by "delete_snapshot" :: held 2.478s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:07:32 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-f1c6616d-f262-49a6-be14-54cba04576e8 tempest-VolumesDeleteCascade-1685423249 None] Created reservations ['a09f91d6-e072-4337-a895-1e6052ae1af8', '9dfe52a9-eea2-4355-9175-e96038b22618', 'e9495ce5-057d-492d-9a74-1c222f936a4e', '359614a3-a736-4717-b4eb-13221eef5143'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:07:32 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-f1c6616d-f262-49a6-be14-54cba04576e8 tempest-VolumesDeleteCascade-1685423249 None] Delete snapshot completed successfully. Apr 16 15:07:32 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-f1c6616d-f262-49a6-be14-54cba04576e8 tempest-VolumesDeleteCascade-1685423249 None] Lock "cinder-bd1267d3-deae-4603-ad18-659487a36843-delete_snapshot" released by "delete_snapshot" :: held 2.592s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:07:32 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-f1c6616d-f262-49a6-be14-54cba04576e8 tempest-VolumesDeleteCascade-1685423249 None] Snapshots deleted, issuing volume delete {{(pid=82756) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 16 15:07:32 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-f1c6616d-f262-49a6-be14-54cba04576e8 tempest-VolumesDeleteCascade-1685423249 None] Acquiring lock "cinder-quobyte-c094148b-93da-4fb4-98a0-02d6209cbae2" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:07:32 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-f1c6616d-f262-49a6-be14-54cba04576e8 tempest-VolumesDeleteCascade-1685423249 None] Lock "cinder-quobyte-c094148b-93da-4fb4-98a0-02d6209cbae2" acquired by "delete_volume" :: waited 0.009s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:07:32 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac691aa0-cf5a-4d38-aa23-8331e5bf33e1]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:07:32 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-f1c6616d-f262-49a6-be14-54cba04576e8 tempest-VolumesDeleteCascade-1685423249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c094148b-93da-4fb4-98a0-02d6209cbae2 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:07:32 devstack sudo[86156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c094148b-93da-4fb4-98a0-02d6209cbae2 Apr 16 15:07:32 devstack sudo[86156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:07:32 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [None req-824ad9ff-a26c-402c-8a9f-60703a220a3d tempest-VolumesTransfersV357Test-2071776645 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82756) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 15:07:32 devstack sudo[86156]: pam_unix(sudo:session): session closed for user root Apr 16 15:07:33 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-824ad9ff-a26c-402c-8a9f-60703a220a3d tempest-VolumesTransfersV357Test-2071776645 None] Flow 'volume_create_manager' (6f0c062a-7692-44c5-a09a-ab31d1206ab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:07:33 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-824ad9ff-a26c-402c-8a9f-60703a220a3d tempest-VolumesTransfersV357Test-2071776645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a97ce42-37db-4685-84c9-2d2be7cbfdc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:07:33 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-f1c6616d-f262-49a6-be14-54cba04576e8 tempest-VolumesDeleteCascade-1685423249 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c094148b-93da-4fb4-98a0-02d6209cbae2" returned: 0 in 0.727s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:07:33 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-f1c6616d-f262-49a6-be14-54cba04576e8 tempest-VolumesDeleteCascade-1685423249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c094148b-93da-4fb4-98a0-02d6209cbae2 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:07:33 devstack sudo[86161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c094148b-93da-4fb4-98a0-02d6209cbae2 Apr 16 15:07:33 devstack sudo[86161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:07:33 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-824ad9ff-a26c-402c-8a9f-60703a220a3d tempest-VolumesTransfersV357Test-2071776645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a97ce42-37db-4685-84c9-2d2be7cbfdc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:07:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-625103051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5311bcd8-23a5-4843-8ae8-558980fa0342,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c84a831144e84855af9761e356399b0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:07:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:07:33Z,use_quota=True,user_id='88a5eb3417d24cc7a6b590d432a22089',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:07:33 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-824ad9ff-a26c-402c-8a9f-60703a220a3d tempest-VolumesTransfersV357Test-2071776645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e954c50-676d-4dad-8d0d-1663bfce2acd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:07:33 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-824ad9ff-a26c-402c-8a9f-60703a220a3d tempest-VolumesTransfersV357Test-2071776645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e954c50-676d-4dad-8d0d-1663bfce2acd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:07:33 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-824ad9ff-a26c-402c-8a9f-60703a220a3d tempest-VolumesTransfersV357Test-2071776645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29e3548e-d511-4dc0-ad74-7ebef15998c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:07:33 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-824ad9ff-a26c-402c-8a9f-60703a220a3d tempest-VolumesTransfersV357Test-2071776645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29e3548e-d511-4dc0-ad74-7ebef15998c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5311bcd8-23a5-4843-8ae8-558980fa0342', 'volume_name': 'volume-5311bcd8-23a5-4843-8ae8-558980fa0342', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:07:33 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-824ad9ff-a26c-402c-8a9f-60703a220a3d tempest-VolumesTransfersV357Test-2071776645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c4a9636-8f8e-4805-8584-6d092676dd0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:07:33 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-824ad9ff-a26c-402c-8a9f-60703a220a3d tempest-VolumesTransfersV357Test-2071776645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c4a9636-8f8e-4805-8584-6d092676dd0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:07:33 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-824ad9ff-a26c-402c-8a9f-60703a220a3d tempest-VolumesTransfersV357Test-2071776645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e172a111-1e5a-491e-b6ed-6500f2b28b8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:07:33 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-824ad9ff-a26c-402c-8a9f-60703a220a3d tempest-VolumesTransfersV357Test-2071776645 None] Volume 5311bcd8-23a5-4843-8ae8-558980fa0342: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5311bcd8-23a5-4843-8ae8-558980fa0342', 'volume_size': 1} Apr 16 15:07:33 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-824ad9ff-a26c-402c-8a9f-60703a220a3d tempest-VolumesTransfersV357Test-2071776645 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:07:33 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-824ad9ff-a26c-402c-8a9f-60703a220a3d tempest-VolumesTransfersV357Test-2071776645 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:07:33 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-824ad9ff-a26c-402c-8a9f-60703a220a3d tempest-VolumesTransfersV357Test-2071776645 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:07:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-625103051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5311bcd8-23a5-4843-8ae8-558980fa0342,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c84a831144e84855af9761e356399b0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:07:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:07:33Z,use_quota=True,user_id='88a5eb3417d24cc7a6b590d432a22089',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)}" {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 15:07:33 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-824ad9ff-a26c-402c-8a9f-60703a220a3d tempest-VolumesTransfersV357Test-2071776645 None] Creating volume 5311bcd8-23a5-4843-8ae8-558980fa0342 {{(pid=82756) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 15:07:33 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-824ad9ff-a26c-402c-8a9f-60703a220a3d tempest-VolumesTransfersV357Test-2071776645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:07:33 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-824ad9ff-a26c-402c-8a9f-60703a220a3d tempest-VolumesTransfersV357Test-2071776645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:07:33 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-824ad9ff-a26c-402c-8a9f-60703a220a3d tempest-VolumesTransfersV357Test-2071776645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:07:33 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-824ad9ff-a26c-402c-8a9f-60703a220a3d tempest-VolumesTransfersV357Test-2071776645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:07:33 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-824ad9ff-a26c-402c-8a9f-60703a220a3d tempest-VolumesTransfersV357Test-2071776645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:07:33 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-824ad9ff-a26c-402c-8a9f-60703a220a3d tempest-VolumesTransfersV357Test-2071776645 None] Selected osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 as target Quobyte volume. {{(pid=82756) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 15:07:33 devstack cinder-volume[82756]: INFO cinder.volume.drivers.remotefs [None req-824ad9ff-a26c-402c-8a9f-60703a220a3d tempest-VolumesTransfersV357Test-2071776645 None] casted to osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 Apr 16 15:07:33 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-824ad9ff-a26c-402c-8a9f-60703a220a3d tempest-VolumesTransfersV357Test-2071776645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-5311bcd8-23a5-4843-8ae8-558980fa0342 1073741824 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:07:33 devstack sudo[86163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-5311bcd8-23a5-4843-8ae8-558980fa0342 1073741824 Apr 16 15:07:33 devstack sudo[86163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:07:33 devstack sudo[86161]: pam_unix(sudo:session): session closed for user root Apr 16 15:07:33 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-f1c6616d-f262-49a6-be14-54cba04576e8 tempest-VolumesDeleteCascade-1685423249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c094148b-93da-4fb4-98a0-02d6209cbae2" returned: 0 in 0.519s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:07:33 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-f1c6616d-f262-49a6-be14-54cba04576e8 tempest-VolumesDeleteCascade-1685423249 None] Lock "cinder-quobyte-c094148b-93da-4fb4-98a0-02d6209cbae2" released by "delete_volume" :: held 1.278s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:07:33 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-f1c6616d-f262-49a6-be14-54cba04576e8 tempest-VolumesDeleteCascade-1685423249 None] Created reservations ['edc12a53-e29c-4fdf-ac7d-121d8623d68e', '5243223e-e545-4306-b580-7127168c0ec8', '0cb6e4d2-7fc2-4948-b3de-65dd1cf4f50a', 'db6e2347-75e0-4c9d-8559-6348fc331f57'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:07:33 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-f1c6616d-f262-49a6-be14-54cba04576e8 tempest-VolumesDeleteCascade-1685423249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:07:33 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-f1c6616d-f262-49a6-be14-54cba04576e8 tempest-VolumesDeleteCascade-1685423249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:07:33 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-f1c6616d-f262-49a6-be14-54cba04576e8 tempest-VolumesDeleteCascade-1685423249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:07:33 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-f1c6616d-f262-49a6-be14-54cba04576e8 tempest-VolumesDeleteCascade-1685423249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:07:33 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-f1c6616d-f262-49a6-be14-54cba04576e8 tempest-VolumesDeleteCascade-1685423249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:07:33 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-f1c6616d-f262-49a6-be14-54cba04576e8 tempest-VolumesDeleteCascade-1685423249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:07:33 devstack sudo[86172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:07:33 devstack sudo[86172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:07:33 devstack sudo[86163]: pam_unix(sudo:session): session closed for user root Apr 16 15:07:33 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-824ad9ff-a26c-402c-8a9f-60703a220a3d tempest-VolumesTransfersV357Test-2071776645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-5311bcd8-23a5-4843-8ae8-558980fa0342 1073741824" returned: 0 in 0.635s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:07:33 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-824ad9ff-a26c-402c-8a9f-60703a220a3d tempest-VolumesTransfersV357Test-2071776645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-5311bcd8-23a5-4843-8ae8-558980fa0342 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:07:33 devstack sudo[86174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-5311bcd8-23a5-4843-8ae8-558980fa0342 Apr 16 15:07:33 devstack sudo[86174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:07:34 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [None req-77116b0b-8f1e-4b08-8842-728fb6c606de tempest-VolumesDeleteCascade-1685423249 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82756) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 15:07:34 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-77116b0b-8f1e-4b08-8842-728fb6c606de tempest-VolumesDeleteCascade-1685423249 None] Flow 'volume_create_manager' (835d3fa8-85a6-429f-9182-d2d7f8c173a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:07:34 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-77116b0b-8f1e-4b08-8842-728fb6c606de tempest-VolumesDeleteCascade-1685423249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf6bf19b-be7b-4e87-9171-7ae2f032cd2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:07:34 devstack sudo[86174]: pam_unix(sudo:session): session closed for user root Apr 16 15:07:34 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-77116b0b-8f1e-4b08-8842-728fb6c606de tempest-VolumesDeleteCascade-1685423249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf6bf19b-be7b-4e87-9171-7ae2f032cd2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:07:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1683900091',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d3b91b0-ef1e-4e68-a25e-133629dde9b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ca70da607504e9b9bdcfc1193b266be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:07:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:07:34Z,use_quota=True,user_id='f6ed217abc8e463a91e2dc03ed09aa03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:07:34 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-77116b0b-8f1e-4b08-8842-728fb6c606de tempest-VolumesDeleteCascade-1685423249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42399ed0-99eb-4d8e-ae76-da30e77782cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:07:34 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-77116b0b-8f1e-4b08-8842-728fb6c606de tempest-VolumesDeleteCascade-1685423249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42399ed0-99eb-4d8e-ae76-da30e77782cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:07:34 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-77116b0b-8f1e-4b08-8842-728fb6c606de tempest-VolumesDeleteCascade-1685423249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2bcfbfd-467b-487d-a247-1f3507097e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:07:34 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-77116b0b-8f1e-4b08-8842-728fb6c606de tempest-VolumesDeleteCascade-1685423249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2bcfbfd-467b-487d-a247-1f3507097e53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d3b91b0-ef1e-4e68-a25e-133629dde9b5', 'volume_name': 'volume-2d3b91b0-ef1e-4e68-a25e-133629dde9b5', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:07:34 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-77116b0b-8f1e-4b08-8842-728fb6c606de tempest-VolumesDeleteCascade-1685423249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae4bd858-47ee-464f-83b3-bbd720ba6d18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:07:34 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-77116b0b-8f1e-4b08-8842-728fb6c606de tempest-VolumesDeleteCascade-1685423249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae4bd858-47ee-464f-83b3-bbd720ba6d18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:07:34 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-77116b0b-8f1e-4b08-8842-728fb6c606de tempest-VolumesDeleteCascade-1685423249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a75aa2ee-00b5-468f-a07c-a81e81b8db0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:07:34 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-77116b0b-8f1e-4b08-8842-728fb6c606de tempest-VolumesDeleteCascade-1685423249 None] Volume 2d3b91b0-ef1e-4e68-a25e-133629dde9b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d3b91b0-ef1e-4e68-a25e-133629dde9b5', 'volume_size': 1} Apr 16 15:07:34 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-77116b0b-8f1e-4b08-8842-728fb6c606de tempest-VolumesDeleteCascade-1685423249 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:07:34 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-824ad9ff-a26c-402c-8a9f-60703a220a3d tempest-VolumesTransfersV357Test-2071776645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-5311bcd8-23a5-4843-8ae8-558980fa0342" returned: 0 in 0.565s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:07:34 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-824ad9ff-a26c-402c-8a9f-60703a220a3d tempest-VolumesTransfersV357Test-2071776645 None] <== create_volume: return (1236ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'} {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 15:07:34 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-824ad9ff-a26c-402c-8a9f-60703a220a3d tempest-VolumesTransfersV357Test-2071776645 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.237s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:07:34 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-77116b0b-8f1e-4b08-8842-728fb6c606de tempest-VolumesDeleteCascade-1685423249 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:07:34 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-77116b0b-8f1e-4b08-8842-728fb6c606de tempest-VolumesDeleteCascade-1685423249 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:07:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1683900091',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d3b91b0-ef1e-4e68-a25e-133629dde9b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ca70da607504e9b9bdcfc1193b266be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:07:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:07:34Z,use_quota=True,user_id='f6ed217abc8e463a91e2dc03ed09aa03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)}" {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 15:07:34 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-77116b0b-8f1e-4b08-8842-728fb6c606de tempest-VolumesDeleteCascade-1685423249 None] Creating volume 2d3b91b0-ef1e-4e68-a25e-133629dde9b5 {{(pid=82756) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 15:07:34 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-77116b0b-8f1e-4b08-8842-728fb6c606de tempest-VolumesDeleteCascade-1685423249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:07:34 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-77116b0b-8f1e-4b08-8842-728fb6c606de tempest-VolumesDeleteCascade-1685423249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:07:34 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-77116b0b-8f1e-4b08-8842-728fb6c606de tempest-VolumesDeleteCascade-1685423249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:07:34 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-77116b0b-8f1e-4b08-8842-728fb6c606de tempest-VolumesDeleteCascade-1685423249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:07:34 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-77116b0b-8f1e-4b08-8842-728fb6c606de tempest-VolumesDeleteCascade-1685423249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:07:34 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-77116b0b-8f1e-4b08-8842-728fb6c606de tempest-VolumesDeleteCascade-1685423249 None] Selected osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 as target Quobyte volume. {{(pid=82756) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 15:07:34 devstack cinder-volume[82756]: INFO cinder.volume.drivers.remotefs [None req-77116b0b-8f1e-4b08-8842-728fb6c606de tempest-VolumesDeleteCascade-1685423249 None] casted to osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 Apr 16 15:07:34 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-77116b0b-8f1e-4b08-8842-728fb6c606de tempest-VolumesDeleteCascade-1685423249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2d3b91b0-ef1e-4e68-a25e-133629dde9b5 1073741824 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:07:34 devstack sudo[86172]: pam_unix(sudo:session): session closed for user root Apr 16 15:07:34 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-824ad9ff-a26c-402c-8a9f-60703a220a3d tempest-VolumesTransfersV357Test-2071776645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e172a111-1e5a-491e-b6ed-6500f2b28b8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5311bcd8-23a5-4843-8ae8-558980fa0342', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:07:34 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-824ad9ff-a26c-402c-8a9f-60703a220a3d tempest-VolumesTransfersV357Test-2071776645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c93a9e1-ec5d-4684-9d56-62684a8bc9df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:07:34 devstack sudo[86184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2d3b91b0-ef1e-4e68-a25e-133629dde9b5 1073741824 Apr 16 15:07:34 devstack sudo[86184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:07:34 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-f1c6616d-f262-49a6-be14-54cba04576e8 tempest-VolumesDeleteCascade-1685423249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.715s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:07:34 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-f1c6616d-f262-49a6-be14-54cba04576e8 tempest-VolumesDeleteCascade-1685423249 None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:07:34 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-f1c6616d-f262-49a6-be14-54cba04576e8 tempest-VolumesDeleteCascade-1685423249 None] Deleted volume successfully. Apr 16 15:07:34 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-824ad9ff-a26c-402c-8a9f-60703a220a3d tempest-VolumesTransfersV357Test-2071776645 None] Volume volume-5311bcd8-23a5-4843-8ae8-558980fa0342 (5311bcd8-23a5-4843-8ae8-558980fa0342): created successfully Apr 16 15:07:34 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-824ad9ff-a26c-402c-8a9f-60703a220a3d tempest-VolumesTransfersV357Test-2071776645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c93a9e1-ec5d-4684-9d56-62684a8bc9df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:07:34 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-824ad9ff-a26c-402c-8a9f-60703a220a3d tempest-VolumesTransfersV357Test-2071776645 None] Flow 'volume_create_manager' (6f0c062a-7692-44c5-a09a-ab31d1206ab6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:07:34 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-824ad9ff-a26c-402c-8a9f-60703a220a3d tempest-VolumesTransfersV357Test-2071776645 None] Created volume successfully. Apr 16 15:07:34 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-f1c6616d-f262-49a6-be14-54cba04576e8 tempest-VolumesDeleteCascade-1685423249 None] Lock "cinder-c094148b-93da-4fb4-98a0-02d6209cbae2-delete_volume" released by "delete_volume" :: held 10.174s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:07:35 devstack sudo[86184]: pam_unix(sudo:session): session closed for user root Apr 16 15:07:35 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-77116b0b-8f1e-4b08-8842-728fb6c606de tempest-VolumesDeleteCascade-1685423249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2d3b91b0-ef1e-4e68-a25e-133629dde9b5 1073741824" returned: 0 in 0.696s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:07:35 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-77116b0b-8f1e-4b08-8842-728fb6c606de tempest-VolumesDeleteCascade-1685423249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2d3b91b0-ef1e-4e68-a25e-133629dde9b5 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:07:35 devstack sudo[86206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2d3b91b0-ef1e-4e68-a25e-133629dde9b5 Apr 16 15:07:35 devstack sudo[86206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:07:35 devstack sudo[86206]: pam_unix(sudo:session): session closed for user root Apr 16 15:07:35 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-77116b0b-8f1e-4b08-8842-728fb6c606de tempest-VolumesDeleteCascade-1685423249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2d3b91b0-ef1e-4e68-a25e-133629dde9b5" returned: 0 in 0.485s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:07:35 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-77116b0b-8f1e-4b08-8842-728fb6c606de tempest-VolumesDeleteCascade-1685423249 None] <== create_volume: return (1218ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'} {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 15:07:35 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-77116b0b-8f1e-4b08-8842-728fb6c606de tempest-VolumesDeleteCascade-1685423249 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.224s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:07:35 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-77116b0b-8f1e-4b08-8842-728fb6c606de tempest-VolumesDeleteCascade-1685423249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a75aa2ee-00b5-468f-a07c-a81e81b8db0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d3b91b0-ef1e-4e68-a25e-133629dde9b5', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:07:35 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-77116b0b-8f1e-4b08-8842-728fb6c606de tempest-VolumesDeleteCascade-1685423249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79262c51-affc-4c3a-83da-7d4b97acd912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:07:35 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-ce425f08-da16-45a9-a03c-0a47f1622aaa tempest-VolumesTransfersV357Test-1330355766 None] Transfer volume completed successfully. Apr 16 15:07:35 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-77116b0b-8f1e-4b08-8842-728fb6c606de tempest-VolumesDeleteCascade-1685423249 None] Volume volume-2d3b91b0-ef1e-4e68-a25e-133629dde9b5 (2d3b91b0-ef1e-4e68-a25e-133629dde9b5): created successfully Apr 16 15:07:35 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-77116b0b-8f1e-4b08-8842-728fb6c606de tempest-VolumesDeleteCascade-1685423249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79262c51-affc-4c3a-83da-7d4b97acd912) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:07:35 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-77116b0b-8f1e-4b08-8842-728fb6c606de tempest-VolumesDeleteCascade-1685423249 None] Flow 'volume_create_manager' (835d3fa8-85a6-429f-9182-d2d7f8c173a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:07:35 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-77116b0b-8f1e-4b08-8842-728fb6c606de tempest-VolumesDeleteCascade-1685423249 None] Created volume successfully. Apr 16 15:07:36 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-68527c12-5468-47ac-b8de-e78aa9de03ed tempest-VolumesDeleteCascade-1685423249 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:07:36 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-68527c12-5468-47ac-b8de-e78aa9de03ed tempest-VolumesDeleteCascade-1685423249 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:07:36 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-68527c12-5468-47ac-b8de-e78aa9de03ed tempest-VolumesDeleteCascade-1685423249 None] Creating offline snapshot 16084838-8c99-40e4-967c-80ca7869fc98 of volume 2d3b91b0-ef1e-4e68-a25e-133629dde9b5 {{(pid=82756) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 16 15:07:36 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fb13bd7-1373-4f49-aa4e-a92ee5a1954e]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:07:36 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-68527c12-5468-47ac-b8de-e78aa9de03ed tempest-VolumesDeleteCascade-1685423249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2d3b91b0-ef1e-4e68-a25e-133629dde9b5 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:07:36 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-ef8f0446-6cb4-4e6d-8e9a-a1c132f606d2 tempest-VolumesTransfersV357Test-736880680 None] Acquiring lock "cinder-5311bcd8-23a5-4843-8ae8-558980fa0342-delete_volume" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:07:36 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-ef8f0446-6cb4-4e6d-8e9a-a1c132f606d2 tempest-VolumesTransfersV357Test-736880680 None] Lock "cinder-5311bcd8-23a5-4843-8ae8-558980fa0342-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:07:36 devstack sudo[86212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2d3b91b0-ef1e-4e68-a25e-133629dde9b5 Apr 16 15:07:36 devstack sudo[86212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:07:36 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-ef8f0446-6cb4-4e6d-8e9a-a1c132f606d2 tempest-VolumesTransfersV357Test-736880680 None] Acquiring lock "cinder-quobyte-5311bcd8-23a5-4843-8ae8-558980fa0342" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:07:36 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-ef8f0446-6cb4-4e6d-8e9a-a1c132f606d2 tempest-VolumesTransfersV357Test-736880680 None] Lock "cinder-quobyte-5311bcd8-23a5-4843-8ae8-558980fa0342" acquired by "delete_volume" :: waited 0.010s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:07:36 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[696ac4fe-13da-48d8-90c8-2e9d6efb3187]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:07:36 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-ef8f0446-6cb4-4e6d-8e9a-a1c132f606d2 tempest-VolumesTransfersV357Test-736880680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-5311bcd8-23a5-4843-8ae8-558980fa0342 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:07:36 devstack sudo[86214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-5311bcd8-23a5-4843-8ae8-558980fa0342 Apr 16 15:07:36 devstack sudo[86214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:07:37 devstack sudo[86212]: pam_unix(sudo:session): session closed for user root Apr 16 15:07:37 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-68527c12-5468-47ac-b8de-e78aa9de03ed tempest-VolumesDeleteCascade-1685423249 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2d3b91b0-ef1e-4e68-a25e-133629dde9b5" returned: 0 in 0.536s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:07:37 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-68527c12-5468-47ac-b8de-e78aa9de03ed tempest-VolumesDeleteCascade-1685423249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2d3b91b0-ef1e-4e68-a25e-133629dde9b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2d3b91b0-ef1e-4e68-a25e-133629dde9b5.16084838-8c99-40e4-967c-80ca7869fc98 1G {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:07:37 devstack sudo[86221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2d3b91b0-ef1e-4e68-a25e-133629dde9b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2d3b91b0-ef1e-4e68-a25e-133629dde9b5.16084838-8c99-40e4-967c-80ca7869fc98 1G Apr 16 15:07:37 devstack sudo[86221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:07:37 devstack cinder-volume[82756]: INFO cinder.volume.manager [req-603f2519-992d-44f7-b795-f24ec7f4af92 req-748ad633-54fd-4e07-9c90-ac4346a2ced7 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Terminate volume connection completed successfully. Apr 16 15:07:37 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [req-603f2519-992d-44f7-b795-f24ec7f4af92 req-748ad633-54fd-4e07-9c90-ac4346a2ced7 tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Deleting attachment fcef1686-eee6-4560-816c-d5b807e8ba82. {{(pid=82756) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 16 15:07:37 devstack sudo[86214]: pam_unix(sudo:session): session closed for user root Apr 16 15:07:37 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-ef8f0446-6cb4-4e6d-8e9a-a1c132f606d2 tempest-VolumesTransfersV357Test-736880680 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-5311bcd8-23a5-4843-8ae8-558980fa0342" returned: 0 in 0.546s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:07:37 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-ef8f0446-6cb4-4e6d-8e9a-a1c132f606d2 tempest-VolumesTransfersV357Test-736880680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-5311bcd8-23a5-4843-8ae8-558980fa0342 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:07:37 devstack sudo[86224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-5311bcd8-23a5-4843-8ae8-558980fa0342 Apr 16 15:07:37 devstack sudo[86224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:07:37 devstack sudo[86224]: pam_unix(sudo:session): session closed for user root Apr 16 15:07:37 devstack sudo[86221]: pam_unix(sudo:session): session closed for user root Apr 16 15:07:37 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-ef8f0446-6cb4-4e6d-8e9a-a1c132f606d2 tempest-VolumesTransfersV357Test-736880680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-5311bcd8-23a5-4843-8ae8-558980fa0342" returned: 0 in 0.607s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:07:37 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-ef8f0446-6cb4-4e6d-8e9a-a1c132f606d2 tempest-VolumesTransfersV357Test-736880680 None] Lock "cinder-quobyte-5311bcd8-23a5-4843-8ae8-558980fa0342" released by "delete_volume" :: held 1.185s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:07:37 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-68527c12-5468-47ac-b8de-e78aa9de03ed tempest-VolumesDeleteCascade-1685423249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2d3b91b0-ef1e-4e68-a25e-133629dde9b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2d3b91b0-ef1e-4e68-a25e-133629dde9b5.16084838-8c99-40e4-967c-80ca7869fc98 1G" returned: 0 in 0.759s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:07:37 devstack cinder-volume[82756]: DEBUG cinder.coordination [req-603f2519-992d-44f7-b795-f24ec7f4af92 req-0afc9b00-7957-4f39-b112-51f786b9053a tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Acquiring lock "cinder-80e7a5cb-9ef2-4aa9-91a6-6d7d841c82ae-delete_volume" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:07:37 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-68527c12-5468-47ac-b8de-e78aa9de03ed tempest-VolumesDeleteCascade-1685423249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d3b91b0-ef1e-4e68-a25e-133629dde9b5 -F qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2d3b91b0-ef1e-4e68-a25e-133629dde9b5.16084838-8c99-40e4-967c-80ca7869fc98 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:07:37 devstack sudo[86230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d3b91b0-ef1e-4e68-a25e-133629dde9b5 -F qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2d3b91b0-ef1e-4e68-a25e-133629dde9b5.16084838-8c99-40e4-967c-80ca7869fc98 Apr 16 15:07:37 devstack sudo[86230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:07:37 devstack cinder-volume[82756]: DEBUG cinder.coordination [req-603f2519-992d-44f7-b795-f24ec7f4af92 req-0afc9b00-7957-4f39-b112-51f786b9053a tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Lock "cinder-80e7a5cb-9ef2-4aa9-91a6-6d7d841c82ae-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:07:37 devstack cinder-volume[82756]: DEBUG cinder.coordination [req-603f2519-992d-44f7-b795-f24ec7f4af92 req-0afc9b00-7957-4f39-b112-51f786b9053a tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Acquiring lock "cinder-quobyte-80e7a5cb-9ef2-4aa9-91a6-6d7d841c82ae" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:07:37 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-ef8f0446-6cb4-4e6d-8e9a-a1c132f606d2 tempest-VolumesTransfersV357Test-736880680 None] Created reservations ['24f90f87-03ba-437c-a217-02a12f2ec691', '1f2c185b-1bbd-489e-8f7a-f8b2f404e47a', 'b67315ae-7f3c-409c-afaa-f5fd4579abd8', 'be2fca5b-9a6f-42fd-a144-7c92b380e55e'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:07:37 devstack cinder-volume[82756]: DEBUG cinder.coordination [req-603f2519-992d-44f7-b795-f24ec7f4af92 req-0afc9b00-7957-4f39-b112-51f786b9053a tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Lock "cinder-quobyte-80e7a5cb-9ef2-4aa9-91a6-6d7d841c82ae" acquired by "delete_volume" :: waited 0.015s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:07:37 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2aedc71-3bae-4571-b288-d7e08be31ea6]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:07:37 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [req-603f2519-992d-44f7-b795-f24ec7f4af92 req-0afc9b00-7957-4f39-b112-51f786b9053a tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-80e7a5cb-9ef2-4aa9-91a6-6d7d841c82ae {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:07:37 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-ef8f0446-6cb4-4e6d-8e9a-a1c132f606d2 tempest-VolumesTransfersV357Test-736880680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:07:37 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-ef8f0446-6cb4-4e6d-8e9a-a1c132f606d2 tempest-VolumesTransfersV357Test-736880680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:07:37 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-ef8f0446-6cb4-4e6d-8e9a-a1c132f606d2 tempest-VolumesTransfersV357Test-736880680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:07:37 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-ef8f0446-6cb4-4e6d-8e9a-a1c132f606d2 tempest-VolumesTransfersV357Test-736880680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:07:37 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-ef8f0446-6cb4-4e6d-8e9a-a1c132f606d2 tempest-VolumesTransfersV357Test-736880680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:07:37 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-ef8f0446-6cb4-4e6d-8e9a-a1c132f606d2 tempest-VolumesTransfersV357Test-736880680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:07:38 devstack sudo[86233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:07:38 devstack sudo[86233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:07:38 devstack sudo[86232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-80e7a5cb-9ef2-4aa9-91a6-6d7d841c82ae Apr 16 15:07:38 devstack sudo[86232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:07:38 devstack sudo[86230]: pam_unix(sudo:session): session closed for user root Apr 16 15:07:38 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-68527c12-5468-47ac-b8de-e78aa9de03ed tempest-VolumesDeleteCascade-1685423249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d3b91b0-ef1e-4e68-a25e-133629dde9b5 -F qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2d3b91b0-ef1e-4e68-a25e-133629dde9b5.16084838-8c99-40e4-967c-80ca7869fc98" returned: 0 in 0.619s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:07:38 devstack cinder-volume[82756]: WARNING cinder.volume.drivers.remotefs [None req-68527c12-5468-47ac-b8de-e78aa9de03ed tempest-VolumesDeleteCascade-1685423249 None] /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2d3b91b0-ef1e-4e68-a25e-133629dde9b5.16084838-8c99-40e4-967c-80ca7869fc98 is being set with open permissions: ugo+rw Apr 16 15:07:38 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-68527c12-5468-47ac-b8de-e78aa9de03ed tempest-VolumesDeleteCascade-1685423249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2d3b91b0-ef1e-4e68-a25e-133629dde9b5.16084838-8c99-40e4-967c-80ca7869fc98 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:07:38 devstack sudo[86243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2d3b91b0-ef1e-4e68-a25e-133629dde9b5.16084838-8c99-40e4-967c-80ca7869fc98 Apr 16 15:07:38 devstack sudo[86243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:07:38 devstack sudo[86232]: pam_unix(sudo:session): session closed for user root Apr 16 15:07:38 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [req-603f2519-992d-44f7-b795-f24ec7f4af92 req-0afc9b00-7957-4f39-b112-51f786b9053a tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-80e7a5cb-9ef2-4aa9-91a6-6d7d841c82ae" returned: 0 in 0.619s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:07:38 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [req-603f2519-992d-44f7-b795-f24ec7f4af92 req-0afc9b00-7957-4f39-b112-51f786b9053a tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-80e7a5cb-9ef2-4aa9-91a6-6d7d841c82ae {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:07:38 devstack sudo[86233]: pam_unix(sudo:session): session closed for user root Apr 16 15:07:38 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-ef8f0446-6cb4-4e6d-8e9a-a1c132f606d2 tempest-VolumesTransfersV357Test-736880680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.581s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:07:38 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-ef8f0446-6cb4-4e6d-8e9a-a1c132f606d2 tempest-VolumesTransfersV357Test-736880680 None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:07:38 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-ef8f0446-6cb4-4e6d-8e9a-a1c132f606d2 tempest-VolumesTransfersV357Test-736880680 None] Deleted volume successfully. Apr 16 15:07:38 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-ef8f0446-6cb4-4e6d-8e9a-a1c132f606d2 tempest-VolumesTransfersV357Test-736880680 None] Lock "cinder-5311bcd8-23a5-4843-8ae8-558980fa0342-delete_volume" released by "delete_volume" :: held 2.041s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:07:38 devstack sudo[86245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-80e7a5cb-9ef2-4aa9-91a6-6d7d841c82ae Apr 16 15:07:38 devstack sudo[86245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:07:39 devstack sudo[86243]: pam_unix(sudo:session): session closed for user root Apr 16 15:07:39 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-68527c12-5468-47ac-b8de-e78aa9de03ed tempest-VolumesDeleteCascade-1685423249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2d3b91b0-ef1e-4e68-a25e-133629dde9b5.16084838-8c99-40e4-967c-80ca7869fc98" returned: 0 in 0.620s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:07:39 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-68527c12-5468-47ac-b8de-e78aa9de03ed tempest-VolumesDeleteCascade-1685423249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2d3b91b0-ef1e-4e68-a25e-133629dde9b5.info {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:07:39 devstack sudo[86249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2d3b91b0-ef1e-4e68-a25e-133629dde9b5.info Apr 16 15:07:39 devstack sudo[86249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:07:39 devstack sudo[86245]: pam_unix(sudo:session): session closed for user root Apr 16 15:07:39 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [None req-f253edfa-9047-48c9-b806-5b764ba083e3 tempest-VolumesTransfersV357Test-2071776645 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82756) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 15:07:39 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-f253edfa-9047-48c9-b806-5b764ba083e3 tempest-VolumesTransfersV357Test-2071776645 None] Flow 'volume_create_manager' (4b2ac743-bad5-4cb0-a296-1c8746e04762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:07:39 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-f253edfa-9047-48c9-b806-5b764ba083e3 tempest-VolumesTransfersV357Test-2071776645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2260e72e-93a5-4057-8d03-8baac7266e30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:07:39 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [req-603f2519-992d-44f7-b795-f24ec7f4af92 req-0afc9b00-7957-4f39-b112-51f786b9053a tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-80e7a5cb-9ef2-4aa9-91a6-6d7d841c82ae" returned: 0 in 0.654s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:07:39 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-f253edfa-9047-48c9-b806-5b764ba083e3 tempest-VolumesTransfersV357Test-2071776645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2260e72e-93a5-4057-8d03-8baac7266e30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:07:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-254716724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7a75c04-4eda-410f-b18a-5519be01fdf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c84a831144e84855af9761e356399b0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:07:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:07:39Z,use_quota=True,user_id='88a5eb3417d24cc7a6b590d432a22089',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:07:39 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-f253edfa-9047-48c9-b806-5b764ba083e3 tempest-VolumesTransfersV357Test-2071776645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d93a09bd-70e8-461a-872c-4a1a39552152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:07:39 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-f253edfa-9047-48c9-b806-5b764ba083e3 tempest-VolumesTransfersV357Test-2071776645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d93a09bd-70e8-461a-872c-4a1a39552152) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:07:39 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-f253edfa-9047-48c9-b806-5b764ba083e3 tempest-VolumesTransfersV357Test-2071776645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d042820a-407e-4959-8f51-c35816a5b026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:07:39 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-f253edfa-9047-48c9-b806-5b764ba083e3 tempest-VolumesTransfersV357Test-2071776645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d042820a-407e-4959-8f51-c35816a5b026) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7a75c04-4eda-410f-b18a-5519be01fdf7', 'volume_name': 'volume-e7a75c04-4eda-410f-b18a-5519be01fdf7', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:07:39 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-f253edfa-9047-48c9-b806-5b764ba083e3 tempest-VolumesTransfersV357Test-2071776645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18066499-d6a1-438c-aeaf-7dd2162bb5ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:07:39 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-f253edfa-9047-48c9-b806-5b764ba083e3 tempest-VolumesTransfersV357Test-2071776645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18066499-d6a1-438c-aeaf-7dd2162bb5ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:07:39 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-f253edfa-9047-48c9-b806-5b764ba083e3 tempest-VolumesTransfersV357Test-2071776645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3b7bca2-31f9-4365-ac00-cbc1d023fbe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:07:39 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-f253edfa-9047-48c9-b806-5b764ba083e3 tempest-VolumesTransfersV357Test-2071776645 None] Volume e7a75c04-4eda-410f-b18a-5519be01fdf7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7a75c04-4eda-410f-b18a-5519be01fdf7', 'volume_size': 1} Apr 16 15:07:39 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-f253edfa-9047-48c9-b806-5b764ba083e3 tempest-VolumesTransfersV357Test-2071776645 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:07:39 devstack cinder-volume[82756]: DEBUG cinder.coordination [req-603f2519-992d-44f7-b795-f24ec7f4af92 req-0afc9b00-7957-4f39-b112-51f786b9053a tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Lock "cinder-quobyte-80e7a5cb-9ef2-4aa9-91a6-6d7d841c82ae" released by "delete_volume" :: held 1.335s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:07:39 devstack cinder-volume[82756]: DEBUG cinder.quota [req-603f2519-992d-44f7-b795-f24ec7f4af92 req-0afc9b00-7957-4f39-b112-51f786b9053a tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Created reservations ['ab9fd066-77c4-43e3-a37a-ddc2c8ad71bf', 'fd1e1a01-ebb0-4d2c-96cc-6a235b106798', 'a63d6ef2-0d05-4790-9daa-ee2bfa03d528', 'f535ae19-cb04-4d1e-8914-2531b6784988'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:07:39 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [req-603f2519-992d-44f7-b795-f24ec7f4af92 req-0afc9b00-7957-4f39-b112-51f786b9053a tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:07:39 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [req-603f2519-992d-44f7-b795-f24ec7f4af92 req-0afc9b00-7957-4f39-b112-51f786b9053a tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:07:39 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [req-603f2519-992d-44f7-b795-f24ec7f4af92 req-0afc9b00-7957-4f39-b112-51f786b9053a tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:07:39 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [req-603f2519-992d-44f7-b795-f24ec7f4af92 req-0afc9b00-7957-4f39-b112-51f786b9053a tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:07:39 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [req-603f2519-992d-44f7-b795-f24ec7f4af92 req-0afc9b00-7957-4f39-b112-51f786b9053a tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:07:39 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [req-603f2519-992d-44f7-b795-f24ec7f4af92 req-0afc9b00-7957-4f39-b112-51f786b9053a tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:07:39 devstack sudo[86251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:07:39 devstack sudo[86251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:07:39 devstack sudo[86249]: pam_unix(sudo:session): session closed for user root Apr 16 15:07:39 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-68527c12-5468-47ac-b8de-e78aa9de03ed tempest-VolumesDeleteCascade-1685423249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2d3b91b0-ef1e-4e68-a25e-133629dde9b5.info" returned: 0 in 0.678s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:07:39 devstack cinder-volume[82756]: WARNING cinder.volume.drivers.remotefs [None req-68527c12-5468-47ac-b8de-e78aa9de03ed tempest-VolumesDeleteCascade-1685423249 None] /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2d3b91b0-ef1e-4e68-a25e-133629dde9b5.info is being set with open permissions: ugo+rw Apr 16 15:07:39 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-68527c12-5468-47ac-b8de-e78aa9de03ed tempest-VolumesDeleteCascade-1685423249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2d3b91b0-ef1e-4e68-a25e-133629dde9b5.info {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:07:39 devstack sudo[86254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2d3b91b0-ef1e-4e68-a25e-133629dde9b5.info Apr 16 15:07:39 devstack sudo[86254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:07:39 devstack sudo[86251]: pam_unix(sudo:session): session closed for user root Apr 16 15:07:39 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [req-603f2519-992d-44f7-b795-f24ec7f4af92 req-0afc9b00-7957-4f39-b112-51f786b9053a tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.551s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:07:39 devstack cinder-volume[82756]: DEBUG cinder.manager [req-603f2519-992d-44f7-b795-f24ec7f4af92 req-0afc9b00-7957-4f39-b112-51f786b9053a tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:07:39 devstack cinder-volume[82756]: INFO cinder.volume.manager [req-603f2519-992d-44f7-b795-f24ec7f4af92 req-0afc9b00-7957-4f39-b112-51f786b9053a tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Deleted volume successfully. Apr 16 15:07:39 devstack cinder-volume[82756]: DEBUG cinder.coordination [req-603f2519-992d-44f7-b795-f24ec7f4af92 req-0afc9b00-7957-4f39-b112-51f786b9053a tempest-ServerBootFromVolumeStableRescueTest-1755722048 None] Lock "cinder-80e7a5cb-9ef2-4aa9-91a6-6d7d841c82ae-delete_volume" released by "delete_volume" :: held 2.071s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:07:40 devstack sudo[86254]: pam_unix(sudo:session): session closed for user root Apr 16 15:07:40 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-68527c12-5468-47ac-b8de-e78aa9de03ed tempest-VolumesDeleteCascade-1685423249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2d3b91b0-ef1e-4e68-a25e-133629dde9b5.info" returned: 0 in 0.559s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:07:40 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-68527c12-5468-47ac-b8de-e78aa9de03ed tempest-VolumesDeleteCascade-1685423249 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.856s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:07:40 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-f253edfa-9047-48c9-b806-5b764ba083e3 tempest-VolumesTransfersV357Test-2071776645 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.092s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:07:40 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-f253edfa-9047-48c9-b806-5b764ba083e3 tempest-VolumesTransfersV357Test-2071776645 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:07:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-254716724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7a75c04-4eda-410f-b18a-5519be01fdf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c84a831144e84855af9761e356399b0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:07:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:07:39Z,use_quota=True,user_id='88a5eb3417d24cc7a6b590d432a22089',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)}" {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 15:07:40 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-f253edfa-9047-48c9-b806-5b764ba083e3 tempest-VolumesTransfersV357Test-2071776645 None] Creating volume e7a75c04-4eda-410f-b18a-5519be01fdf7 {{(pid=82756) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 15:07:40 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-f253edfa-9047-48c9-b806-5b764ba083e3 tempest-VolumesTransfersV357Test-2071776645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:07:40 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-f253edfa-9047-48c9-b806-5b764ba083e3 tempest-VolumesTransfersV357Test-2071776645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:07:40 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-f253edfa-9047-48c9-b806-5b764ba083e3 tempest-VolumesTransfersV357Test-2071776645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:07:40 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-f253edfa-9047-48c9-b806-5b764ba083e3 tempest-VolumesTransfersV357Test-2071776645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:07:40 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-f253edfa-9047-48c9-b806-5b764ba083e3 tempest-VolumesTransfersV357Test-2071776645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:07:40 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-f253edfa-9047-48c9-b806-5b764ba083e3 tempest-VolumesTransfersV357Test-2071776645 None] Selected osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 as target Quobyte volume. {{(pid=82756) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 15:07:40 devstack cinder-volume[82756]: INFO cinder.volume.drivers.remotefs [None req-f253edfa-9047-48c9-b806-5b764ba083e3 tempest-VolumesTransfersV357Test-2071776645 None] casted to osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 Apr 16 15:07:40 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-f253edfa-9047-48c9-b806-5b764ba083e3 tempest-VolumesTransfersV357Test-2071776645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-e7a75c04-4eda-410f-b18a-5519be01fdf7 1073741824 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:07:40 devstack sudo[86258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-e7a75c04-4eda-410f-b18a-5519be01fdf7 1073741824 Apr 16 15:07:40 devstack sudo[86258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:07:40 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-68527c12-5468-47ac-b8de-e78aa9de03ed tempest-VolumesDeleteCascade-1685423249 None] Create snapshot completed successfully Apr 16 15:07:41 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c154fe5-6050-4611-81fd-e913beab505a tempest-VolumesDeleteCascade-1685423249 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82756) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 15:07:41 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-4c154fe5-6050-4611-81fd-e913beab505a tempest-VolumesDeleteCascade-1685423249 None] Flow 'volume_create_manager' (ae70cc28-b9f1-47dd-895b-f1a159455ab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:07:41 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-4c154fe5-6050-4611-81fd-e913beab505a tempest-VolumesDeleteCascade-1685423249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a325d7cd-fcff-4ad0-871a-7c90d87836aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:07:41 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-4c154fe5-6050-4611-81fd-e913beab505a tempest-VolumesDeleteCascade-1685423249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a325d7cd-fcff-4ad0-871a-7c90d87836aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:07:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-673511191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9dbeb64-8654-4914-bc22-1c12451ec50e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ca70da607504e9b9bdcfc1193b266be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:07:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=16084838-8c99-40e4-967c-80ca7869fc98,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:07:41Z,use_quota=True,user_id='f6ed217abc8e463a91e2dc03ed09aa03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:07:41 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-4c154fe5-6050-4611-81fd-e913beab505a tempest-VolumesDeleteCascade-1685423249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57abb662-b1a1-4e13-9cd8-30f99318ad51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:07:41 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-4c154fe5-6050-4611-81fd-e913beab505a tempest-VolumesDeleteCascade-1685423249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57abb662-b1a1-4e13-9cd8-30f99318ad51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:07:41 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-4c154fe5-6050-4611-81fd-e913beab505a tempest-VolumesDeleteCascade-1685423249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (318c0faf-5d94-45ca-a0e4-db78b82c4a95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:07:41 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-4c154fe5-6050-4611-81fd-e913beab505a tempest-VolumesDeleteCascade-1685423249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (318c0faf-5d94-45ca-a0e4-db78b82c4a95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f9dbeb64-8654-4914-bc22-1c12451ec50e', 'volume_name': 'volume-f9dbeb64-8654-4914-bc22-1c12451ec50e', 'volume_size': 1, 'snapshot_id': '16084838-8c99-40e4-967c-80ca7869fc98'}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:07:41 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-4c154fe5-6050-4611-81fd-e913beab505a tempest-VolumesDeleteCascade-1685423249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (160a7bdf-8a41-44ee-b82b-e1c14163d917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:07:41 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-4c154fe5-6050-4611-81fd-e913beab505a tempest-VolumesDeleteCascade-1685423249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (160a7bdf-8a41-44ee-b82b-e1c14163d917) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:07:41 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-4c154fe5-6050-4611-81fd-e913beab505a tempest-VolumesDeleteCascade-1685423249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1e0359f-66ae-48c9-9f41-fbad7a9eb7c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:07:41 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-4c154fe5-6050-4611-81fd-e913beab505a tempest-VolumesDeleteCascade-1685423249 None] Volume f9dbeb64-8654-4914-bc22-1c12451ec50e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f9dbeb64-8654-4914-bc22-1c12451ec50e', 'volume_size': 1, 'snapshot_id': '16084838-8c99-40e4-967c-80ca7869fc98'} Apr 16 15:07:41 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-4c154fe5-6050-4611-81fd-e913beab505a tempest-VolumesDeleteCascade-1685423249 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:07:41 devstack sudo[86258]: pam_unix(sudo:session): session closed for user root Apr 16 15:07:41 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-f253edfa-9047-48c9-b806-5b764ba083e3 tempest-VolumesTransfersV357Test-2071776645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-e7a75c04-4eda-410f-b18a-5519be01fdf7 1073741824" returned: 0 in 0.821s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:07:41 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-f253edfa-9047-48c9-b806-5b764ba083e3 tempest-VolumesTransfersV357Test-2071776645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-e7a75c04-4eda-410f-b18a-5519be01fdf7 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:07:41 devstack sudo[86263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-e7a75c04-4eda-410f-b18a-5519be01fdf7 Apr 16 15:07:41 devstack sudo[86263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:07:41 devstack sudo[86263]: pam_unix(sudo:session): session closed for user root Apr 16 15:07:41 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-f253edfa-9047-48c9-b806-5b764ba083e3 tempest-VolumesTransfersV357Test-2071776645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-e7a75c04-4eda-410f-b18a-5519be01fdf7" returned: 0 in 0.633s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:07:41 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-f253edfa-9047-48c9-b806-5b764ba083e3 tempest-VolumesTransfersV357Test-2071776645 None] <== create_volume: return (1494ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'} {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 15:07:41 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-f253edfa-9047-48c9-b806-5b764ba083e3 tempest-VolumesTransfersV357Test-2071776645 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.496s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:07:41 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-4c154fe5-6050-4611-81fd-e913beab505a tempest-VolumesDeleteCascade-1685423249 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.682s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:07:41 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-4c154fe5-6050-4611-81fd-e913beab505a tempest-VolumesDeleteCascade-1685423249 None] Acquiring lock "cinder-quobyte-16084838-8c99-40e4-967c-80ca7869fc98-f9dbeb64-8654-4914-bc22-1c12451ec50e" by "_create_volume_from_snapshot" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:07:41 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-f253edfa-9047-48c9-b806-5b764ba083e3 tempest-VolumesTransfersV357Test-2071776645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3b7bca2-31f9-4365-ac00-cbc1d023fbe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7a75c04-4eda-410f-b18a-5519be01fdf7', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:07:41 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-f253edfa-9047-48c9-b806-5b764ba083e3 tempest-VolumesTransfersV357Test-2071776645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (359ced4b-ba7f-4c84-826b-35fc91409ba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:07:41 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-4c154fe5-6050-4611-81fd-e913beab505a tempest-VolumesDeleteCascade-1685423249 None] Lock "cinder-quobyte-16084838-8c99-40e4-967c-80ca7869fc98-f9dbeb64-8654-4914-bc22-1c12451ec50e" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:07:41 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-4c154fe5-6050-4611-81fd-e913beab505a tempest-VolumesDeleteCascade-1685423249 None] Creating volume f9dbeb64-8654-4914-bc22-1c12451ec50e from snapshot 16084838-8c99-40e4-967c-80ca7869fc98 {{(pid=82756) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 16 15:07:41 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-4c154fe5-6050-4611-81fd-e913beab505a tempest-VolumesDeleteCascade-1685423249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:07:41 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-4c154fe5-6050-4611-81fd-e913beab505a tempest-VolumesDeleteCascade-1685423249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:07:41 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-4c154fe5-6050-4611-81fd-e913beab505a tempest-VolumesDeleteCascade-1685423249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:07:41 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-4c154fe5-6050-4611-81fd-e913beab505a tempest-VolumesDeleteCascade-1685423249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:07:41 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-4c154fe5-6050-4611-81fd-e913beab505a tempest-VolumesDeleteCascade-1685423249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:07:41 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-4c154fe5-6050-4611-81fd-e913beab505a tempest-VolumesDeleteCascade-1685423249 None] Selected osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 as target Quobyte volume. {{(pid=82756) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 15:07:41 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-4c154fe5-6050-4611-81fd-e913beab505a tempest-VolumesDeleteCascade-1685423249 None] Acquiring lock "cinder-quobyte-f9dbeb64-8654-4914-bc22-1c12451ec50e" by "_copy_volume_from_snapshot" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:07:41 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-f253edfa-9047-48c9-b806-5b764ba083e3 tempest-VolumesTransfersV357Test-2071776645 None] Volume volume-e7a75c04-4eda-410f-b18a-5519be01fdf7 (e7a75c04-4eda-410f-b18a-5519be01fdf7): created successfully Apr 16 15:07:41 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-f253edfa-9047-48c9-b806-5b764ba083e3 tempest-VolumesTransfersV357Test-2071776645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (359ced4b-ba7f-4c84-826b-35fc91409ba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:07:41 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-f253edfa-9047-48c9-b806-5b764ba083e3 tempest-VolumesTransfersV357Test-2071776645 None] Flow 'volume_create_manager' (4b2ac743-bad5-4cb0-a296-1c8746e04762) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:07:41 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-4c154fe5-6050-4611-81fd-e913beab505a tempest-VolumesDeleteCascade-1685423249 None] Lock "cinder-quobyte-f9dbeb64-8654-4914-bc22-1c12451ec50e" acquired by "_copy_volume_from_snapshot" :: waited 0.037s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:07:41 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-4c154fe5-6050-4611-81fd-e913beab505a tempest-VolumesDeleteCascade-1685423249 None] snapshot: 16084838-8c99-40e4-967c-80ca7869fc98, volume: f9dbeb64-8654-4914-bc22-1c12451ec50e, {{(pid=82756) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 16 15:07:41 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-f253edfa-9047-48c9-b806-5b764ba083e3 tempest-VolumesTransfersV357Test-2071776645 None] Created volume successfully. Apr 16 15:07:41 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-4c154fe5-6050-4611-81fd-e913beab505a tempest-VolumesDeleteCascade-1685423249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:07:41 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-4c154fe5-6050-4611-81fd-e913beab505a tempest-VolumesDeleteCascade-1685423249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:07:41 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-4c154fe5-6050-4611-81fd-e913beab505a tempest-VolumesDeleteCascade-1685423249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:07:41 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-4c154fe5-6050-4611-81fd-e913beab505a tempest-VolumesDeleteCascade-1685423249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:07:41 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-4c154fe5-6050-4611-81fd-e913beab505a tempest-VolumesDeleteCascade-1685423249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:07:41 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[158cf93b-2845-4ab7-b7d6-b4f0a63372ba]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:07:41 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-4c154fe5-6050-4611-81fd-e913beab505a tempest-VolumesDeleteCascade-1685423249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2d3b91b0-ef1e-4e68-a25e-133629dde9b5.16084838-8c99-40e4-967c-80ca7869fc98 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:07:42 devstack sudo[86267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2d3b91b0-ef1e-4e68-a25e-133629dde9b5.16084838-8c99-40e4-967c-80ca7869fc98 Apr 16 15:07:42 devstack sudo[86267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:07:42 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-79424b7b-32fd-4ff7-8373-08b6eb4460f3 tempest-VolumesTransfersV357Test-736880680 None] Acquiring lock "cinder-e7a75c04-4eda-410f-b18a-5519be01fdf7-delete_volume" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:07:42 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-79424b7b-32fd-4ff7-8373-08b6eb4460f3 tempest-VolumesTransfersV357Test-736880680 None] Lock "cinder-e7a75c04-4eda-410f-b18a-5519be01fdf7-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:07:42 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-79424b7b-32fd-4ff7-8373-08b6eb4460f3 tempest-VolumesTransfersV357Test-736880680 None] Acquiring lock "cinder-quobyte-e7a75c04-4eda-410f-b18a-5519be01fdf7" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:07:42 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-79424b7b-32fd-4ff7-8373-08b6eb4460f3 tempest-VolumesTransfersV357Test-736880680 None] Lock "cinder-quobyte-e7a75c04-4eda-410f-b18a-5519be01fdf7" acquired by "delete_volume" :: waited 0.010s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:07:42 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f7c3fa7-1f52-4fb8-be05-9295259c4f2d]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:07:42 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-79424b7b-32fd-4ff7-8373-08b6eb4460f3 tempest-VolumesTransfersV357Test-736880680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-e7a75c04-4eda-410f-b18a-5519be01fdf7 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:07:42 devstack sudo[86267]: pam_unix(sudo:session): session closed for user root Apr 16 15:07:42 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-4c154fe5-6050-4611-81fd-e913beab505a tempest-VolumesDeleteCascade-1685423249 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2d3b91b0-ef1e-4e68-a25e-133629dde9b5.16084838-8c99-40e4-967c-80ca7869fc98" returned: 0 in 0.916s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:07:42 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-4c154fe5-6050-4611-81fd-e913beab505a tempest-VolumesDeleteCascade-1685423249 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2d3b91b0-ef1e-4e68-a25e-133629dde9b5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82756) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 15:07:42 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-4c154fe5-6050-4611-81fd-e913beab505a tempest-VolumesDeleteCascade-1685423249 None] will copy from snapshot at /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2d3b91b0-ef1e-4e68-a25e-133629dde9b5 {{(pid=82756) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 16 15:07:42 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-4c154fe5-6050-4611-81fd-e913beab505a tempest-VolumesDeleteCascade-1685423249 None] Creating direct copy from snapshot {{(pid=82756) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 16 15:07:42 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[2adbd463-3ed1-4da7-8402-04ce9fc1a98b]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:07:42 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-4c154fe5-6050-4611-81fd-e913beab505a tempest-VolumesDeleteCascade-1685423249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2d3b91b0-ef1e-4e68-a25e-133629dde9b5 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:07:42 devstack sudo[86281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-e7a75c04-4eda-410f-b18a-5519be01fdf7 Apr 16 15:07:42 devstack sudo[86281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:07:42 devstack sudo[86295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2d3b91b0-ef1e-4e68-a25e-133629dde9b5 Apr 16 15:07:42 devstack sudo[86295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:07:43 devstack sudo[86281]: pam_unix(sudo:session): session closed for user root Apr 16 15:07:43 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-79424b7b-32fd-4ff7-8373-08b6eb4460f3 tempest-VolumesTransfersV357Test-736880680 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-e7a75c04-4eda-410f-b18a-5519be01fdf7" returned: 0 in 0.660s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:07:43 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-79424b7b-32fd-4ff7-8373-08b6eb4460f3 tempest-VolumesTransfersV357Test-736880680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-e7a75c04-4eda-410f-b18a-5519be01fdf7 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:07:43 devstack sudo[86308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-e7a75c04-4eda-410f-b18a-5519be01fdf7 Apr 16 15:07:43 devstack sudo[86308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:07:43 devstack sudo[86295]: pam_unix(sudo:session): session closed for user root Apr 16 15:07:43 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-4c154fe5-6050-4611-81fd-e913beab505a tempest-VolumesDeleteCascade-1685423249 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2d3b91b0-ef1e-4e68-a25e-133629dde9b5" returned: 0 in 0.627s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:07:43 devstack cinder-volume[82756]: DEBUG cinder.utils [None req-4c154fe5-6050-4611-81fd-e913beab505a tempest-VolumesDeleteCascade-1685423249 None] Path /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-f9dbeb64-8654-4914-bc22-1c12451ec50e not found in is_blk_device check {{(pid=82756) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 16 15:07:43 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-4c154fe5-6050-4611-81fd-e913beab505a tempest-VolumesDeleteCascade-1685423249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2d3b91b0-ef1e-4e68-a25e-133629dde9b5 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-f9dbeb64-8654-4914-bc22-1c12451ec50e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:07:43 devstack sudo[86311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2d3b91b0-ef1e-4e68-a25e-133629dde9b5 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-f9dbeb64-8654-4914-bc22-1c12451ec50e Apr 16 15:07:43 devstack sudo[86311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:07:43 devstack sudo[86308]: pam_unix(sudo:session): session closed for user root Apr 16 15:07:43 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-79424b7b-32fd-4ff7-8373-08b6eb4460f3 tempest-VolumesTransfersV357Test-736880680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-e7a75c04-4eda-410f-b18a-5519be01fdf7" returned: 0 in 0.524s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:07:43 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-79424b7b-32fd-4ff7-8373-08b6eb4460f3 tempest-VolumesTransfersV357Test-736880680 None] Lock "cinder-quobyte-e7a75c04-4eda-410f-b18a-5519be01fdf7" released by "delete_volume" :: held 1.222s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:07:44 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-79424b7b-32fd-4ff7-8373-08b6eb4460f3 tempest-VolumesTransfersV357Test-736880680 None] Created reservations ['3ac1f82e-ac3e-47fd-8b6b-e79ec23c7f19', '62604efb-dac5-4c36-ab0c-1075ba0fef84', '53965079-a383-4458-864d-4642e5066f9e', 'e2cb632e-b681-4974-a786-5be7b8320dba'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:07:44 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-79424b7b-32fd-4ff7-8373-08b6eb4460f3 tempest-VolumesTransfersV357Test-736880680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:07:44 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-79424b7b-32fd-4ff7-8373-08b6eb4460f3 tempest-VolumesTransfersV357Test-736880680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:07:44 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-79424b7b-32fd-4ff7-8373-08b6eb4460f3 tempest-VolumesTransfersV357Test-736880680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:07:44 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-79424b7b-32fd-4ff7-8373-08b6eb4460f3 tempest-VolumesTransfersV357Test-736880680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:07:44 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-79424b7b-32fd-4ff7-8373-08b6eb4460f3 tempest-VolumesTransfersV357Test-736880680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:07:44 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-79424b7b-32fd-4ff7-8373-08b6eb4460f3 tempest-VolumesTransfersV357Test-736880680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:07:44 devstack sudo[86320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:07:44 devstack sudo[86320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:07:45 devstack sudo[86320]: pam_unix(sudo:session): session closed for user root Apr 16 15:07:45 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-79424b7b-32fd-4ff7-8373-08b6eb4460f3 tempest-VolumesTransfersV357Test-736880680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 1.674s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:07:45 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-79424b7b-32fd-4ff7-8373-08b6eb4460f3 tempest-VolumesTransfersV357Test-736880680 None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:07:45 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-79424b7b-32fd-4ff7-8373-08b6eb4460f3 tempest-VolumesTransfersV357Test-736880680 None] Deleted volume successfully. Apr 16 15:07:45 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-79424b7b-32fd-4ff7-8373-08b6eb4460f3 tempest-VolumesTransfersV357Test-736880680 None] Lock "cinder-e7a75c04-4eda-410f-b18a-5519be01fdf7-delete_volume" released by "delete_volume" :: held 3.115s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:07:46 devstack sudo[86311]: pam_unix(sudo:session): session closed for user root Apr 16 15:07:46 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-4c154fe5-6050-4611-81fd-e913beab505a tempest-VolumesDeleteCascade-1685423249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2d3b91b0-ef1e-4e68-a25e-133629dde9b5 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-f9dbeb64-8654-4914-bc22-1c12451ec50e" returned: 0 in 2.754s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:07:46 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8606226-0d79-4f01-9a75-a20d034efa1e]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:07:46 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-4c154fe5-6050-4611-81fd-e913beab505a tempest-VolumesDeleteCascade-1685423249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2d3b91b0-ef1e-4e68-a25e-133629dde9b5 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:07:46 devstack sudo[86333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2d3b91b0-ef1e-4e68-a25e-133629dde9b5 Apr 16 15:07:46 devstack sudo[86333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:07:46 devstack sudo[86333]: pam_unix(sudo:session): session closed for user root Apr 16 15:07:46 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-4c154fe5-6050-4611-81fd-e913beab505a tempest-VolumesDeleteCascade-1685423249 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2d3b91b0-ef1e-4e68-a25e-133629dde9b5" returned: 0 in 0.647s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:07:46 devstack cinder-volume[82756]: DEBUG cinder.image.image_utils [None req-4c154fe5-6050-4611-81fd-e913beab505a tempest-VolumesDeleteCascade-1685423249 None] Image conversion details: src /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2d3b91b0-ef1e-4e68-a25e-133629dde9b5, size 1024.00 MB, duration 2.75 sec, destination /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-f9dbeb64-8654-4914-bc22-1c12451ec50e {{(pid=82756) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 15:07:46 devstack cinder-volume[82756]: INFO cinder.image.image_utils [None req-4c154fe5-6050-4611-81fd-e913beab505a tempest-VolumesDeleteCascade-1685423249 None] Converted 1024.00 MB image at 371.76 MB/s Apr 16 15:07:46 devstack cinder-volume[82756]: WARNING cinder.volume.drivers.remotefs [None req-4c154fe5-6050-4611-81fd-e913beab505a tempest-VolumesDeleteCascade-1685423249 None] /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-f9dbeb64-8654-4914-bc22-1c12451ec50e is being set with open permissions: ugo+rw Apr 16 15:07:46 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-4c154fe5-6050-4611-81fd-e913beab505a tempest-VolumesDeleteCascade-1685423249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-f9dbeb64-8654-4914-bc22-1c12451ec50e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:07:46 devstack sudo[86338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-f9dbeb64-8654-4914-bc22-1c12451ec50e Apr 16 15:07:46 devstack sudo[86338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:07:47 devstack sudo[86338]: pam_unix(sudo:session): session closed for user root Apr 16 15:07:47 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-4c154fe5-6050-4611-81fd-e913beab505a tempest-VolumesDeleteCascade-1685423249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-f9dbeb64-8654-4914-bc22-1c12451ec50e" returned: 0 in 0.511s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:07:47 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-4c154fe5-6050-4611-81fd-e913beab505a tempest-VolumesDeleteCascade-1685423249 None] Lock "cinder-quobyte-f9dbeb64-8654-4914-bc22-1c12451ec50e" released by "_copy_volume_from_snapshot" :: held 5.532s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:07:47 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-4c154fe5-6050-4611-81fd-e913beab505a tempest-VolumesDeleteCascade-1685423249 None] Lock "cinder-quobyte-16084838-8c99-40e4-967c-80ca7869fc98-f9dbeb64-8654-4914-bc22-1c12451ec50e" released by "_create_volume_from_snapshot" :: held 5.580s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:07:47 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-4c154fe5-6050-4611-81fd-e913beab505a tempest-VolumesDeleteCascade-1685423249 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.604s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:07:47 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-4c154fe5-6050-4611-81fd-e913beab505a tempest-VolumesDeleteCascade-1685423249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1e0359f-66ae-48c9-9f41-fbad7a9eb7c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9dbeb64-8654-4914-bc22-1c12451ec50e', 'volume_size': 1, 'snapshot_id': '16084838-8c99-40e4-967c-80ca7869fc98'}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:07:47 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-4c154fe5-6050-4611-81fd-e913beab505a tempest-VolumesDeleteCascade-1685423249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b485b220-528a-46f9-b4c7-deac5c9a79f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:07:47 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-4c154fe5-6050-4611-81fd-e913beab505a tempest-VolumesDeleteCascade-1685423249 None] Volume volume-f9dbeb64-8654-4914-bc22-1c12451ec50e (f9dbeb64-8654-4914-bc22-1c12451ec50e): created successfully Apr 16 15:07:47 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-4c154fe5-6050-4611-81fd-e913beab505a tempest-VolumesDeleteCascade-1685423249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b485b220-528a-46f9-b4c7-deac5c9a79f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:07:47 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-4c154fe5-6050-4611-81fd-e913beab505a tempest-VolumesDeleteCascade-1685423249 None] Flow 'volume_create_manager' (ae70cc28-b9f1-47dd-895b-f1a159455ab3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:07:47 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-4c154fe5-6050-4611-81fd-e913beab505a tempest-VolumesDeleteCascade-1685423249 None] Created volume successfully. Apr 16 15:07:48 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-58be81a6-488f-47b2-b7fb-8cb205ae6c9a tempest-VolumesDeleteCascade-1685423249 None] Acquiring lock "cinder-2d3b91b0-ef1e-4e68-a25e-133629dde9b5-delete_volume" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:07:48 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-58be81a6-488f-47b2-b7fb-8cb205ae6c9a tempest-VolumesDeleteCascade-1685423249 None] Lock "cinder-2d3b91b0-ef1e-4e68-a25e-133629dde9b5-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:07:48 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-58be81a6-488f-47b2-b7fb-8cb205ae6c9a tempest-VolumesDeleteCascade-1685423249 None] Performing cascade delete. {{(pid=82756) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 16 15:07:48 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-58be81a6-488f-47b2-b7fb-8cb205ae6c9a tempest-VolumesDeleteCascade-1685423249 None] Acquiring lock "cinder-16084838-8c99-40e4-967c-80ca7869fc98-delete_snapshot" by "delete_snapshot" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:07:48 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-58be81a6-488f-47b2-b7fb-8cb205ae6c9a tempest-VolumesDeleteCascade-1685423249 None] Lock "cinder-16084838-8c99-40e4-967c-80ca7869fc98-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:07:48 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-58be81a6-488f-47b2-b7fb-8cb205ae6c9a tempest-VolumesDeleteCascade-1685423249 None] Acquiring lock "cinder-quobyte-2d3b91b0-ef1e-4e68-a25e-133629dde9b5" by "delete_snapshot" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:07:48 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-58be81a6-488f-47b2-b7fb-8cb205ae6c9a tempest-VolumesDeleteCascade-1685423249 None] Lock "cinder-quobyte-2d3b91b0-ef1e-4e68-a25e-133629dde9b5" acquired by "delete_snapshot" :: waited 0.017s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:07:48 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-58be81a6-488f-47b2-b7fb-8cb205ae6c9a tempest-VolumesDeleteCascade-1685423249 None] Acquiring lock "cinder-quobyte-16084838-8c99-40e4-967c-80ca7869fc98" by "_delete_snapshot" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:07:48 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-58be81a6-488f-47b2-b7fb-8cb205ae6c9a tempest-VolumesDeleteCascade-1685423249 None] Lock "cinder-quobyte-16084838-8c99-40e4-967c-80ca7869fc98" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:07:48 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-58be81a6-488f-47b2-b7fb-8cb205ae6c9a tempest-VolumesDeleteCascade-1685423249 None] Deleting offline snapshot 16084838-8c99-40e4-967c-80ca7869fc98 of volume 2d3b91b0-ef1e-4e68-a25e-133629dde9b5 {{(pid=82756) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 15:07:48 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-58be81a6-488f-47b2-b7fb-8cb205ae6c9a tempest-VolumesDeleteCascade-1685423249 None] snapshot_file for this snap is: volume-2d3b91b0-ef1e-4e68-a25e-133629dde9b5.16084838-8c99-40e4-967c-80ca7869fc98 {{(pid=82756) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 15:07:48 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ead1290-f52d-4ac3-ab87-d860ee841f9a]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:07:48 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-58be81a6-488f-47b2-b7fb-8cb205ae6c9a tempest-VolumesDeleteCascade-1685423249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2d3b91b0-ef1e-4e68-a25e-133629dde9b5.16084838-8c99-40e4-967c-80ca7869fc98 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:07:49 devstack sudo[86341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2d3b91b0-ef1e-4e68-a25e-133629dde9b5.16084838-8c99-40e4-967c-80ca7869fc98 Apr 16 15:07:49 devstack sudo[86341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:07:49 devstack sudo[86341]: pam_unix(sudo:session): session closed for user root Apr 16 15:07:49 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-58be81a6-488f-47b2-b7fb-8cb205ae6c9a tempest-VolumesDeleteCascade-1685423249 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2d3b91b0-ef1e-4e68-a25e-133629dde9b5.16084838-8c99-40e4-967c-80ca7869fc98" returned: 0 in 0.618s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:07:49 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-58be81a6-488f-47b2-b7fb-8cb205ae6c9a tempest-VolumesDeleteCascade-1685423249 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2d3b91b0-ef1e-4e68-a25e-133629dde9b5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82756) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 15:07:49 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[116452e4-49a6-45c9-a9b7-033ba27c2f04]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:07:49 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-58be81a6-488f-47b2-b7fb-8cb205ae6c9a tempest-VolumesDeleteCascade-1685423249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2d3b91b0-ef1e-4e68-a25e-133629dde9b5 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:07:49 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [None req-d664e920-e7e9-45eb-9646-a1ad4e1f7773 tempest-VolumesCloneNegativeTest-1896329593 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82756) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 15:07:49 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-d664e920-e7e9-45eb-9646-a1ad4e1f7773 tempest-VolumesCloneNegativeTest-1896329593 None] Flow 'volume_create_manager' (dca34e86-b3fa-4889-a20e-9e356c2694ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:07:49 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-d664e920-e7e9-45eb-9646-a1ad4e1f7773 tempest-VolumesCloneNegativeTest-1896329593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (627406bb-eac0-4dad-b4d9-2fa4004d6f10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:07:49 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-d664e920-e7e9-45eb-9646-a1ad4e1f7773 tempest-VolumesCloneNegativeTest-1896329593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (627406bb-eac0-4dad-b4d9-2fa4004d6f10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:07:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-966474793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eefc4958-dcb5-4821-803f-65598816685c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='394b71fccc3f4472b88f80a89a914c70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:07:50Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:07:50Z,use_quota=True,user_id='4fe3f8b001f3456887841ac3842e32a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:07:49 devstack sudo[86350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2d3b91b0-ef1e-4e68-a25e-133629dde9b5 Apr 16 15:07:49 devstack sudo[86350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:07:49 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-d664e920-e7e9-45eb-9646-a1ad4e1f7773 tempest-VolumesCloneNegativeTest-1896329593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e35822ed-2b86-43c2-aacb-26ec850a308f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:07:49 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-d664e920-e7e9-45eb-9646-a1ad4e1f7773 tempest-VolumesCloneNegativeTest-1896329593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e35822ed-2b86-43c2-aacb-26ec850a308f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:07:49 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-d664e920-e7e9-45eb-9646-a1ad4e1f7773 tempest-VolumesCloneNegativeTest-1896329593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (752e5ccd-59a7-4fd2-9045-f58d41af67c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:07:49 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-d664e920-e7e9-45eb-9646-a1ad4e1f7773 tempest-VolumesCloneNegativeTest-1896329593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (752e5ccd-59a7-4fd2-9045-f58d41af67c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eefc4958-dcb5-4821-803f-65598816685c', 'volume_name': 'volume-eefc4958-dcb5-4821-803f-65598816685c', 'volume_size': 2}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:07:49 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-d664e920-e7e9-45eb-9646-a1ad4e1f7773 tempest-VolumesCloneNegativeTest-1896329593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (840b0d2f-19d0-41e0-85a8-e28c83efbfe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:07:49 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-d664e920-e7e9-45eb-9646-a1ad4e1f7773 tempest-VolumesCloneNegativeTest-1896329593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (840b0d2f-19d0-41e0-85a8-e28c83efbfe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:07:49 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-d664e920-e7e9-45eb-9646-a1ad4e1f7773 tempest-VolumesCloneNegativeTest-1896329593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e65f9a3-78de-4f7f-9486-1818d0d46da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:07:49 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-d664e920-e7e9-45eb-9646-a1ad4e1f7773 tempest-VolumesCloneNegativeTest-1896329593 None] Volume eefc4958-dcb5-4821-803f-65598816685c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eefc4958-dcb5-4821-803f-65598816685c', 'volume_size': 2} Apr 16 15:07:49 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-d664e920-e7e9-45eb-9646-a1ad4e1f7773 tempest-VolumesCloneNegativeTest-1896329593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:07:49 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-d664e920-e7e9-45eb-9646-a1ad4e1f7773 tempest-VolumesCloneNegativeTest-1896329593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:07:49 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-d664e920-e7e9-45eb-9646-a1ad4e1f7773 tempest-VolumesCloneNegativeTest-1896329593 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:07:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-966474793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eefc4958-dcb5-4821-803f-65598816685c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='394b71fccc3f4472b88f80a89a914c70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:07:50Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:07:50Z,use_quota=True,user_id='4fe3f8b001f3456887841ac3842e32a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)}" {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 15:07:49 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-d664e920-e7e9-45eb-9646-a1ad4e1f7773 tempest-VolumesCloneNegativeTest-1896329593 None] Creating volume eefc4958-dcb5-4821-803f-65598816685c {{(pid=82756) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 15:07:49 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-d664e920-e7e9-45eb-9646-a1ad4e1f7773 tempest-VolumesCloneNegativeTest-1896329593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:07:49 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-d664e920-e7e9-45eb-9646-a1ad4e1f7773 tempest-VolumesCloneNegativeTest-1896329593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:07:49 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-d664e920-e7e9-45eb-9646-a1ad4e1f7773 tempest-VolumesCloneNegativeTest-1896329593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:07:49 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-d664e920-e7e9-45eb-9646-a1ad4e1f7773 tempest-VolumesCloneNegativeTest-1896329593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:07:49 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-d664e920-e7e9-45eb-9646-a1ad4e1f7773 tempest-VolumesCloneNegativeTest-1896329593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:07:49 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-d664e920-e7e9-45eb-9646-a1ad4e1f7773 tempest-VolumesCloneNegativeTest-1896329593 None] Selected osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 as target Quobyte volume. {{(pid=82756) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 15:07:49 devstack cinder-volume[82756]: INFO cinder.volume.drivers.remotefs [None req-d664e920-e7e9-45eb-9646-a1ad4e1f7773 tempest-VolumesCloneNegativeTest-1896329593 None] casted to osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 Apr 16 15:07:49 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-d664e920-e7e9-45eb-9646-a1ad4e1f7773 tempest-VolumesCloneNegativeTest-1896329593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-eefc4958-dcb5-4821-803f-65598816685c 2147483648 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:07:49 devstack sudo[86352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-eefc4958-dcb5-4821-803f-65598816685c 2147483648 Apr 16 15:07:49 devstack sudo[86352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:07:50 devstack sudo[86350]: pam_unix(sudo:session): session closed for user root Apr 16 15:07:50 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-58be81a6-488f-47b2-b7fb-8cb205ae6c9a tempest-VolumesDeleteCascade-1685423249 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2d3b91b0-ef1e-4e68-a25e-133629dde9b5" returned: 0 in 0.633s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:07:50 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-58be81a6-488f-47b2-b7fb-8cb205ae6c9a tempest-VolumesDeleteCascade-1685423249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2d3b91b0-ef1e-4e68-a25e-133629dde9b5.16084838-8c99-40e4-967c-80ca7869fc98 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:07:50 devstack sudo[86375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2d3b91b0-ef1e-4e68-a25e-133629dde9b5.16084838-8c99-40e4-967c-80ca7869fc98 Apr 16 15:07:50 devstack sudo[86375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:07:50 devstack sudo[86352]: pam_unix(sudo:session): session closed for user root Apr 16 15:07:50 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-d664e920-e7e9-45eb-9646-a1ad4e1f7773 tempest-VolumesCloneNegativeTest-1896329593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-eefc4958-dcb5-4821-803f-65598816685c 2147483648" returned: 0 in 0.672s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:07:50 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-d664e920-e7e9-45eb-9646-a1ad4e1f7773 tempest-VolumesCloneNegativeTest-1896329593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-eefc4958-dcb5-4821-803f-65598816685c {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:07:50 devstack sudo[86377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-eefc4958-dcb5-4821-803f-65598816685c Apr 16 15:07:50 devstack sudo[86377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:07:50 devstack sudo[86375]: pam_unix(sudo:session): session closed for user root Apr 16 15:07:50 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-58be81a6-488f-47b2-b7fb-8cb205ae6c9a tempest-VolumesDeleteCascade-1685423249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2d3b91b0-ef1e-4e68-a25e-133629dde9b5.16084838-8c99-40e4-967c-80ca7869fc98" returned: 0 in 0.523s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:07:50 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-58be81a6-488f-47b2-b7fb-8cb205ae6c9a tempest-VolumesDeleteCascade-1685423249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2d3b91b0-ef1e-4e68-a25e-133629dde9b5.16084838-8c99-40e4-967c-80ca7869fc98 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:07:50 devstack sudo[86382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2d3b91b0-ef1e-4e68-a25e-133629dde9b5.16084838-8c99-40e4-967c-80ca7869fc98 Apr 16 15:07:50 devstack sudo[86382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:07:50 devstack sudo[86377]: pam_unix(sudo:session): session closed for user root Apr 16 15:07:50 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-d664e920-e7e9-45eb-9646-a1ad4e1f7773 tempest-VolumesCloneNegativeTest-1896329593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-eefc4958-dcb5-4821-803f-65598816685c" returned: 0 in 0.579s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:07:50 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-d664e920-e7e9-45eb-9646-a1ad4e1f7773 tempest-VolumesCloneNegativeTest-1896329593 None] <== create_volume: return (1299ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'} {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 15:07:50 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-d664e920-e7e9-45eb-9646-a1ad4e1f7773 tempest-VolumesCloneNegativeTest-1896329593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.301s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:07:51 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-d664e920-e7e9-45eb-9646-a1ad4e1f7773 tempest-VolumesCloneNegativeTest-1896329593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e65f9a3-78de-4f7f-9486-1818d0d46da6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eefc4958-dcb5-4821-803f-65598816685c', 'volume_size': 2}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:07:51 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-d664e920-e7e9-45eb-9646-a1ad4e1f7773 tempest-VolumesCloneNegativeTest-1896329593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7721d0c-66a8-479a-96ca-fd82b4f351cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:07:51 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-d664e920-e7e9-45eb-9646-a1ad4e1f7773 tempest-VolumesCloneNegativeTest-1896329593 None] Volume volume-eefc4958-dcb5-4821-803f-65598816685c (eefc4958-dcb5-4821-803f-65598816685c): created successfully Apr 16 15:07:51 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-d664e920-e7e9-45eb-9646-a1ad4e1f7773 tempest-VolumesCloneNegativeTest-1896329593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7721d0c-66a8-479a-96ca-fd82b4f351cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:07:51 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-d664e920-e7e9-45eb-9646-a1ad4e1f7773 tempest-VolumesCloneNegativeTest-1896329593 None] Flow 'volume_create_manager' (dca34e86-b3fa-4889-a20e-9e356c2694ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:07:51 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-d664e920-e7e9-45eb-9646-a1ad4e1f7773 tempest-VolumesCloneNegativeTest-1896329593 None] Created volume successfully. Apr 16 15:07:51 devstack sudo[86382]: pam_unix(sudo:session): session closed for user root Apr 16 15:07:51 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-58be81a6-488f-47b2-b7fb-8cb205ae6c9a tempest-VolumesDeleteCascade-1685423249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2d3b91b0-ef1e-4e68-a25e-133629dde9b5.16084838-8c99-40e4-967c-80ca7869fc98" returned: 0 in 0.526s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:07:51 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-58be81a6-488f-47b2-b7fb-8cb205ae6c9a tempest-VolumesDeleteCascade-1685423249 None] Lock "cinder-quobyte-16084838-8c99-40e4-967c-80ca7869fc98" released by "_delete_snapshot" :: held 2.375s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:07:51 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-58be81a6-488f-47b2-b7fb-8cb205ae6c9a tempest-VolumesDeleteCascade-1685423249 None] Lock "cinder-quobyte-2d3b91b0-ef1e-4e68-a25e-133629dde9b5" released by "delete_snapshot" :: held 2.388s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:07:51 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-58be81a6-488f-47b2-b7fb-8cb205ae6c9a tempest-VolumesDeleteCascade-1685423249 None] Created reservations ['8d69c79c-8bd5-4d85-bc44-164830073cb1', '1a358407-d7fc-480e-b404-91a3115abb8b', 'd2b1a099-6701-4a55-ab26-46d36c4c33fc', '8666292b-2d55-49d2-92b2-cee24c8702ae'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:07:51 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-58be81a6-488f-47b2-b7fb-8cb205ae6c9a tempest-VolumesDeleteCascade-1685423249 None] Delete snapshot completed successfully. Apr 16 15:07:51 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-58be81a6-488f-47b2-b7fb-8cb205ae6c9a tempest-VolumesDeleteCascade-1685423249 None] Lock "cinder-16084838-8c99-40e4-967c-80ca7869fc98-delete_snapshot" released by "delete_snapshot" :: held 2.493s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:07:51 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-58be81a6-488f-47b2-b7fb-8cb205ae6c9a tempest-VolumesDeleteCascade-1685423249 None] Snapshots deleted, issuing volume delete {{(pid=82756) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 16 15:07:51 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-58be81a6-488f-47b2-b7fb-8cb205ae6c9a tempest-VolumesDeleteCascade-1685423249 None] Acquiring lock "cinder-quobyte-2d3b91b0-ef1e-4e68-a25e-133629dde9b5" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:07:51 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-58be81a6-488f-47b2-b7fb-8cb205ae6c9a tempest-VolumesDeleteCascade-1685423249 None] Lock "cinder-quobyte-2d3b91b0-ef1e-4e68-a25e-133629dde9b5" acquired by "delete_volume" :: waited 0.006s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:07:51 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ddf009d-9bda-4ccb-bfc4-57b258bc6948]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:07:51 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-58be81a6-488f-47b2-b7fb-8cb205ae6c9a tempest-VolumesDeleteCascade-1685423249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2d3b91b0-ef1e-4e68-a25e-133629dde9b5 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:07:51 devstack sudo[86387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2d3b91b0-ef1e-4e68-a25e-133629dde9b5 Apr 16 15:07:51 devstack sudo[86387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:07:51 devstack cinder-volume[82756]: DEBUG oslo_service.periodic_task [None req-9570f02d-5ef9-412b-993f-520a9e5bfa81 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82756) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 16 15:07:51 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-9570f02d-5ef9-412b-993f-520a9e5bfa81 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:07:51 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-9570f02d-5ef9-412b-993f-520a9e5bfa81 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:07:51 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-9570f02d-5ef9-412b-993f-520a9e5bfa81 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:07:51 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-9570f02d-5ef9-412b-993f-520a9e5bfa81 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:07:51 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-9570f02d-5ef9-412b-993f-520a9e5bfa81 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:07:51 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-9570f02d-5ef9-412b-993f-520a9e5bfa81 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:07:51 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-f70ef696-a19f-4259-9d23-ea3e64bbcd4b tempest-VolumesCloneNegativeTest-1896329593 None] Acquiring lock "cinder-eefc4958-dcb5-4821-803f-65598816685c-delete_volume" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:07:51 devstack sudo[86389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:07:51 devstack sudo[86389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:07:51 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-f70ef696-a19f-4259-9d23-ea3e64bbcd4b tempest-VolumesCloneNegativeTest-1896329593 None] Lock "cinder-eefc4958-dcb5-4821-803f-65598816685c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:07:51 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-f70ef696-a19f-4259-9d23-ea3e64bbcd4b tempest-VolumesCloneNegativeTest-1896329593 None] Acquiring lock "cinder-quobyte-eefc4958-dcb5-4821-803f-65598816685c" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:07:51 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-f70ef696-a19f-4259-9d23-ea3e64bbcd4b tempest-VolumesCloneNegativeTest-1896329593 None] Lock "cinder-quobyte-eefc4958-dcb5-4821-803f-65598816685c" acquired by "delete_volume" :: waited 0.014s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:07:51 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9f4546d-7c2c-4050-888a-3dbe8dc27b2e]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:07:51 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-f70ef696-a19f-4259-9d23-ea3e64bbcd4b tempest-VolumesCloneNegativeTest-1896329593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-eefc4958-dcb5-4821-803f-65598816685c {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:07:52 devstack sudo[86387]: pam_unix(sudo:session): session closed for user root Apr 16 15:07:52 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-58be81a6-488f-47b2-b7fb-8cb205ae6c9a tempest-VolumesDeleteCascade-1685423249 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2d3b91b0-ef1e-4e68-a25e-133629dde9b5" returned: 0 in 0.633s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:07:52 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-58be81a6-488f-47b2-b7fb-8cb205ae6c9a tempest-VolumesDeleteCascade-1685423249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2d3b91b0-ef1e-4e68-a25e-133629dde9b5 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:07:52 devstack sudo[86394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-eefc4958-dcb5-4821-803f-65598816685c Apr 16 15:07:52 devstack sudo[86394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:07:52 devstack sudo[86395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2d3b91b0-ef1e-4e68-a25e-133629dde9b5 Apr 16 15:07:52 devstack sudo[86395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:07:52 devstack sudo[86389]: pam_unix(sudo:session): session closed for user root Apr 16 15:07:52 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-9570f02d-5ef9-412b-993f-520a9e5bfa81 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.564s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:07:52 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-9570f02d-5ef9-412b-993f-520a9e5bfa81 None None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:07:52 devstack sudo[86394]: pam_unix(sudo:session): session closed for user root Apr 16 15:07:52 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-f70ef696-a19f-4259-9d23-ea3e64bbcd4b tempest-VolumesCloneNegativeTest-1896329593 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-eefc4958-dcb5-4821-803f-65598816685c" returned: 0 in 0.565s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:07:52 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-f70ef696-a19f-4259-9d23-ea3e64bbcd4b tempest-VolumesCloneNegativeTest-1896329593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-eefc4958-dcb5-4821-803f-65598816685c {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:07:52 devstack sudo[86404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-eefc4958-dcb5-4821-803f-65598816685c Apr 16 15:07:52 devstack sudo[86404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:07:52 devstack sudo[86395]: pam_unix(sudo:session): session closed for user root Apr 16 15:07:52 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-58be81a6-488f-47b2-b7fb-8cb205ae6c9a tempest-VolumesDeleteCascade-1685423249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2d3b91b0-ef1e-4e68-a25e-133629dde9b5" returned: 0 in 0.563s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:07:52 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-58be81a6-488f-47b2-b7fb-8cb205ae6c9a tempest-VolumesDeleteCascade-1685423249 None] Lock "cinder-quobyte-2d3b91b0-ef1e-4e68-a25e-133629dde9b5" released by "delete_volume" :: held 1.231s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:07:52 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-58be81a6-488f-47b2-b7fb-8cb205ae6c9a tempest-VolumesDeleteCascade-1685423249 None] Created reservations ['6fb542bc-af01-4822-a471-4ca053ecb4c3', '44bee316-3b61-4133-9bb7-bd6bc20af7f7', 'c8127ba8-89d4-43a1-9071-7d05f60853c6', 'a3e8d0c8-3e80-4396-ad49-263f6232e8b5'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:07:52 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-58be81a6-488f-47b2-b7fb-8cb205ae6c9a tempest-VolumesDeleteCascade-1685423249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:07:52 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-58be81a6-488f-47b2-b7fb-8cb205ae6c9a tempest-VolumesDeleteCascade-1685423249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:07:52 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-58be81a6-488f-47b2-b7fb-8cb205ae6c9a tempest-VolumesDeleteCascade-1685423249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:07:52 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-58be81a6-488f-47b2-b7fb-8cb205ae6c9a tempest-VolumesDeleteCascade-1685423249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:07:52 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-58be81a6-488f-47b2-b7fb-8cb205ae6c9a tempest-VolumesDeleteCascade-1685423249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:07:52 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-58be81a6-488f-47b2-b7fb-8cb205ae6c9a tempest-VolumesDeleteCascade-1685423249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:07:52 devstack sudo[86406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:07:52 devstack sudo[86406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:07:53 devstack sudo[86404]: pam_unix(sudo:session): session closed for user root Apr 16 15:07:53 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-f70ef696-a19f-4259-9d23-ea3e64bbcd4b tempest-VolumesCloneNegativeTest-1896329593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-eefc4958-dcb5-4821-803f-65598816685c" returned: 0 in 0.545s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:07:53 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-f70ef696-a19f-4259-9d23-ea3e64bbcd4b tempest-VolumesCloneNegativeTest-1896329593 None] Lock "cinder-quobyte-eefc4958-dcb5-4821-803f-65598816685c" released by "delete_volume" :: held 1.144s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:07:53 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-f70ef696-a19f-4259-9d23-ea3e64bbcd4b tempest-VolumesCloneNegativeTest-1896329593 None] Created reservations ['f1abd83f-ff05-4ff7-871b-fd1527c1899d', '24718024-1075-4da8-9a26-c80278f42d31', '580cecc2-f81b-4806-bb0e-1c62d3c1edfa', 'c1f93789-8307-4a70-9947-602df2a78b69'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:07:53 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-f70ef696-a19f-4259-9d23-ea3e64bbcd4b tempest-VolumesCloneNegativeTest-1896329593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:07:53 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-f70ef696-a19f-4259-9d23-ea3e64bbcd4b tempest-VolumesCloneNegativeTest-1896329593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:07:53 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-f70ef696-a19f-4259-9d23-ea3e64bbcd4b tempest-VolumesCloneNegativeTest-1896329593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:07:53 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-f70ef696-a19f-4259-9d23-ea3e64bbcd4b tempest-VolumesCloneNegativeTest-1896329593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:07:53 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-f70ef696-a19f-4259-9d23-ea3e64bbcd4b tempest-VolumesCloneNegativeTest-1896329593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:07:53 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-f70ef696-a19f-4259-9d23-ea3e64bbcd4b tempest-VolumesCloneNegativeTest-1896329593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:07:53 devstack sudo[86413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:07:53 devstack sudo[86413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:07:53 devstack sudo[86406]: pam_unix(sudo:session): session closed for user root Apr 16 15:07:53 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-58be81a6-488f-47b2-b7fb-8cb205ae6c9a tempest-VolumesDeleteCascade-1685423249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.545s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:07:53 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-58be81a6-488f-47b2-b7fb-8cb205ae6c9a tempest-VolumesDeleteCascade-1685423249 None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:07:53 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-58be81a6-488f-47b2-b7fb-8cb205ae6c9a tempest-VolumesDeleteCascade-1685423249 None] Deleted volume successfully. Apr 16 15:07:53 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-58be81a6-488f-47b2-b7fb-8cb205ae6c9a tempest-VolumesDeleteCascade-1685423249 None] Lock "cinder-2d3b91b0-ef1e-4e68-a25e-133629dde9b5-delete_volume" released by "delete_volume" :: held 4.495s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:07:53 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-5eeb8474-6e72-4165-86ce-6a16da8908aa tempest-VolumesDeleteCascade-1685423249 None] Acquiring lock "cinder-f9dbeb64-8654-4914-bc22-1c12451ec50e-delete_volume" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:07:53 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-5eeb8474-6e72-4165-86ce-6a16da8908aa tempest-VolumesDeleteCascade-1685423249 None] Lock "cinder-f9dbeb64-8654-4914-bc22-1c12451ec50e-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:07:53 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-5eeb8474-6e72-4165-86ce-6a16da8908aa tempest-VolumesDeleteCascade-1685423249 None] Acquiring lock "cinder-quobyte-f9dbeb64-8654-4914-bc22-1c12451ec50e" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:07:53 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-5eeb8474-6e72-4165-86ce-6a16da8908aa tempest-VolumesDeleteCascade-1685423249 None] Lock "cinder-quobyte-f9dbeb64-8654-4914-bc22-1c12451ec50e" acquired by "delete_volume" :: waited 0.016s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:07:53 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d71ed1c-71b8-4f0f-acca-983b953981ca]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:07:53 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-5eeb8474-6e72-4165-86ce-6a16da8908aa tempest-VolumesDeleteCascade-1685423249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-f9dbeb64-8654-4914-bc22-1c12451ec50e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:07:53 devstack sudo[86416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-f9dbeb64-8654-4914-bc22-1c12451ec50e Apr 16 15:07:53 devstack sudo[86416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:07:53 devstack sudo[86413]: pam_unix(sudo:session): session closed for user root Apr 16 15:07:53 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-f70ef696-a19f-4259-9d23-ea3e64bbcd4b tempest-VolumesCloneNegativeTest-1896329593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.511s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:07:53 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-f70ef696-a19f-4259-9d23-ea3e64bbcd4b tempest-VolumesCloneNegativeTest-1896329593 None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:07:53 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-f70ef696-a19f-4259-9d23-ea3e64bbcd4b tempest-VolumesCloneNegativeTest-1896329593 None] Deleted volume successfully. Apr 16 15:07:53 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-f70ef696-a19f-4259-9d23-ea3e64bbcd4b tempest-VolumesCloneNegativeTest-1896329593 None] Lock "cinder-eefc4958-dcb5-4821-803f-65598816685c-delete_volume" released by "delete_volume" :: held 1.940s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:07:53 devstack sudo[86416]: pam_unix(sudo:session): session closed for user root Apr 16 15:07:53 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-5eeb8474-6e72-4165-86ce-6a16da8908aa tempest-VolumesDeleteCascade-1685423249 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-f9dbeb64-8654-4914-bc22-1c12451ec50e" returned: 0 in 0.615s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:07:53 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-5eeb8474-6e72-4165-86ce-6a16da8908aa tempest-VolumesDeleteCascade-1685423249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-f9dbeb64-8654-4914-bc22-1c12451ec50e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:07:54 devstack sudo[86422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-f9dbeb64-8654-4914-bc22-1c12451ec50e Apr 16 15:07:54 devstack sudo[86422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:07:54 devstack sudo[86422]: pam_unix(sudo:session): session closed for user root Apr 16 15:07:54 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-5eeb8474-6e72-4165-86ce-6a16da8908aa tempest-VolumesDeleteCascade-1685423249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-f9dbeb64-8654-4914-bc22-1c12451ec50e" returned: 0 in 0.705s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:07:54 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-5eeb8474-6e72-4165-86ce-6a16da8908aa tempest-VolumesDeleteCascade-1685423249 None] Lock "cinder-quobyte-f9dbeb64-8654-4914-bc22-1c12451ec50e" released by "delete_volume" :: held 1.355s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:07:54 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-5eeb8474-6e72-4165-86ce-6a16da8908aa tempest-VolumesDeleteCascade-1685423249 None] Created reservations ['5ce8b898-5a73-4510-9459-55ac23ddb28b', 'b54430d5-7f30-47f6-9e8a-1ad1c6aa76b6', '160554f2-d229-4fc1-a93d-ef01fd7b6a7c', 'e2d3ccec-3252-4b24-89dd-52ee2d752ff6'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:07:54 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-5eeb8474-6e72-4165-86ce-6a16da8908aa tempest-VolumesDeleteCascade-1685423249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:07:54 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-5eeb8474-6e72-4165-86ce-6a16da8908aa tempest-VolumesDeleteCascade-1685423249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:07:54 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-5eeb8474-6e72-4165-86ce-6a16da8908aa tempest-VolumesDeleteCascade-1685423249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:07:54 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-5eeb8474-6e72-4165-86ce-6a16da8908aa tempest-VolumesDeleteCascade-1685423249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:07:54 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-5eeb8474-6e72-4165-86ce-6a16da8908aa tempest-VolumesDeleteCascade-1685423249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:07:54 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-5eeb8474-6e72-4165-86ce-6a16da8908aa tempest-VolumesDeleteCascade-1685423249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:07:54 devstack sudo[86452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:07:54 devstack sudo[86452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:07:55 devstack sudo[86452]: pam_unix(sudo:session): session closed for user root Apr 16 15:07:55 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-5eeb8474-6e72-4165-86ce-6a16da8908aa tempest-VolumesDeleteCascade-1685423249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.647s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:07:55 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-5eeb8474-6e72-4165-86ce-6a16da8908aa tempest-VolumesDeleteCascade-1685423249 None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:07:55 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-5eeb8474-6e72-4165-86ce-6a16da8908aa tempest-VolumesDeleteCascade-1685423249 None] Deleted volume successfully. Apr 16 15:07:55 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-5eeb8474-6e72-4165-86ce-6a16da8908aa tempest-VolumesDeleteCascade-1685423249 None] Lock "cinder-f9dbeb64-8654-4914-bc22-1c12451ec50e-delete_volume" released by "delete_volume" :: held 2.303s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:07:56 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6d3da1a-e42e-4a25-8be4-b66a40ac5214 tempest-VolumesNegativeTest-1876418517 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82756) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 15:07:56 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-c6d3da1a-e42e-4a25-8be4-b66a40ac5214 tempest-VolumesNegativeTest-1876418517 None] Flow 'volume_create_manager' (e0f1f4b4-275e-4cb1-aa1a-c38ad7d9864b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:07:56 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-c6d3da1a-e42e-4a25-8be4-b66a40ac5214 tempest-VolumesNegativeTest-1876418517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de59b2d3-e1c0-48fc-b6b4-c92ff71e9f45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:07:56 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-c6d3da1a-e42e-4a25-8be4-b66a40ac5214 tempest-VolumesNegativeTest-1876418517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de59b2d3-e1c0-48fc-b6b4-c92ff71e9f45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:07:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1433573649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76053374-2c15-46be-ad16-8f6bed0df272,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad7e5fde1ffa45e1b51efff94146e2a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:07:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:07:57Z,use_quota=True,user_id='1f23442dc91c4ac58dc34da55fe7dc0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:07:56 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-c6d3da1a-e42e-4a25-8be4-b66a40ac5214 tempest-VolumesNegativeTest-1876418517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2a28669-b04b-4859-b45b-ac780a746263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:07:56 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-c6d3da1a-e42e-4a25-8be4-b66a40ac5214 tempest-VolumesNegativeTest-1876418517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2a28669-b04b-4859-b45b-ac780a746263) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:07:56 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-c6d3da1a-e42e-4a25-8be4-b66a40ac5214 tempest-VolumesNegativeTest-1876418517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03b9729c-9f77-4cee-a60e-35f74be56f36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:07:56 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-c6d3da1a-e42e-4a25-8be4-b66a40ac5214 tempest-VolumesNegativeTest-1876418517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03b9729c-9f77-4cee-a60e-35f74be56f36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76053374-2c15-46be-ad16-8f6bed0df272', 'volume_name': 'volume-76053374-2c15-46be-ad16-8f6bed0df272', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:07:56 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-c6d3da1a-e42e-4a25-8be4-b66a40ac5214 tempest-VolumesNegativeTest-1876418517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b85bb72e-9d7f-4077-8723-c3705028995c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:07:56 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-c6d3da1a-e42e-4a25-8be4-b66a40ac5214 tempest-VolumesNegativeTest-1876418517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b85bb72e-9d7f-4077-8723-c3705028995c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:07:56 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-c6d3da1a-e42e-4a25-8be4-b66a40ac5214 tempest-VolumesNegativeTest-1876418517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b8c6950-464f-4459-8168-d705cf2051cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:07:56 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-c6d3da1a-e42e-4a25-8be4-b66a40ac5214 tempest-VolumesNegativeTest-1876418517 None] Volume 76053374-2c15-46be-ad16-8f6bed0df272: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76053374-2c15-46be-ad16-8f6bed0df272', 'volume_size': 1} Apr 16 15:07:56 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-c6d3da1a-e42e-4a25-8be4-b66a40ac5214 tempest-VolumesNegativeTest-1876418517 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:07:56 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-c6d3da1a-e42e-4a25-8be4-b66a40ac5214 tempest-VolumesNegativeTest-1876418517 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:07:56 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-c6d3da1a-e42e-4a25-8be4-b66a40ac5214 tempest-VolumesNegativeTest-1876418517 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:07:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1433573649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76053374-2c15-46be-ad16-8f6bed0df272,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad7e5fde1ffa45e1b51efff94146e2a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:07:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:07:57Z,use_quota=True,user_id='1f23442dc91c4ac58dc34da55fe7dc0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)}" {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 15:07:56 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-c6d3da1a-e42e-4a25-8be4-b66a40ac5214 tempest-VolumesNegativeTest-1876418517 None] Creating volume 76053374-2c15-46be-ad16-8f6bed0df272 {{(pid=82756) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 15:07:56 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-c6d3da1a-e42e-4a25-8be4-b66a40ac5214 tempest-VolumesNegativeTest-1876418517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:07:56 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-c6d3da1a-e42e-4a25-8be4-b66a40ac5214 tempest-VolumesNegativeTest-1876418517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:07:56 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-c6d3da1a-e42e-4a25-8be4-b66a40ac5214 tempest-VolumesNegativeTest-1876418517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:07:56 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-c6d3da1a-e42e-4a25-8be4-b66a40ac5214 tempest-VolumesNegativeTest-1876418517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:07:56 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-c6d3da1a-e42e-4a25-8be4-b66a40ac5214 tempest-VolumesNegativeTest-1876418517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:07:56 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-c6d3da1a-e42e-4a25-8be4-b66a40ac5214 tempest-VolumesNegativeTest-1876418517 None] Selected osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 as target Quobyte volume. {{(pid=82756) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 15:07:56 devstack cinder-volume[82756]: INFO cinder.volume.drivers.remotefs [None req-c6d3da1a-e42e-4a25-8be4-b66a40ac5214 tempest-VolumesNegativeTest-1876418517 None] casted to osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 Apr 16 15:07:56 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-c6d3da1a-e42e-4a25-8be4-b66a40ac5214 tempest-VolumesNegativeTest-1876418517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-76053374-2c15-46be-ad16-8f6bed0df272 1073741824 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:07:56 devstack sudo[86458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-76053374-2c15-46be-ad16-8f6bed0df272 1073741824 Apr 16 15:07:56 devstack sudo[86458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:07:57 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bd9cd02-c915-4633-80aa-667c30b6cf6d tempest-VolumesActionsTest-1011119310 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82756) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 15:07:57 devstack sudo[86458]: pam_unix(sudo:session): session closed for user root Apr 16 15:07:57 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-3bd9cd02-c915-4633-80aa-667c30b6cf6d tempest-VolumesActionsTest-1011119310 None] Flow 'volume_create_manager' (a9640709-52d8-49e8-8185-2bfdde1edfa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:07:57 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-3bd9cd02-c915-4633-80aa-667c30b6cf6d tempest-VolumesActionsTest-1011119310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62f221b4-8874-4438-9e14-394ac407278e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:07:57 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-c6d3da1a-e42e-4a25-8be4-b66a40ac5214 tempest-VolumesNegativeTest-1876418517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-76053374-2c15-46be-ad16-8f6bed0df272 1073741824" returned: 0 in 0.726s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:07:57 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-3bd9cd02-c915-4633-80aa-667c30b6cf6d tempest-VolumesActionsTest-1011119310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62f221b4-8874-4438-9e14-394ac407278e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:07:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1009890265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5061d3bc-15c6-43e9-9031-4551f03f771f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f62108dfb2544358974111915853b3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:07:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:07:58Z,use_quota=True,user_id='d5b67ea45a1d45bb8b7c8d44919cd8fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:07:57 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-3bd9cd02-c915-4633-80aa-667c30b6cf6d tempest-VolumesActionsTest-1011119310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83f0d68c-ff9e-44e5-8e19-16b5ca14880d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:07:57 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-3bd9cd02-c915-4633-80aa-667c30b6cf6d tempest-VolumesActionsTest-1011119310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83f0d68c-ff9e-44e5-8e19-16b5ca14880d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:07:57 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-3bd9cd02-c915-4633-80aa-667c30b6cf6d tempest-VolumesActionsTest-1011119310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e69002dd-3a11-4fa1-ba34-32e19a492dee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:07:57 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-3bd9cd02-c915-4633-80aa-667c30b6cf6d tempest-VolumesActionsTest-1011119310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e69002dd-3a11-4fa1-ba34-32e19a492dee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5061d3bc-15c6-43e9-9031-4551f03f771f', 'volume_name': 'volume-5061d3bc-15c6-43e9-9031-4551f03f771f', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:07:57 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-3bd9cd02-c915-4633-80aa-667c30b6cf6d tempest-VolumesActionsTest-1011119310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a1d30cb-e3e8-4822-a713-f4e077c36857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:07:57 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-3bd9cd02-c915-4633-80aa-667c30b6cf6d tempest-VolumesActionsTest-1011119310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a1d30cb-e3e8-4822-a713-f4e077c36857) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:07:57 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-3bd9cd02-c915-4633-80aa-667c30b6cf6d tempest-VolumesActionsTest-1011119310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (926f729c-d2e0-4bad-893d-6b74dad83c03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:07:57 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-3bd9cd02-c915-4633-80aa-667c30b6cf6d tempest-VolumesActionsTest-1011119310 None] Volume 5061d3bc-15c6-43e9-9031-4551f03f771f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5061d3bc-15c6-43e9-9031-4551f03f771f', 'volume_size': 1} Apr 16 15:07:57 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-3bd9cd02-c915-4633-80aa-667c30b6cf6d tempest-VolumesActionsTest-1011119310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:07:57 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-c6d3da1a-e42e-4a25-8be4-b66a40ac5214 tempest-VolumesNegativeTest-1876418517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-76053374-2c15-46be-ad16-8f6bed0df272 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:07:57 devstack sudo[86463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-76053374-2c15-46be-ad16-8f6bed0df272 Apr 16 15:07:57 devstack sudo[86463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:07:58 devstack sudo[86463]: pam_unix(sudo:session): session closed for user root Apr 16 15:07:58 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-c6d3da1a-e42e-4a25-8be4-b66a40ac5214 tempest-VolumesNegativeTest-1876418517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-76053374-2c15-46be-ad16-8f6bed0df272" returned: 0 in 0.595s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:07:58 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-c6d3da1a-e42e-4a25-8be4-b66a40ac5214 tempest-VolumesNegativeTest-1876418517 None] <== create_volume: return (1390ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'} {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 15:07:58 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-c6d3da1a-e42e-4a25-8be4-b66a40ac5214 tempest-VolumesNegativeTest-1876418517 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.393s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:07:58 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-3bd9cd02-c915-4633-80aa-667c30b6cf6d tempest-VolumesActionsTest-1011119310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.623s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:07:58 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-3bd9cd02-c915-4633-80aa-667c30b6cf6d tempest-VolumesActionsTest-1011119310 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:07:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1009890265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5061d3bc-15c6-43e9-9031-4551f03f771f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f62108dfb2544358974111915853b3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:07:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:07:58Z,use_quota=True,user_id='d5b67ea45a1d45bb8b7c8d44919cd8fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)}" {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 15:07:58 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-3bd9cd02-c915-4633-80aa-667c30b6cf6d tempest-VolumesActionsTest-1011119310 None] Creating volume 5061d3bc-15c6-43e9-9031-4551f03f771f {{(pid=82756) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 15:07:58 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-3bd9cd02-c915-4633-80aa-667c30b6cf6d tempest-VolumesActionsTest-1011119310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:07:58 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-3bd9cd02-c915-4633-80aa-667c30b6cf6d tempest-VolumesActionsTest-1011119310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:07:58 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-3bd9cd02-c915-4633-80aa-667c30b6cf6d tempest-VolumesActionsTest-1011119310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:07:58 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-3bd9cd02-c915-4633-80aa-667c30b6cf6d tempest-VolumesActionsTest-1011119310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:07:58 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-3bd9cd02-c915-4633-80aa-667c30b6cf6d tempest-VolumesActionsTest-1011119310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:07:58 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-3bd9cd02-c915-4633-80aa-667c30b6cf6d tempest-VolumesActionsTest-1011119310 None] Selected osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 as target Quobyte volume. {{(pid=82756) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 15:07:58 devstack cinder-volume[82756]: INFO cinder.volume.drivers.remotefs [None req-3bd9cd02-c915-4633-80aa-667c30b6cf6d tempest-VolumesActionsTest-1011119310 None] casted to osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 Apr 16 15:07:58 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-3bd9cd02-c915-4633-80aa-667c30b6cf6d tempest-VolumesActionsTest-1011119310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-5061d3bc-15c6-43e9-9031-4551f03f771f 1073741824 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:07:58 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-c6d3da1a-e42e-4a25-8be4-b66a40ac5214 tempest-VolumesNegativeTest-1876418517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b8c6950-464f-4459-8168-d705cf2051cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76053374-2c15-46be-ad16-8f6bed0df272', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:07:58 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-c6d3da1a-e42e-4a25-8be4-b66a40ac5214 tempest-VolumesNegativeTest-1876418517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7188acf-b4eb-4095-a402-1a1141cae6ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:07:58 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-c6d3da1a-e42e-4a25-8be4-b66a40ac5214 tempest-VolumesNegativeTest-1876418517 None] Volume volume-76053374-2c15-46be-ad16-8f6bed0df272 (76053374-2c15-46be-ad16-8f6bed0df272): created successfully Apr 16 15:07:58 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-c6d3da1a-e42e-4a25-8be4-b66a40ac5214 tempest-VolumesNegativeTest-1876418517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7188acf-b4eb-4095-a402-1a1141cae6ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:07:58 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-c6d3da1a-e42e-4a25-8be4-b66a40ac5214 tempest-VolumesNegativeTest-1876418517 None] Flow 'volume_create_manager' (e0f1f4b4-275e-4cb1-aa1a-c38ad7d9864b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:07:58 devstack sudo[86466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-5061d3bc-15c6-43e9-9031-4551f03f771f 1073741824 Apr 16 15:07:58 devstack sudo[86466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:07:58 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-c6d3da1a-e42e-4a25-8be4-b66a40ac5214 tempest-VolumesNegativeTest-1876418517 None] Created volume successfully. Apr 16 15:07:59 devstack sudo[86466]: pam_unix(sudo:session): session closed for user root Apr 16 15:07:59 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-3bd9cd02-c915-4633-80aa-667c30b6cf6d tempest-VolumesActionsTest-1011119310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-5061d3bc-15c6-43e9-9031-4551f03f771f 1073741824" returned: 0 in 0.816s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:07:59 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-3bd9cd02-c915-4633-80aa-667c30b6cf6d tempest-VolumesActionsTest-1011119310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-5061d3bc-15c6-43e9-9031-4551f03f771f {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:07:59 devstack sudo[86473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-5061d3bc-15c6-43e9-9031-4551f03f771f Apr 16 15:07:59 devstack sudo[86473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:07:59 devstack sudo[86473]: pam_unix(sudo:session): session closed for user root Apr 16 15:07:59 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-3bd9cd02-c915-4633-80aa-667c30b6cf6d tempest-VolumesActionsTest-1011119310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-5061d3bc-15c6-43e9-9031-4551f03f771f" returned: 0 in 0.587s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:07:59 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-3bd9cd02-c915-4633-80aa-667c30b6cf6d tempest-VolumesActionsTest-1011119310 None] <== create_volume: return (1450ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'} {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 15:07:59 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-3bd9cd02-c915-4633-80aa-667c30b6cf6d tempest-VolumesActionsTest-1011119310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.453s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:07:59 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-3bd9cd02-c915-4633-80aa-667c30b6cf6d tempest-VolumesActionsTest-1011119310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (926f729c-d2e0-4bad-893d-6b74dad83c03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5061d3bc-15c6-43e9-9031-4551f03f771f', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:07:59 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-3bd9cd02-c915-4633-80aa-667c30b6cf6d tempest-VolumesActionsTest-1011119310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5db65d03-2386-480d-b79f-ed22cc65a42b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:07:59 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-3bd9cd02-c915-4633-80aa-667c30b6cf6d tempest-VolumesActionsTest-1011119310 None] Volume volume-5061d3bc-15c6-43e9-9031-4551f03f771f (5061d3bc-15c6-43e9-9031-4551f03f771f): created successfully Apr 16 15:07:59 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-3bd9cd02-c915-4633-80aa-667c30b6cf6d tempest-VolumesActionsTest-1011119310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5db65d03-2386-480d-b79f-ed22cc65a42b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:07:59 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-3bd9cd02-c915-4633-80aa-667c30b6cf6d tempest-VolumesActionsTest-1011119310 None] Flow 'volume_create_manager' (a9640709-52d8-49e8-8185-2bfdde1edfa1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:07:59 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-3bd9cd02-c915-4633-80aa-667c30b6cf6d tempest-VolumesActionsTest-1011119310 None] Created volume successfully. Apr 16 15:08:00 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-d0ca41ed-c0e3-4516-a415-02e71b976fdd tempest-VolumesActionsTest-1011119310 None] Acquiring lock "cinder-5061d3bc-15c6-43e9-9031-4551f03f771f" by "attach_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:08:00 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-d0ca41ed-c0e3-4516-a415-02e71b976fdd tempest-VolumesActionsTest-1011119310 None] Lock "cinder-5061d3bc-15c6-43e9-9031-4551f03f771f" acquired by "attach_volume" :: waited 0.012s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:08:00 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-d0ca41ed-c0e3-4516-a415-02e71b976fdd tempest-VolumesActionsTest-1011119310 None] Attaching volume 5061d3bc-15c6-43e9-9031-4551f03f771f to instance 0ee592d2-fbde-46a6-8668-fa09212c6f17 at mountpoint /dev/vdb on host None. Apr 16 15:08:00 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-d0ca41ed-c0e3-4516-a415-02e71b976fdd tempest-VolumesActionsTest-1011119310 None] Attach volume completed successfully. Apr 16 15:08:00 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-d0ca41ed-c0e3-4516-a415-02e71b976fdd tempest-VolumesActionsTest-1011119310 None] Lock "cinder-5061d3bc-15c6-43e9-9031-4551f03f771f" released by "attach_volume" :: held 0.136s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:08:01 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-c67a7c08-1654-4d87-830b-4bc60382f7ac tempest-VolumesActionsTest-1145584555 None] Terminate volume connection completed successfully. Apr 16 15:08:02 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-c67a7c08-1654-4d87-830b-4bc60382f7ac tempest-VolumesActionsTest-1145584555 None] Acquiring lock "cinder-5061d3bc-15c6-43e9-9031-4551f03f771f-detach_volume" by "detach_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:08:02 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-c67a7c08-1654-4d87-830b-4bc60382f7ac tempest-VolumesActionsTest-1145584555 None] Lock "cinder-5061d3bc-15c6-43e9-9031-4551f03f771f-detach_volume" acquired by "detach_volume" :: waited 0.022s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:08:02 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-c67a7c08-1654-4d87-830b-4bc60382f7ac tempest-VolumesActionsTest-1145584555 None] Detaching volume 5061d3bc-15c6-43e9-9031-4551f03f771f from instance 0ee592d2-fbde-46a6-8668-fa09212c6f17. Apr 16 15:08:02 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-c67a7c08-1654-4d87-830b-4bc60382f7ac tempest-VolumesActionsTest-1145584555 None] Detach volume completed successfully. Apr 16 15:08:02 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-c67a7c08-1654-4d87-830b-4bc60382f7ac tempest-VolumesActionsTest-1145584555 None] Lock "cinder-5061d3bc-15c6-43e9-9031-4551f03f771f-detach_volume" released by "detach_volume" :: held 0.067s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:08:02 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-175fe788-e10b-4056-b7ab-33da9ebce1bc tempest-VolumesActionsTest-1011119310 None] Acquiring lock "cinder-5061d3bc-15c6-43e9-9031-4551f03f771f-detach_volume" by "detach_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:08:02 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-175fe788-e10b-4056-b7ab-33da9ebce1bc tempest-VolumesActionsTest-1011119310 None] Lock "cinder-5061d3bc-15c6-43e9-9031-4551f03f771f-detach_volume" acquired by "detach_volume" :: waited 0.009s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:08:02 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-175fe788-e10b-4056-b7ab-33da9ebce1bc tempest-VolumesActionsTest-1011119310 None] Volume detach called, but volume not attached. Apr 16 15:08:02 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-175fe788-e10b-4056-b7ab-33da9ebce1bc tempest-VolumesActionsTest-1011119310 None] Lock "cinder-5061d3bc-15c6-43e9-9031-4551f03f771f-detach_volume" released by "detach_volume" :: held 0.011s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:08:03 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-59f3eb0d-c0fb-43f3-b45c-f4c7831b072d tempest-VolumesActionsTest-1011119310 None] Acquiring lock "cinder-5061d3bc-15c6-43e9-9031-4551f03f771f-delete_volume" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:08:03 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-59f3eb0d-c0fb-43f3-b45c-f4c7831b072d tempest-VolumesActionsTest-1011119310 None] Lock "cinder-5061d3bc-15c6-43e9-9031-4551f03f771f-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:08:03 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-59f3eb0d-c0fb-43f3-b45c-f4c7831b072d tempest-VolumesActionsTest-1011119310 None] Acquiring lock "cinder-quobyte-5061d3bc-15c6-43e9-9031-4551f03f771f" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:08:03 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-59f3eb0d-c0fb-43f3-b45c-f4c7831b072d tempest-VolumesActionsTest-1011119310 None] Lock "cinder-quobyte-5061d3bc-15c6-43e9-9031-4551f03f771f" acquired by "delete_volume" :: waited 0.015s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:08:03 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a1bcda4-cc0f-455f-86ff-47ab31ee955d]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:08:03 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-59f3eb0d-c0fb-43f3-b45c-f4c7831b072d tempest-VolumesActionsTest-1011119310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-5061d3bc-15c6-43e9-9031-4551f03f771f {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:08:04 devstack sudo[86517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-5061d3bc-15c6-43e9-9031-4551f03f771f Apr 16 15:08:04 devstack sudo[86517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:08:04 devstack sudo[86517]: pam_unix(sudo:session): session closed for user root Apr 16 15:08:04 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-59f3eb0d-c0fb-43f3-b45c-f4c7831b072d tempest-VolumesActionsTest-1011119310 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-5061d3bc-15c6-43e9-9031-4551f03f771f" returned: 0 in 1.028s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:08:04 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-59f3eb0d-c0fb-43f3-b45c-f4c7831b072d tempest-VolumesActionsTest-1011119310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-5061d3bc-15c6-43e9-9031-4551f03f771f {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:08:04 devstack sudo[86526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-5061d3bc-15c6-43e9-9031-4551f03f771f Apr 16 15:08:04 devstack sudo[86526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:08:05 devstack sudo[86526]: pam_unix(sudo:session): session closed for user root Apr 16 15:08:05 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-59f3eb0d-c0fb-43f3-b45c-f4c7831b072d tempest-VolumesActionsTest-1011119310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-5061d3bc-15c6-43e9-9031-4551f03f771f" returned: 0 in 0.717s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:08:05 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-59f3eb0d-c0fb-43f3-b45c-f4c7831b072d tempest-VolumesActionsTest-1011119310 None] Lock "cinder-quobyte-5061d3bc-15c6-43e9-9031-4551f03f771f" released by "delete_volume" :: held 1.794s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:08:05 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-59f3eb0d-c0fb-43f3-b45c-f4c7831b072d tempest-VolumesActionsTest-1011119310 None] Created reservations ['f386cadd-4309-481b-9509-af0f252501f4', '903e5d0e-d0df-4cdd-964b-8ed4069bbd7a', '9564b4e5-6e3e-4a71-9a7d-3057265d3e3f', 'f732b591-dea1-4072-a48f-cd20e5cdc546'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:08:05 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-59f3eb0d-c0fb-43f3-b45c-f4c7831b072d tempest-VolumesActionsTest-1011119310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:08:05 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-59f3eb0d-c0fb-43f3-b45c-f4c7831b072d tempest-VolumesActionsTest-1011119310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:08:05 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-59f3eb0d-c0fb-43f3-b45c-f4c7831b072d tempest-VolumesActionsTest-1011119310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:08:05 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-59f3eb0d-c0fb-43f3-b45c-f4c7831b072d tempest-VolumesActionsTest-1011119310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:08:05 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-59f3eb0d-c0fb-43f3-b45c-f4c7831b072d tempest-VolumesActionsTest-1011119310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:08:05 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-59f3eb0d-c0fb-43f3-b45c-f4c7831b072d tempest-VolumesActionsTest-1011119310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:08:05 devstack sudo[86534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:08:05 devstack sudo[86534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:08:06 devstack sudo[86534]: pam_unix(sudo:session): session closed for user root Apr 16 15:08:06 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-59f3eb0d-c0fb-43f3-b45c-f4c7831b072d tempest-VolumesActionsTest-1011119310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.805s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:08:06 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-59f3eb0d-c0fb-43f3-b45c-f4c7831b072d tempest-VolumesActionsTest-1011119310 None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:08:06 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-59f3eb0d-c0fb-43f3-b45c-f4c7831b072d tempest-VolumesActionsTest-1011119310 None] Deleted volume successfully. Apr 16 15:08:06 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-59f3eb0d-c0fb-43f3-b45c-f4c7831b072d tempest-VolumesActionsTest-1011119310 None] Lock "cinder-5061d3bc-15c6-43e9-9031-4551f03f771f-delete_volume" released by "delete_volume" :: held 2.851s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:08:08 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [None req-616c987b-55f2-4292-8bb9-a523c04073aa tempest-VolumesActionsTest-570492233 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82756) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 15:08:08 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-616c987b-55f2-4292-8bb9-a523c04073aa tempest-VolumesActionsTest-570492233 None] Flow 'volume_create_manager' (954f51ca-9865-4dba-97a9-8a9c5a649d69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:08:08 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-616c987b-55f2-4292-8bb9-a523c04073aa tempest-VolumesActionsTest-570492233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90175951-d2c2-4fd9-adf6-a8231aeae28b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:08:08 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-616c987b-55f2-4292-8bb9-a523c04073aa tempest-VolumesActionsTest-570492233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90175951-d2c2-4fd9-adf6-a8231aeae28b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:08:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1285685470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1fe4c2f-0039-4d10-b121-1dbbbdb434fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d38d3ec7126e4bdb99fd5b94eeba18ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:08:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:08:09Z,use_quota=True,user_id='640a66261bdb49c4adf32efd439c678b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:08:08 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-616c987b-55f2-4292-8bb9-a523c04073aa tempest-VolumesActionsTest-570492233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e073728b-a59f-4882-8621-46717aa4805d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:08:08 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-616c987b-55f2-4292-8bb9-a523c04073aa tempest-VolumesActionsTest-570492233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e073728b-a59f-4882-8621-46717aa4805d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:08:08 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-616c987b-55f2-4292-8bb9-a523c04073aa tempest-VolumesActionsTest-570492233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40295b01-571b-477f-b8e3-53e7015d86d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:08:08 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-616c987b-55f2-4292-8bb9-a523c04073aa tempest-VolumesActionsTest-570492233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40295b01-571b-477f-b8e3-53e7015d86d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1fe4c2f-0039-4d10-b121-1dbbbdb434fa', 'volume_name': 'volume-c1fe4c2f-0039-4d10-b121-1dbbbdb434fa', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:08:08 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-616c987b-55f2-4292-8bb9-a523c04073aa tempest-VolumesActionsTest-570492233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38453506-45d5-4f2d-b776-bd2276ca9a2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:08:08 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-616c987b-55f2-4292-8bb9-a523c04073aa tempest-VolumesActionsTest-570492233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38453506-45d5-4f2d-b776-bd2276ca9a2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:08:08 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-616c987b-55f2-4292-8bb9-a523c04073aa tempest-VolumesActionsTest-570492233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01d4e253-e43e-4bc4-85a7-1cc30f220b71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:08:08 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-616c987b-55f2-4292-8bb9-a523c04073aa tempest-VolumesActionsTest-570492233 None] Volume c1fe4c2f-0039-4d10-b121-1dbbbdb434fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1fe4c2f-0039-4d10-b121-1dbbbdb434fa', 'volume_size': 1} Apr 16 15:08:08 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-616c987b-55f2-4292-8bb9-a523c04073aa tempest-VolumesActionsTest-570492233 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:08:08 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-616c987b-55f2-4292-8bb9-a523c04073aa tempest-VolumesActionsTest-570492233 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:08:08 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-616c987b-55f2-4292-8bb9-a523c04073aa tempest-VolumesActionsTest-570492233 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:08:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1285685470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1fe4c2f-0039-4d10-b121-1dbbbdb434fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d38d3ec7126e4bdb99fd5b94eeba18ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:08:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:08:09Z,use_quota=True,user_id='640a66261bdb49c4adf32efd439c678b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)}" {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 15:08:08 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-616c987b-55f2-4292-8bb9-a523c04073aa tempest-VolumesActionsTest-570492233 None] Creating volume c1fe4c2f-0039-4d10-b121-1dbbbdb434fa {{(pid=82756) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 15:08:08 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-616c987b-55f2-4292-8bb9-a523c04073aa tempest-VolumesActionsTest-570492233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:08:08 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-616c987b-55f2-4292-8bb9-a523c04073aa tempest-VolumesActionsTest-570492233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:08:08 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-616c987b-55f2-4292-8bb9-a523c04073aa tempest-VolumesActionsTest-570492233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:08:08 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-616c987b-55f2-4292-8bb9-a523c04073aa tempest-VolumesActionsTest-570492233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:08:08 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-616c987b-55f2-4292-8bb9-a523c04073aa tempest-VolumesActionsTest-570492233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:08:08 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-616c987b-55f2-4292-8bb9-a523c04073aa tempest-VolumesActionsTest-570492233 None] Selected osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 as target Quobyte volume. {{(pid=82756) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 15:08:08 devstack cinder-volume[82756]: INFO cinder.volume.drivers.remotefs [None req-616c987b-55f2-4292-8bb9-a523c04073aa tempest-VolumesActionsTest-570492233 None] casted to osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 Apr 16 15:08:08 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-616c987b-55f2-4292-8bb9-a523c04073aa tempest-VolumesActionsTest-570492233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c1fe4c2f-0039-4d10-b121-1dbbbdb434fa 1073741824 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:08:08 devstack sudo[86571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c1fe4c2f-0039-4d10-b121-1dbbbdb434fa 1073741824 Apr 16 15:08:08 devstack sudo[86571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:08:09 devstack sudo[86571]: pam_unix(sudo:session): session closed for user root Apr 16 15:08:09 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-616c987b-55f2-4292-8bb9-a523c04073aa tempest-VolumesActionsTest-570492233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c1fe4c2f-0039-4d10-b121-1dbbbdb434fa 1073741824" returned: 0 in 0.751s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:08:09 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-616c987b-55f2-4292-8bb9-a523c04073aa tempest-VolumesActionsTest-570492233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c1fe4c2f-0039-4d10-b121-1dbbbdb434fa {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:08:09 devstack sudo[86578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c1fe4c2f-0039-4d10-b121-1dbbbdb434fa Apr 16 15:08:09 devstack sudo[86578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:08:09 devstack sudo[86578]: pam_unix(sudo:session): session closed for user root Apr 16 15:08:09 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-616c987b-55f2-4292-8bb9-a523c04073aa tempest-VolumesActionsTest-570492233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c1fe4c2f-0039-4d10-b121-1dbbbdb434fa" returned: 0 in 0.497s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:08:09 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-616c987b-55f2-4292-8bb9-a523c04073aa tempest-VolumesActionsTest-570492233 None] <== create_volume: return (1278ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'} {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 15:08:09 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-616c987b-55f2-4292-8bb9-a523c04073aa tempest-VolumesActionsTest-570492233 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.284s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:08:09 devstack cinder-volume[82756]: DEBUG dbcounter [-] [82756] Writing DB stats cinder:SELECT=134,cinder:UPDATE=160,cinder:DELETE=18,cinder:INSERT=45 {{(pid=82756) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 15:08:09 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-616c987b-55f2-4292-8bb9-a523c04073aa tempest-VolumesActionsTest-570492233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01d4e253-e43e-4bc4-85a7-1cc30f220b71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1fe4c2f-0039-4d10-b121-1dbbbdb434fa', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:08:09 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-616c987b-55f2-4292-8bb9-a523c04073aa tempest-VolumesActionsTest-570492233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bd92d70-5f64-4637-bf75-2e72f8a8a314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:08:09 devstack cinder-volume[82756]: DEBUG dbcounter [-] [82756] Writing DB stats cinder:SELECT=124,cinder:UPDATE=162,cinder:INSERT=35,cinder:DELETE=9 {{(pid=82756) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 15:08:10 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-616c987b-55f2-4292-8bb9-a523c04073aa tempest-VolumesActionsTest-570492233 None] Volume volume-c1fe4c2f-0039-4d10-b121-1dbbbdb434fa (c1fe4c2f-0039-4d10-b121-1dbbbdb434fa): created successfully Apr 16 15:08:10 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-616c987b-55f2-4292-8bb9-a523c04073aa tempest-VolumesActionsTest-570492233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bd92d70-5f64-4637-bf75-2e72f8a8a314) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:08:10 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-616c987b-55f2-4292-8bb9-a523c04073aa tempest-VolumesActionsTest-570492233 None] Flow 'volume_create_manager' (954f51ca-9865-4dba-97a9-8a9c5a649d69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:08:10 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-616c987b-55f2-4292-8bb9-a523c04073aa tempest-VolumesActionsTest-570492233 None] Created volume successfully. Apr 16 15:08:14 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [None req-3fce03a6-28ec-44d9-9567-aec9c075f467 tempest-VolumesActionsTest-1011119310 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82756) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 15:08:14 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-3fce03a6-28ec-44d9-9567-aec9c075f467 tempest-VolumesActionsTest-1011119310 None] Flow 'volume_create_manager' (aea55423-982f-4f28-9e06-a02680a91ee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:08:14 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-3fce03a6-28ec-44d9-9567-aec9c075f467 tempest-VolumesActionsTest-1011119310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69e55001-0d13-4737-afb8-93e393d1beca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:08:14 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-3fce03a6-28ec-44d9-9567-aec9c075f467 tempest-VolumesActionsTest-1011119310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69e55001-0d13-4737-afb8-93e393d1beca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:08:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-91296163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bf7bd75-6f45-499d-a60d-1f4c806ed9f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f62108dfb2544358974111915853b3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:08:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:08:15Z,use_quota=True,user_id='d5b67ea45a1d45bb8b7c8d44919cd8fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:08:15 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-3fce03a6-28ec-44d9-9567-aec9c075f467 tempest-VolumesActionsTest-1011119310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20af6b59-fdf2-4ee7-80b8-ac285ea1cb1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:08:15 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-3fce03a6-28ec-44d9-9567-aec9c075f467 tempest-VolumesActionsTest-1011119310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20af6b59-fdf2-4ee7-80b8-ac285ea1cb1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:08:15 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-3fce03a6-28ec-44d9-9567-aec9c075f467 tempest-VolumesActionsTest-1011119310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f71c8b6a-5c8f-4fa3-ae09-4a2918548702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:08:15 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-3fce03a6-28ec-44d9-9567-aec9c075f467 tempest-VolumesActionsTest-1011119310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f71c8b6a-5c8f-4fa3-ae09-4a2918548702) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5bf7bd75-6f45-499d-a60d-1f4c806ed9f5', 'volume_name': 'volume-5bf7bd75-6f45-499d-a60d-1f4c806ed9f5', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:08:15 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-3fce03a6-28ec-44d9-9567-aec9c075f467 tempest-VolumesActionsTest-1011119310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d77651ab-10e5-4da1-a0d3-dd317e9b5472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:08:15 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-3fce03a6-28ec-44d9-9567-aec9c075f467 tempest-VolumesActionsTest-1011119310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d77651ab-10e5-4da1-a0d3-dd317e9b5472) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:08:15 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-3fce03a6-28ec-44d9-9567-aec9c075f467 tempest-VolumesActionsTest-1011119310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e7d695b-96ad-4139-bb7e-f3d3c1b1dcca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:08:15 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-3fce03a6-28ec-44d9-9567-aec9c075f467 tempest-VolumesActionsTest-1011119310 None] Volume 5bf7bd75-6f45-499d-a60d-1f4c806ed9f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5bf7bd75-6f45-499d-a60d-1f4c806ed9f5', 'volume_size': 1} Apr 16 15:08:15 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-3fce03a6-28ec-44d9-9567-aec9c075f467 tempest-VolumesActionsTest-1011119310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:08:15 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-3fce03a6-28ec-44d9-9567-aec9c075f467 tempest-VolumesActionsTest-1011119310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:08:15 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-3fce03a6-28ec-44d9-9567-aec9c075f467 tempest-VolumesActionsTest-1011119310 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:08:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-91296163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bf7bd75-6f45-499d-a60d-1f4c806ed9f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f62108dfb2544358974111915853b3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:08:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:08:15Z,use_quota=True,user_id='d5b67ea45a1d45bb8b7c8d44919cd8fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)}" {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 15:08:15 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-3fce03a6-28ec-44d9-9567-aec9c075f467 tempest-VolumesActionsTest-1011119310 None] Creating volume 5bf7bd75-6f45-499d-a60d-1f4c806ed9f5 {{(pid=82756) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 15:08:15 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-3fce03a6-28ec-44d9-9567-aec9c075f467 tempest-VolumesActionsTest-1011119310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:08:15 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-3fce03a6-28ec-44d9-9567-aec9c075f467 tempest-VolumesActionsTest-1011119310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:08:15 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-3fce03a6-28ec-44d9-9567-aec9c075f467 tempest-VolumesActionsTest-1011119310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:08:15 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-3fce03a6-28ec-44d9-9567-aec9c075f467 tempest-VolumesActionsTest-1011119310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:08:15 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-3fce03a6-28ec-44d9-9567-aec9c075f467 tempest-VolumesActionsTest-1011119310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:08:15 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-3fce03a6-28ec-44d9-9567-aec9c075f467 tempest-VolumesActionsTest-1011119310 None] Selected osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 as target Quobyte volume. {{(pid=82756) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 15:08:15 devstack cinder-volume[82756]: INFO cinder.volume.drivers.remotefs [None req-3fce03a6-28ec-44d9-9567-aec9c075f467 tempest-VolumesActionsTest-1011119310 None] casted to osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 Apr 16 15:08:15 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-3fce03a6-28ec-44d9-9567-aec9c075f467 tempest-VolumesActionsTest-1011119310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-5bf7bd75-6f45-499d-a60d-1f4c806ed9f5 1073741824 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:08:15 devstack sudo[86627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-5bf7bd75-6f45-499d-a60d-1f4c806ed9f5 1073741824 Apr 16 15:08:15 devstack sudo[86627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:08:15 devstack sudo[86627]: pam_unix(sudo:session): session closed for user root Apr 16 15:08:15 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-3fce03a6-28ec-44d9-9567-aec9c075f467 tempest-VolumesActionsTest-1011119310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-5bf7bd75-6f45-499d-a60d-1f4c806ed9f5 1073741824" returned: 0 in 0.600s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:08:15 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-3fce03a6-28ec-44d9-9567-aec9c075f467 tempest-VolumesActionsTest-1011119310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-5bf7bd75-6f45-499d-a60d-1f4c806ed9f5 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:08:15 devstack sudo[86647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-5bf7bd75-6f45-499d-a60d-1f4c806ed9f5 Apr 16 15:08:15 devstack sudo[86647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:08:16 devstack sudo[86647]: pam_unix(sudo:session): session closed for user root Apr 16 15:08:16 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-3fce03a6-28ec-44d9-9567-aec9c075f467 tempest-VolumesActionsTest-1011119310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-5bf7bd75-6f45-499d-a60d-1f4c806ed9f5" returned: 0 in 0.415s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:08:16 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-3fce03a6-28ec-44d9-9567-aec9c075f467 tempest-VolumesActionsTest-1011119310 None] <== create_volume: return (1044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'} {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 15:08:16 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-3fce03a6-28ec-44d9-9567-aec9c075f467 tempest-VolumesActionsTest-1011119310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.047s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:08:16 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-3fce03a6-28ec-44d9-9567-aec9c075f467 tempest-VolumesActionsTest-1011119310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e7d695b-96ad-4139-bb7e-f3d3c1b1dcca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5bf7bd75-6f45-499d-a60d-1f4c806ed9f5', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:08:16 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-3fce03a6-28ec-44d9-9567-aec9c075f467 tempest-VolumesActionsTest-1011119310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c634477c-b038-4fda-9e8a-6a47763b003b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:08:16 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-3fce03a6-28ec-44d9-9567-aec9c075f467 tempest-VolumesActionsTest-1011119310 None] Volume volume-5bf7bd75-6f45-499d-a60d-1f4c806ed9f5 (5bf7bd75-6f45-499d-a60d-1f4c806ed9f5): created successfully Apr 16 15:08:16 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-3fce03a6-28ec-44d9-9567-aec9c075f467 tempest-VolumesActionsTest-1011119310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c634477c-b038-4fda-9e8a-6a47763b003b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:08:16 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-3fce03a6-28ec-44d9-9567-aec9c075f467 tempest-VolumesActionsTest-1011119310 None] Flow 'volume_create_manager' (aea55423-982f-4f28-9e06-a02680a91ee3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:08:16 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-3fce03a6-28ec-44d9-9567-aec9c075f467 tempest-VolumesActionsTest-1011119310 None] Created volume successfully. Apr 16 15:08:17 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-1453bd5f-8e7e-477a-8590-7875472fb885 tempest-VolumesActionsTest-1145584555 None] Acquiring lock "cinder-5bf7bd75-6f45-499d-a60d-1f4c806ed9f5-delete_volume" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:08:17 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-1453bd5f-8e7e-477a-8590-7875472fb885 tempest-VolumesActionsTest-1145584555 None] Lock "cinder-5bf7bd75-6f45-499d-a60d-1f4c806ed9f5-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:08:17 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-1453bd5f-8e7e-477a-8590-7875472fb885 tempest-VolumesActionsTest-1145584555 None] Acquiring lock "cinder-quobyte-5bf7bd75-6f45-499d-a60d-1f4c806ed9f5" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:08:17 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-1453bd5f-8e7e-477a-8590-7875472fb885 tempest-VolumesActionsTest-1145584555 None] Lock "cinder-quobyte-5bf7bd75-6f45-499d-a60d-1f4c806ed9f5" acquired by "delete_volume" :: waited 0.009s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:08:17 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[420fbbf5-cf12-42ad-a8b4-7592d6441e51]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:08:17 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-1453bd5f-8e7e-477a-8590-7875472fb885 tempest-VolumesActionsTest-1145584555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-5bf7bd75-6f45-499d-a60d-1f4c806ed9f5 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:08:17 devstack sudo[86677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-5bf7bd75-6f45-499d-a60d-1f4c806ed9f5 Apr 16 15:08:17 devstack sudo[86677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:08:17 devstack sudo[86677]: pam_unix(sudo:session): session closed for user root Apr 16 15:08:17 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-1453bd5f-8e7e-477a-8590-7875472fb885 tempest-VolumesActionsTest-1145584555 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-5bf7bd75-6f45-499d-a60d-1f4c806ed9f5" returned: 0 in 0.530s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:08:17 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-1453bd5f-8e7e-477a-8590-7875472fb885 tempest-VolumesActionsTest-1145584555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-5bf7bd75-6f45-499d-a60d-1f4c806ed9f5 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:08:17 devstack sudo[86689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-5bf7bd75-6f45-499d-a60d-1f4c806ed9f5 Apr 16 15:08:17 devstack sudo[86689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:08:18 devstack sudo[86689]: pam_unix(sudo:session): session closed for user root Apr 16 15:08:18 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-1453bd5f-8e7e-477a-8590-7875472fb885 tempest-VolumesActionsTest-1145584555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-5bf7bd75-6f45-499d-a60d-1f4c806ed9f5" returned: 0 in 0.651s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:08:18 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-1453bd5f-8e7e-477a-8590-7875472fb885 tempest-VolumesActionsTest-1145584555 None] Lock "cinder-quobyte-5bf7bd75-6f45-499d-a60d-1f4c806ed9f5" released by "delete_volume" :: held 1.220s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:08:18 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-1453bd5f-8e7e-477a-8590-7875472fb885 tempest-VolumesActionsTest-1145584555 None] Created reservations ['645c12f5-caf3-4af2-b6e5-b6ea05a121e8', '5838a7ef-4c1f-4243-af82-362dd772a19e', '5787e561-fbe6-4ded-9b60-5baf3ab8e8d1', 'd3a08965-ea41-43a8-8f3a-77a0a0e71fcb'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:08:18 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-1453bd5f-8e7e-477a-8590-7875472fb885 tempest-VolumesActionsTest-1145584555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:08:18 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-1453bd5f-8e7e-477a-8590-7875472fb885 tempest-VolumesActionsTest-1145584555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:08:18 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-1453bd5f-8e7e-477a-8590-7875472fb885 tempest-VolumesActionsTest-1145584555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:08:18 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-1453bd5f-8e7e-477a-8590-7875472fb885 tempest-VolumesActionsTest-1145584555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:08:18 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-1453bd5f-8e7e-477a-8590-7875472fb885 tempest-VolumesActionsTest-1145584555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:08:18 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-1453bd5f-8e7e-477a-8590-7875472fb885 tempest-VolumesActionsTest-1145584555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:08:18 devstack sudo[86728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:08:18 devstack sudo[86728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:08:19 devstack sudo[86728]: pam_unix(sudo:session): session closed for user root Apr 16 15:08:19 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-1453bd5f-8e7e-477a-8590-7875472fb885 tempest-VolumesActionsTest-1145584555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.566s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:08:19 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-1453bd5f-8e7e-477a-8590-7875472fb885 tempest-VolumesActionsTest-1145584555 None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:08:19 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-1453bd5f-8e7e-477a-8590-7875472fb885 tempest-VolumesActionsTest-1145584555 None] Deleted volume successfully. Apr 16 15:08:19 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-1453bd5f-8e7e-477a-8590-7875472fb885 tempest-VolumesActionsTest-1145584555 None] Lock "cinder-5bf7bd75-6f45-499d-a60d-1f4c806ed9f5-delete_volume" released by "delete_volume" :: held 1.982s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:08:19 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [None req-acbe5ad9-b18f-4378-8905-bcfc904a6195 tempest-VolumesActionsTest-1011119310 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82756) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 15:08:19 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-acbe5ad9-b18f-4378-8905-bcfc904a6195 tempest-VolumesActionsTest-1011119310 None] Flow 'volume_create_manager' (b6a6aeaa-67e8-4233-986d-d165472b850a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:08:19 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-acbe5ad9-b18f-4378-8905-bcfc904a6195 tempest-VolumesActionsTest-1011119310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (039417df-a2b0-499e-8a6d-79ecb9876901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:08:19 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-acbe5ad9-b18f-4378-8905-bcfc904a6195 tempest-VolumesActionsTest-1011119310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (039417df-a2b0-499e-8a6d-79ecb9876901) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:08:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1059398126',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff504898-c8ef-4b15-b187-b8fe00de4f3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f62108dfb2544358974111915853b3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:08:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:08:20Z,use_quota=True,user_id='d5b67ea45a1d45bb8b7c8d44919cd8fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:08:19 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-acbe5ad9-b18f-4378-8905-bcfc904a6195 tempest-VolumesActionsTest-1011119310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1479995d-65e8-4625-9535-c9af8c85709b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:08:19 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-acbe5ad9-b18f-4378-8905-bcfc904a6195 tempest-VolumesActionsTest-1011119310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1479995d-65e8-4625-9535-c9af8c85709b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:08:19 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-acbe5ad9-b18f-4378-8905-bcfc904a6195 tempest-VolumesActionsTest-1011119310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1f02335-3e7c-4a55-aa91-b480b25beede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:08:19 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-acbe5ad9-b18f-4378-8905-bcfc904a6195 tempest-VolumesActionsTest-1011119310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1f02335-3e7c-4a55-aa91-b480b25beede) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff504898-c8ef-4b15-b187-b8fe00de4f3b', 'volume_name': 'volume-ff504898-c8ef-4b15-b187-b8fe00de4f3b', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:08:19 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-acbe5ad9-b18f-4378-8905-bcfc904a6195 tempest-VolumesActionsTest-1011119310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c52358f6-a041-4ce8-8e7b-a1e616864217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:08:19 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-acbe5ad9-b18f-4378-8905-bcfc904a6195 tempest-VolumesActionsTest-1011119310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c52358f6-a041-4ce8-8e7b-a1e616864217) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:08:19 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-acbe5ad9-b18f-4378-8905-bcfc904a6195 tempest-VolumesActionsTest-1011119310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f361156-f013-4c2d-bfbb-4db0a29dbdb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:08:19 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-acbe5ad9-b18f-4378-8905-bcfc904a6195 tempest-VolumesActionsTest-1011119310 None] Volume ff504898-c8ef-4b15-b187-b8fe00de4f3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff504898-c8ef-4b15-b187-b8fe00de4f3b', 'volume_size': 1} Apr 16 15:08:19 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-acbe5ad9-b18f-4378-8905-bcfc904a6195 tempest-VolumesActionsTest-1011119310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:08:19 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-acbe5ad9-b18f-4378-8905-bcfc904a6195 tempest-VolumesActionsTest-1011119310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:08:19 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-acbe5ad9-b18f-4378-8905-bcfc904a6195 tempest-VolumesActionsTest-1011119310 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:08:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1059398126',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff504898-c8ef-4b15-b187-b8fe00de4f3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f62108dfb2544358974111915853b3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:08:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:08:20Z,use_quota=True,user_id='d5b67ea45a1d45bb8b7c8d44919cd8fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)}" {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 15:08:19 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-acbe5ad9-b18f-4378-8905-bcfc904a6195 tempest-VolumesActionsTest-1011119310 None] Creating volume ff504898-c8ef-4b15-b187-b8fe00de4f3b {{(pid=82756) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 15:08:19 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-acbe5ad9-b18f-4378-8905-bcfc904a6195 tempest-VolumesActionsTest-1011119310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:08:19 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-acbe5ad9-b18f-4378-8905-bcfc904a6195 tempest-VolumesActionsTest-1011119310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:08:19 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-acbe5ad9-b18f-4378-8905-bcfc904a6195 tempest-VolumesActionsTest-1011119310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:08:19 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-acbe5ad9-b18f-4378-8905-bcfc904a6195 tempest-VolumesActionsTest-1011119310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:08:19 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-acbe5ad9-b18f-4378-8905-bcfc904a6195 tempest-VolumesActionsTest-1011119310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:08:19 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-acbe5ad9-b18f-4378-8905-bcfc904a6195 tempest-VolumesActionsTest-1011119310 None] Selected osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 as target Quobyte volume. {{(pid=82756) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 15:08:19 devstack cinder-volume[82756]: INFO cinder.volume.drivers.remotefs [None req-acbe5ad9-b18f-4378-8905-bcfc904a6195 tempest-VolumesActionsTest-1011119310 None] casted to osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 Apr 16 15:08:19 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-acbe5ad9-b18f-4378-8905-bcfc904a6195 tempest-VolumesActionsTest-1011119310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-ff504898-c8ef-4b15-b187-b8fe00de4f3b 1073741824 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:08:19 devstack sudo[86775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-ff504898-c8ef-4b15-b187-b8fe00de4f3b 1073741824 Apr 16 15:08:19 devstack sudo[86775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:08:20 devstack sudo[86775]: pam_unix(sudo:session): session closed for user root Apr 16 15:08:20 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-acbe5ad9-b18f-4378-8905-bcfc904a6195 tempest-VolumesActionsTest-1011119310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-ff504898-c8ef-4b15-b187-b8fe00de4f3b 1073741824" returned: 0 in 0.735s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:08:20 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-acbe5ad9-b18f-4378-8905-bcfc904a6195 tempest-VolumesActionsTest-1011119310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-ff504898-c8ef-4b15-b187-b8fe00de4f3b {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:08:20 devstack sudo[86784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-ff504898-c8ef-4b15-b187-b8fe00de4f3b Apr 16 15:08:20 devstack sudo[86784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:08:21 devstack sudo[86784]: pam_unix(sudo:session): session closed for user root Apr 16 15:08:21 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-acbe5ad9-b18f-4378-8905-bcfc904a6195 tempest-VolumesActionsTest-1011119310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-ff504898-c8ef-4b15-b187-b8fe00de4f3b" returned: 0 in 0.677s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:08:21 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-acbe5ad9-b18f-4378-8905-bcfc904a6195 tempest-VolumesActionsTest-1011119310 None] <== create_volume: return (1443ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'} {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 15:08:21 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-acbe5ad9-b18f-4378-8905-bcfc904a6195 tempest-VolumesActionsTest-1011119310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.445s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:08:21 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-acbe5ad9-b18f-4378-8905-bcfc904a6195 tempest-VolumesActionsTest-1011119310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f361156-f013-4c2d-bfbb-4db0a29dbdb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff504898-c8ef-4b15-b187-b8fe00de4f3b', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:08:21 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-acbe5ad9-b18f-4378-8905-bcfc904a6195 tempest-VolumesActionsTest-1011119310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (974f4217-2381-486d-8f90-a573f2dcc5e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:08:21 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-acbe5ad9-b18f-4378-8905-bcfc904a6195 tempest-VolumesActionsTest-1011119310 None] Volume volume-ff504898-c8ef-4b15-b187-b8fe00de4f3b (ff504898-c8ef-4b15-b187-b8fe00de4f3b): created successfully Apr 16 15:08:21 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-acbe5ad9-b18f-4378-8905-bcfc904a6195 tempest-VolumesActionsTest-1011119310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (974f4217-2381-486d-8f90-a573f2dcc5e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:08:21 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-acbe5ad9-b18f-4378-8905-bcfc904a6195 tempest-VolumesActionsTest-1011119310 None] Flow 'volume_create_manager' (b6a6aeaa-67e8-4233-986d-d165472b850a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:08:21 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-acbe5ad9-b18f-4378-8905-bcfc904a6195 tempest-VolumesActionsTest-1011119310 None] Created volume successfully. Apr 16 15:08:22 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-a87f927c-7b63-450b-8446-906ea1612347 tempest-VolumesActionsTest-1145584555 None] Acquiring lock "cinder-ff504898-c8ef-4b15-b187-b8fe00de4f3b-delete_volume" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:08:22 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-a87f927c-7b63-450b-8446-906ea1612347 tempest-VolumesActionsTest-1145584555 None] Lock "cinder-ff504898-c8ef-4b15-b187-b8fe00de4f3b-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:08:22 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-a87f927c-7b63-450b-8446-906ea1612347 tempest-VolumesActionsTest-1145584555 None] Acquiring lock "cinder-quobyte-ff504898-c8ef-4b15-b187-b8fe00de4f3b" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:08:22 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-a87f927c-7b63-450b-8446-906ea1612347 tempest-VolumesActionsTest-1145584555 None] Lock "cinder-quobyte-ff504898-c8ef-4b15-b187-b8fe00de4f3b" acquired by "delete_volume" :: waited 0.015s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:08:22 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f1ec654-e815-4186-ae75-eb29cf718e23]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:08:22 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-a87f927c-7b63-450b-8446-906ea1612347 tempest-VolumesActionsTest-1145584555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-ff504898-c8ef-4b15-b187-b8fe00de4f3b {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:08:22 devstack sudo[86793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-ff504898-c8ef-4b15-b187-b8fe00de4f3b Apr 16 15:08:22 devstack sudo[86793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:08:23 devstack sudo[86793]: pam_unix(sudo:session): session closed for user root Apr 16 15:08:23 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-a87f927c-7b63-450b-8446-906ea1612347 tempest-VolumesActionsTest-1145584555 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-ff504898-c8ef-4b15-b187-b8fe00de4f3b" returned: 0 in 0.899s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:08:23 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-a87f927c-7b63-450b-8446-906ea1612347 tempest-VolumesActionsTest-1145584555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-ff504898-c8ef-4b15-b187-b8fe00de4f3b {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:08:23 devstack sudo[86799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-ff504898-c8ef-4b15-b187-b8fe00de4f3b Apr 16 15:08:23 devstack sudo[86799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:08:24 devstack sudo[86799]: pam_unix(sudo:session): session closed for user root Apr 16 15:08:24 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-a87f927c-7b63-450b-8446-906ea1612347 tempest-VolumesActionsTest-1145584555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-ff504898-c8ef-4b15-b187-b8fe00de4f3b" returned: 0 in 1.382s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:08:24 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-a87f927c-7b63-450b-8446-906ea1612347 tempest-VolumesActionsTest-1145584555 None] Lock "cinder-quobyte-ff504898-c8ef-4b15-b187-b8fe00de4f3b" released by "delete_volume" :: held 2.391s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:08:24 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-a87f927c-7b63-450b-8446-906ea1612347 tempest-VolumesActionsTest-1145584555 None] Created reservations ['4fe1237c-7a11-4cba-ace7-44c7da7a10c0', '343c3561-0a17-4bff-97d1-a8cf0e00858e', '74899897-7ce7-4e8e-a8b9-4fbeb1462d74', 'de99af0c-9939-47c5-83e0-8b324a297044'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:08:24 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-a87f927c-7b63-450b-8446-906ea1612347 tempest-VolumesActionsTest-1145584555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:08:24 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-a87f927c-7b63-450b-8446-906ea1612347 tempest-VolumesActionsTest-1145584555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:08:24 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-a87f927c-7b63-450b-8446-906ea1612347 tempest-VolumesActionsTest-1145584555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:08:24 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-a87f927c-7b63-450b-8446-906ea1612347 tempest-VolumesActionsTest-1145584555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:08:24 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-a87f927c-7b63-450b-8446-906ea1612347 tempest-VolumesActionsTest-1145584555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:08:24 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-a87f927c-7b63-450b-8446-906ea1612347 tempest-VolumesActionsTest-1145584555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:08:24 devstack sudo[86849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:08:24 devstack sudo[86849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:08:26 devstack sudo[86849]: pam_unix(sudo:session): session closed for user root Apr 16 15:08:26 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-a87f927c-7b63-450b-8446-906ea1612347 tempest-VolumesActionsTest-1145584555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 1.526s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:08:26 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-a87f927c-7b63-450b-8446-906ea1612347 tempest-VolumesActionsTest-1145584555 None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:08:26 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-a87f927c-7b63-450b-8446-906ea1612347 tempest-VolumesActionsTest-1145584555 None] Deleted volume successfully. Apr 16 15:08:26 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-a87f927c-7b63-450b-8446-906ea1612347 tempest-VolumesActionsTest-1145584555 None] Lock "cinder-ff504898-c8ef-4b15-b187-b8fe00de4f3b-delete_volume" released by "delete_volume" :: held 4.282s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:08:26 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [None req-3350ca3e-2802-4907-9e3b-abbe5418fa59 tempest-VolumesActionsTest-1011119310 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82756) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 15:08:26 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-3350ca3e-2802-4907-9e3b-abbe5418fa59 tempest-VolumesActionsTest-1011119310 None] Flow 'volume_create_manager' (0a106e64-16a0-4ebc-8b4d-656dc2cf6580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:08:26 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-3350ca3e-2802-4907-9e3b-abbe5418fa59 tempest-VolumesActionsTest-1011119310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e43124e-f11a-4635-b31c-4e7ac3fa1de7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:08:27 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-3350ca3e-2802-4907-9e3b-abbe5418fa59 tempest-VolumesActionsTest-1011119310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e43124e-f11a-4635-b31c-4e7ac3fa1de7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:08:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1456733625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3aecece3-e507-45f7-8bbd-5af8206612fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f62108dfb2544358974111915853b3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:08:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:08:27Z,use_quota=True,user_id='d5b67ea45a1d45bb8b7c8d44919cd8fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:08:27 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-3350ca3e-2802-4907-9e3b-abbe5418fa59 tempest-VolumesActionsTest-1011119310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (796cf1c1-1dcf-44a6-acf0-ac422dd661dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:08:27 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-3350ca3e-2802-4907-9e3b-abbe5418fa59 tempest-VolumesActionsTest-1011119310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (796cf1c1-1dcf-44a6-acf0-ac422dd661dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:08:27 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-3350ca3e-2802-4907-9e3b-abbe5418fa59 tempest-VolumesActionsTest-1011119310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d75d7390-d0a2-44b9-8960-3c0d8e542c0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:08:27 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-3350ca3e-2802-4907-9e3b-abbe5418fa59 tempest-VolumesActionsTest-1011119310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d75d7390-d0a2-44b9-8960-3c0d8e542c0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3aecece3-e507-45f7-8bbd-5af8206612fb', 'volume_name': 'volume-3aecece3-e507-45f7-8bbd-5af8206612fb', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:08:27 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-3350ca3e-2802-4907-9e3b-abbe5418fa59 tempest-VolumesActionsTest-1011119310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1deadf95-bde5-4c3b-a976-240c0749269b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:08:27 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-3350ca3e-2802-4907-9e3b-abbe5418fa59 tempest-VolumesActionsTest-1011119310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1deadf95-bde5-4c3b-a976-240c0749269b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:08:27 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-3350ca3e-2802-4907-9e3b-abbe5418fa59 tempest-VolumesActionsTest-1011119310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (095e3886-2da3-47e8-b94f-438815a827f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:08:27 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-3350ca3e-2802-4907-9e3b-abbe5418fa59 tempest-VolumesActionsTest-1011119310 None] Volume 3aecece3-e507-45f7-8bbd-5af8206612fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3aecece3-e507-45f7-8bbd-5af8206612fb', 'volume_size': 1} Apr 16 15:08:27 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-3350ca3e-2802-4907-9e3b-abbe5418fa59 tempest-VolumesActionsTest-1011119310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:08:27 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-3350ca3e-2802-4907-9e3b-abbe5418fa59 tempest-VolumesActionsTest-1011119310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:08:27 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-3350ca3e-2802-4907-9e3b-abbe5418fa59 tempest-VolumesActionsTest-1011119310 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:08:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1456733625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3aecece3-e507-45f7-8bbd-5af8206612fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f62108dfb2544358974111915853b3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:08:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:08:27Z,use_quota=True,user_id='d5b67ea45a1d45bb8b7c8d44919cd8fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)}" {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 15:08:27 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-3350ca3e-2802-4907-9e3b-abbe5418fa59 tempest-VolumesActionsTest-1011119310 None] Creating volume 3aecece3-e507-45f7-8bbd-5af8206612fb {{(pid=82756) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 15:08:27 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-3350ca3e-2802-4907-9e3b-abbe5418fa59 tempest-VolumesActionsTest-1011119310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:08:27 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-3350ca3e-2802-4907-9e3b-abbe5418fa59 tempest-VolumesActionsTest-1011119310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:08:27 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-3350ca3e-2802-4907-9e3b-abbe5418fa59 tempest-VolumesActionsTest-1011119310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:08:27 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-3350ca3e-2802-4907-9e3b-abbe5418fa59 tempest-VolumesActionsTest-1011119310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:08:27 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-3350ca3e-2802-4907-9e3b-abbe5418fa59 tempest-VolumesActionsTest-1011119310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:08:27 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-3350ca3e-2802-4907-9e3b-abbe5418fa59 tempest-VolumesActionsTest-1011119310 None] Selected osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 as target Quobyte volume. {{(pid=82756) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 15:08:27 devstack cinder-volume[82756]: INFO cinder.volume.drivers.remotefs [None req-3350ca3e-2802-4907-9e3b-abbe5418fa59 tempest-VolumesActionsTest-1011119310 None] casted to osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 Apr 16 15:08:27 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-3350ca3e-2802-4907-9e3b-abbe5418fa59 tempest-VolumesActionsTest-1011119310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-3aecece3-e507-45f7-8bbd-5af8206612fb 1073741824 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:08:27 devstack sudo[86887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-3aecece3-e507-45f7-8bbd-5af8206612fb 1073741824 Apr 16 15:08:27 devstack sudo[86887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:08:27 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-690f9e1e-ed9f-4809-b933-1e32f86b4367 tempest-VolumesActionsTest-570492233 None] Acquiring lock "cinder-c1fe4c2f-0039-4d10-b121-1dbbbdb434fa" by "attach_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:08:27 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-690f9e1e-ed9f-4809-b933-1e32f86b4367 tempest-VolumesActionsTest-570492233 None] Lock "cinder-c1fe4c2f-0039-4d10-b121-1dbbbdb434fa" acquired by "attach_volume" :: waited 0.029s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:08:27 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-690f9e1e-ed9f-4809-b933-1e32f86b4367 tempest-VolumesActionsTest-570492233 None] Attaching volume c1fe4c2f-0039-4d10-b121-1dbbbdb434fa to instance df5da900-6556-4b1a-ad98-4fec2498a6df at mountpoint /dev/vdb on host None. Apr 16 15:08:27 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-690f9e1e-ed9f-4809-b933-1e32f86b4367 tempest-VolumesActionsTest-570492233 None] Attach volume completed successfully. Apr 16 15:08:27 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-690f9e1e-ed9f-4809-b933-1e32f86b4367 tempest-VolumesActionsTest-570492233 None] Lock "cinder-c1fe4c2f-0039-4d10-b121-1dbbbdb434fa" released by "attach_volume" :: held 0.130s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:08:28 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-af417c87-4b22-45c2-9106-bd26961083a5 tempest-VolumesActionsTest-570492233 None] Acquiring lock "cinder-c1fe4c2f-0039-4d10-b121-1dbbbdb434fa-detach_volume" by "detach_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:08:28 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-af417c87-4b22-45c2-9106-bd26961083a5 tempest-VolumesActionsTest-570492233 None] Lock "cinder-c1fe4c2f-0039-4d10-b121-1dbbbdb434fa-detach_volume" acquired by "detach_volume" :: waited 0.014s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:08:28 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-af417c87-4b22-45c2-9106-bd26961083a5 tempest-VolumesActionsTest-570492233 None] Detaching volume c1fe4c2f-0039-4d10-b121-1dbbbdb434fa from instance df5da900-6556-4b1a-ad98-4fec2498a6df. Apr 16 15:08:28 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-af417c87-4b22-45c2-9106-bd26961083a5 tempest-VolumesActionsTest-570492233 None] Detach volume completed successfully. Apr 16 15:08:28 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-af417c87-4b22-45c2-9106-bd26961083a5 tempest-VolumesActionsTest-570492233 None] Lock "cinder-c1fe4c2f-0039-4d10-b121-1dbbbdb434fa-detach_volume" released by "detach_volume" :: held 0.083s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:08:28 devstack sudo[86887]: pam_unix(sudo:session): session closed for user root Apr 16 15:08:28 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-3350ca3e-2802-4907-9e3b-abbe5418fa59 tempest-VolumesActionsTest-1011119310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-3aecece3-e507-45f7-8bbd-5af8206612fb 1073741824" returned: 0 in 1.445s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:08:28 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-3350ca3e-2802-4907-9e3b-abbe5418fa59 tempest-VolumesActionsTest-1011119310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-3aecece3-e507-45f7-8bbd-5af8206612fb {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:08:28 devstack sudo[86916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-3aecece3-e507-45f7-8bbd-5af8206612fb Apr 16 15:08:28 devstack sudo[86916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:08:29 devstack sudo[86916]: pam_unix(sudo:session): session closed for user root Apr 16 15:08:29 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-3350ca3e-2802-4907-9e3b-abbe5418fa59 tempest-VolumesActionsTest-1011119310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-3aecece3-e507-45f7-8bbd-5af8206612fb" returned: 0 in 0.531s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:08:29 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-3350ca3e-2802-4907-9e3b-abbe5418fa59 tempest-VolumesActionsTest-1011119310 None] <== create_volume: return (2024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'} {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 15:08:29 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-3350ca3e-2802-4907-9e3b-abbe5418fa59 tempest-VolumesActionsTest-1011119310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.027s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:08:29 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-3350ca3e-2802-4907-9e3b-abbe5418fa59 tempest-VolumesActionsTest-1011119310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (095e3886-2da3-47e8-b94f-438815a827f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3aecece3-e507-45f7-8bbd-5af8206612fb', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:08:29 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-3350ca3e-2802-4907-9e3b-abbe5418fa59 tempest-VolumesActionsTest-1011119310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6876d17c-5f77-490e-a557-62586ac19210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:08:29 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-3350ca3e-2802-4907-9e3b-abbe5418fa59 tempest-VolumesActionsTest-1011119310 None] Volume volume-3aecece3-e507-45f7-8bbd-5af8206612fb (3aecece3-e507-45f7-8bbd-5af8206612fb): created successfully Apr 16 15:08:29 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-3350ca3e-2802-4907-9e3b-abbe5418fa59 tempest-VolumesActionsTest-1011119310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6876d17c-5f77-490e-a557-62586ac19210) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:08:29 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-3350ca3e-2802-4907-9e3b-abbe5418fa59 tempest-VolumesActionsTest-1011119310 None] Flow 'volume_create_manager' (0a106e64-16a0-4ebc-8b4d-656dc2cf6580) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:08:29 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-3350ca3e-2802-4907-9e3b-abbe5418fa59 tempest-VolumesActionsTest-1011119310 None] Created volume successfully. Apr 16 15:08:30 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-095439fc-e165-4fcb-9b7e-0258a78ddfc1 tempest-VolumesActionsTest-1145584555 None] Acquiring lock "cinder-3aecece3-e507-45f7-8bbd-5af8206612fb-delete_volume" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:08:30 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-095439fc-e165-4fcb-9b7e-0258a78ddfc1 tempest-VolumesActionsTest-1145584555 None] Lock "cinder-3aecece3-e507-45f7-8bbd-5af8206612fb-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:08:30 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-095439fc-e165-4fcb-9b7e-0258a78ddfc1 tempest-VolumesActionsTest-1145584555 None] Acquiring lock "cinder-quobyte-3aecece3-e507-45f7-8bbd-5af8206612fb" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:08:30 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-095439fc-e165-4fcb-9b7e-0258a78ddfc1 tempest-VolumesActionsTest-1145584555 None] Lock "cinder-quobyte-3aecece3-e507-45f7-8bbd-5af8206612fb" acquired by "delete_volume" :: waited 0.012s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:08:30 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[19521df5-1bd2-498e-b028-c3a0b738135b]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:08:30 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-095439fc-e165-4fcb-9b7e-0258a78ddfc1 tempest-VolumesActionsTest-1145584555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-3aecece3-e507-45f7-8bbd-5af8206612fb {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:08:30 devstack sudo[86927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-3aecece3-e507-45f7-8bbd-5af8206612fb Apr 16 15:08:30 devstack sudo[86927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:08:30 devstack sudo[86927]: pam_unix(sudo:session): session closed for user root Apr 16 15:08:30 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-095439fc-e165-4fcb-9b7e-0258a78ddfc1 tempest-VolumesActionsTest-1145584555 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-3aecece3-e507-45f7-8bbd-5af8206612fb" returned: 0 in 0.688s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:08:30 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-095439fc-e165-4fcb-9b7e-0258a78ddfc1 tempest-VolumesActionsTest-1145584555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-3aecece3-e507-45f7-8bbd-5af8206612fb {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:08:30 devstack sudo[86966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-3aecece3-e507-45f7-8bbd-5af8206612fb Apr 16 15:08:30 devstack sudo[86966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:08:31 devstack sudo[86966]: pam_unix(sudo:session): session closed for user root Apr 16 15:08:31 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-095439fc-e165-4fcb-9b7e-0258a78ddfc1 tempest-VolumesActionsTest-1145584555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-3aecece3-e507-45f7-8bbd-5af8206612fb" returned: 0 in 0.527s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:08:31 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-095439fc-e165-4fcb-9b7e-0258a78ddfc1 tempest-VolumesActionsTest-1145584555 None] Lock "cinder-quobyte-3aecece3-e507-45f7-8bbd-5af8206612fb" released by "delete_volume" :: held 1.239s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:08:31 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-095439fc-e165-4fcb-9b7e-0258a78ddfc1 tempest-VolumesActionsTest-1145584555 None] Created reservations ['3b41f44b-12c8-43bf-8453-dc4ce982d1ee', '78479cac-c937-44e6-a2b8-9076c3317027', 'ade72d40-925d-40b1-8a42-2031985c7ea3', 'c5a96268-3222-4297-93fa-c177b0504b5d'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:08:31 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-095439fc-e165-4fcb-9b7e-0258a78ddfc1 tempest-VolumesActionsTest-1145584555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:08:31 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-095439fc-e165-4fcb-9b7e-0258a78ddfc1 tempest-VolumesActionsTest-1145584555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:08:31 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-095439fc-e165-4fcb-9b7e-0258a78ddfc1 tempest-VolumesActionsTest-1145584555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:08:31 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-095439fc-e165-4fcb-9b7e-0258a78ddfc1 tempest-VolumesActionsTest-1145584555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:08:31 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-095439fc-e165-4fcb-9b7e-0258a78ddfc1 tempest-VolumesActionsTest-1145584555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:08:31 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-095439fc-e165-4fcb-9b7e-0258a78ddfc1 tempest-VolumesActionsTest-1145584555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:08:31 devstack sudo[86974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:08:31 devstack sudo[86974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:08:32 devstack sudo[86974]: pam_unix(sudo:session): session closed for user root Apr 16 15:08:32 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-095439fc-e165-4fcb-9b7e-0258a78ddfc1 tempest-VolumesActionsTest-1145584555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.541s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:08:32 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-095439fc-e165-4fcb-9b7e-0258a78ddfc1 tempest-VolumesActionsTest-1145584555 None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:08:32 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-095439fc-e165-4fcb-9b7e-0258a78ddfc1 tempest-VolumesActionsTest-1145584555 None] Deleted volume successfully. Apr 16 15:08:32 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-095439fc-e165-4fcb-9b7e-0258a78ddfc1 tempest-VolumesActionsTest-1145584555 None] Lock "cinder-3aecece3-e507-45f7-8bbd-5af8206612fb-delete_volume" released by "delete_volume" :: held 1.941s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:08:32 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb75b9e7-c012-4936-9035-01320f83a42b tempest-VolumesActionsTest-1011119310 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82756) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 15:08:32 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-fb75b9e7-c012-4936-9035-01320f83a42b tempest-VolumesActionsTest-1011119310 None] Flow 'volume_create_manager' (ea55e656-41e7-4d41-a453-d9618ddafbd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:08:32 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-fb75b9e7-c012-4936-9035-01320f83a42b tempest-VolumesActionsTest-1011119310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d83bde0c-3954-4315-a108-ee5eac3e34f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:08:32 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-fb75b9e7-c012-4936-9035-01320f83a42b tempest-VolumesActionsTest-1011119310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d83bde0c-3954-4315-a108-ee5eac3e34f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:08:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1064838668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3e676b8-99fb-4ea4-96b5-8fc29fcd9e90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f62108dfb2544358974111915853b3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:08:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:08:33Z,use_quota=True,user_id='d5b67ea45a1d45bb8b7c8d44919cd8fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:08:32 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-fb75b9e7-c012-4936-9035-01320f83a42b tempest-VolumesActionsTest-1011119310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bfce7d6-48f9-4c10-b6b0-6925e7e0ab67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:08:32 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-fb75b9e7-c012-4936-9035-01320f83a42b tempest-VolumesActionsTest-1011119310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bfce7d6-48f9-4c10-b6b0-6925e7e0ab67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:08:32 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-fb75b9e7-c012-4936-9035-01320f83a42b tempest-VolumesActionsTest-1011119310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b6ab24c-c373-4081-9a56-c700cdbc40f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:08:32 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-fb75b9e7-c012-4936-9035-01320f83a42b tempest-VolumesActionsTest-1011119310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b6ab24c-c373-4081-9a56-c700cdbc40f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3e676b8-99fb-4ea4-96b5-8fc29fcd9e90', 'volume_name': 'volume-d3e676b8-99fb-4ea4-96b5-8fc29fcd9e90', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:08:32 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-fb75b9e7-c012-4936-9035-01320f83a42b tempest-VolumesActionsTest-1011119310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e290c12-efe0-450f-a2e5-f4f480b5494c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:08:32 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-fb75b9e7-c012-4936-9035-01320f83a42b tempest-VolumesActionsTest-1011119310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e290c12-efe0-450f-a2e5-f4f480b5494c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:08:32 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-fb75b9e7-c012-4936-9035-01320f83a42b tempest-VolumesActionsTest-1011119310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bf331b8-422f-473c-bbcb-506c35f47cb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:08:32 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-fb75b9e7-c012-4936-9035-01320f83a42b tempest-VolumesActionsTest-1011119310 None] Volume d3e676b8-99fb-4ea4-96b5-8fc29fcd9e90: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3e676b8-99fb-4ea4-96b5-8fc29fcd9e90', 'volume_size': 1} Apr 16 15:08:32 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-fb75b9e7-c012-4936-9035-01320f83a42b tempest-VolumesActionsTest-1011119310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:08:32 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-fb75b9e7-c012-4936-9035-01320f83a42b tempest-VolumesActionsTest-1011119310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:08:32 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-fb75b9e7-c012-4936-9035-01320f83a42b tempest-VolumesActionsTest-1011119310 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:08:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1064838668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3e676b8-99fb-4ea4-96b5-8fc29fcd9e90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f62108dfb2544358974111915853b3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:08:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:08:33Z,use_quota=True,user_id='d5b67ea45a1d45bb8b7c8d44919cd8fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)}" {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 15:08:32 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-fb75b9e7-c012-4936-9035-01320f83a42b tempest-VolumesActionsTest-1011119310 None] Creating volume d3e676b8-99fb-4ea4-96b5-8fc29fcd9e90 {{(pid=82756) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 15:08:32 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-fb75b9e7-c012-4936-9035-01320f83a42b tempest-VolumesActionsTest-1011119310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:08:32 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-fb75b9e7-c012-4936-9035-01320f83a42b tempest-VolumesActionsTest-1011119310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:08:32 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-fb75b9e7-c012-4936-9035-01320f83a42b tempest-VolumesActionsTest-1011119310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:08:32 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-fb75b9e7-c012-4936-9035-01320f83a42b tempest-VolumesActionsTest-1011119310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:08:32 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-fb75b9e7-c012-4936-9035-01320f83a42b tempest-VolumesActionsTest-1011119310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:08:32 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-fb75b9e7-c012-4936-9035-01320f83a42b tempest-VolumesActionsTest-1011119310 None] Selected osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 as target Quobyte volume. {{(pid=82756) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 15:08:32 devstack cinder-volume[82756]: INFO cinder.volume.drivers.remotefs [None req-fb75b9e7-c012-4936-9035-01320f83a42b tempest-VolumesActionsTest-1011119310 None] casted to osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 Apr 16 15:08:32 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-fb75b9e7-c012-4936-9035-01320f83a42b tempest-VolumesActionsTest-1011119310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-d3e676b8-99fb-4ea4-96b5-8fc29fcd9e90 1073741824 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:08:32 devstack sudo[86981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-d3e676b8-99fb-4ea4-96b5-8fc29fcd9e90 1073741824 Apr 16 15:08:32 devstack sudo[86981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:08:33 devstack sudo[86981]: pam_unix(sudo:session): session closed for user root Apr 16 15:08:33 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-fb75b9e7-c012-4936-9035-01320f83a42b tempest-VolumesActionsTest-1011119310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-d3e676b8-99fb-4ea4-96b5-8fc29fcd9e90 1073741824" returned: 0 in 0.800s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:08:33 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-fb75b9e7-c012-4936-9035-01320f83a42b tempest-VolumesActionsTest-1011119310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-d3e676b8-99fb-4ea4-96b5-8fc29fcd9e90 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:08:33 devstack sudo[87013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-d3e676b8-99fb-4ea4-96b5-8fc29fcd9e90 Apr 16 15:08:33 devstack sudo[87013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:08:34 devstack sudo[87013]: pam_unix(sudo:session): session closed for user root Apr 16 15:08:34 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-fb75b9e7-c012-4936-9035-01320f83a42b tempest-VolumesActionsTest-1011119310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-d3e676b8-99fb-4ea4-96b5-8fc29fcd9e90" returned: 0 in 0.791s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:08:34 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-fb75b9e7-c012-4936-9035-01320f83a42b tempest-VolumesActionsTest-1011119310 None] <== create_volume: return (1695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'} {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 15:08:34 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-fb75b9e7-c012-4936-9035-01320f83a42b tempest-VolumesActionsTest-1011119310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.697s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:08:34 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-fb75b9e7-c012-4936-9035-01320f83a42b tempest-VolumesActionsTest-1011119310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bf331b8-422f-473c-bbcb-506c35f47cb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3e676b8-99fb-4ea4-96b5-8fc29fcd9e90', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:08:34 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-fb75b9e7-c012-4936-9035-01320f83a42b tempest-VolumesActionsTest-1011119310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0099c93a-1f23-43e2-9032-bca3c9e9d645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:08:34 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-fb75b9e7-c012-4936-9035-01320f83a42b tempest-VolumesActionsTest-1011119310 None] Volume volume-d3e676b8-99fb-4ea4-96b5-8fc29fcd9e90 (d3e676b8-99fb-4ea4-96b5-8fc29fcd9e90): created successfully Apr 16 15:08:34 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-fb75b9e7-c012-4936-9035-01320f83a42b tempest-VolumesActionsTest-1011119310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0099c93a-1f23-43e2-9032-bca3c9e9d645) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:08:34 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-fb75b9e7-c012-4936-9035-01320f83a42b tempest-VolumesActionsTest-1011119310 None] Flow 'volume_create_manager' (ea55e656-41e7-4d41-a453-d9618ddafbd7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:08:34 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-fb75b9e7-c012-4936-9035-01320f83a42b tempest-VolumesActionsTest-1011119310 None] Created volume successfully. Apr 16 15:08:35 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-59ad1938-2000-45cb-aea6-9a0599dde99d tempest-VolumesActionsTest-1145584555 None] Acquiring lock "cinder-d3e676b8-99fb-4ea4-96b5-8fc29fcd9e90-delete_volume" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:08:35 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-59ad1938-2000-45cb-aea6-9a0599dde99d tempest-VolumesActionsTest-1145584555 None] Lock "cinder-d3e676b8-99fb-4ea4-96b5-8fc29fcd9e90-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:08:35 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-59ad1938-2000-45cb-aea6-9a0599dde99d tempest-VolumesActionsTest-1145584555 None] Acquiring lock "cinder-quobyte-d3e676b8-99fb-4ea4-96b5-8fc29fcd9e90" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:08:35 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-59ad1938-2000-45cb-aea6-9a0599dde99d tempest-VolumesActionsTest-1145584555 None] Lock "cinder-quobyte-d3e676b8-99fb-4ea4-96b5-8fc29fcd9e90" acquired by "delete_volume" :: waited 0.019s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:08:35 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f2f1bdd-9ff9-405f-8327-e700a109f60e]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:08:35 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-59ad1938-2000-45cb-aea6-9a0599dde99d tempest-VolumesActionsTest-1145584555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-d3e676b8-99fb-4ea4-96b5-8fc29fcd9e90 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:08:35 devstack sudo[87022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-d3e676b8-99fb-4ea4-96b5-8fc29fcd9e90 Apr 16 15:08:35 devstack sudo[87022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:08:36 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [None req-1eeb63e1-86a3-49a5-a252-5ea7f9c625c0 tempest-ServerRescueNegativeTestJSON-1038487610 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82756) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 15:08:36 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-1eeb63e1-86a3-49a5-a252-5ea7f9c625c0 tempest-ServerRescueNegativeTestJSON-1038487610 None] Flow 'volume_create_manager' (c099be6a-18ac-4141-8bf4-a6d1ea7b725e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:08:36 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-1eeb63e1-86a3-49a5-a252-5ea7f9c625c0 tempest-ServerRescueNegativeTestJSON-1038487610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33e40ba5-3237-4033-b698-aa17c67761a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:08:36 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-1eeb63e1-86a3-49a5-a252-5ea7f9c625c0 tempest-ServerRescueNegativeTestJSON-1038487610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33e40ba5-3237-4033-b698-aa17c67761a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:08:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-369429197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dac7a8d-9bd5-4e83-8851-4d522b7c82c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6b23ed425214e7293b7b52f04ccb2ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:08:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:08:36Z,use_quota=True,user_id='cbc084dcebf041d790923e1840d6bb85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:08:36 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-1eeb63e1-86a3-49a5-a252-5ea7f9c625c0 tempest-ServerRescueNegativeTestJSON-1038487610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e5c74f0-dcfc-4772-9e26-7f86746ceff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:08:36 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-1eeb63e1-86a3-49a5-a252-5ea7f9c625c0 tempest-ServerRescueNegativeTestJSON-1038487610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e5c74f0-dcfc-4772-9e26-7f86746ceff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:08:36 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-1eeb63e1-86a3-49a5-a252-5ea7f9c625c0 tempest-ServerRescueNegativeTestJSON-1038487610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62535323-d60c-418c-93f9-ae6dc8709742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:08:36 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-1eeb63e1-86a3-49a5-a252-5ea7f9c625c0 tempest-ServerRescueNegativeTestJSON-1038487610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62535323-d60c-418c-93f9-ae6dc8709742) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6dac7a8d-9bd5-4e83-8851-4d522b7c82c8', 'volume_name': 'volume-6dac7a8d-9bd5-4e83-8851-4d522b7c82c8', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:08:36 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-1eeb63e1-86a3-49a5-a252-5ea7f9c625c0 tempest-ServerRescueNegativeTestJSON-1038487610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9e76691-bf85-4832-9a0b-d447f4c93674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:08:36 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-1eeb63e1-86a3-49a5-a252-5ea7f9c625c0 tempest-ServerRescueNegativeTestJSON-1038487610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9e76691-bf85-4832-9a0b-d447f4c93674) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:08:36 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-1eeb63e1-86a3-49a5-a252-5ea7f9c625c0 tempest-ServerRescueNegativeTestJSON-1038487610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6b1c2ed-0db2-4619-a858-59f0b7d7ba64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:08:36 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-1eeb63e1-86a3-49a5-a252-5ea7f9c625c0 tempest-ServerRescueNegativeTestJSON-1038487610 None] Volume 6dac7a8d-9bd5-4e83-8851-4d522b7c82c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6dac7a8d-9bd5-4e83-8851-4d522b7c82c8', 'volume_size': 1} Apr 16 15:08:36 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-1eeb63e1-86a3-49a5-a252-5ea7f9c625c0 tempest-ServerRescueNegativeTestJSON-1038487610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:08:36 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-1eeb63e1-86a3-49a5-a252-5ea7f9c625c0 tempest-ServerRescueNegativeTestJSON-1038487610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:08:36 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-1eeb63e1-86a3-49a5-a252-5ea7f9c625c0 tempest-ServerRescueNegativeTestJSON-1038487610 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:08:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-369429197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dac7a8d-9bd5-4e83-8851-4d522b7c82c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6b23ed425214e7293b7b52f04ccb2ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:08:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:08:36Z,use_quota=True,user_id='cbc084dcebf041d790923e1840d6bb85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)}" {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 15:08:36 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-1eeb63e1-86a3-49a5-a252-5ea7f9c625c0 tempest-ServerRescueNegativeTestJSON-1038487610 None] Creating volume 6dac7a8d-9bd5-4e83-8851-4d522b7c82c8 {{(pid=82756) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 15:08:36 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-1eeb63e1-86a3-49a5-a252-5ea7f9c625c0 tempest-ServerRescueNegativeTestJSON-1038487610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:08:36 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-1eeb63e1-86a3-49a5-a252-5ea7f9c625c0 tempest-ServerRescueNegativeTestJSON-1038487610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:08:36 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-1eeb63e1-86a3-49a5-a252-5ea7f9c625c0 tempest-ServerRescueNegativeTestJSON-1038487610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:08:36 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-1eeb63e1-86a3-49a5-a252-5ea7f9c625c0 tempest-ServerRescueNegativeTestJSON-1038487610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:08:36 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-1eeb63e1-86a3-49a5-a252-5ea7f9c625c0 tempest-ServerRescueNegativeTestJSON-1038487610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:08:36 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-1eeb63e1-86a3-49a5-a252-5ea7f9c625c0 tempest-ServerRescueNegativeTestJSON-1038487610 None] Selected osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 as target Quobyte volume. {{(pid=82756) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 15:08:36 devstack cinder-volume[82756]: INFO cinder.volume.drivers.remotefs [None req-1eeb63e1-86a3-49a5-a252-5ea7f9c625c0 tempest-ServerRescueNegativeTestJSON-1038487610 None] casted to osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 Apr 16 15:08:36 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-1eeb63e1-86a3-49a5-a252-5ea7f9c625c0 tempest-ServerRescueNegativeTestJSON-1038487610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6dac7a8d-9bd5-4e83-8851-4d522b7c82c8 1073741824 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:08:36 devstack sudo[87027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6dac7a8d-9bd5-4e83-8851-4d522b7c82c8 1073741824 Apr 16 15:08:36 devstack sudo[87027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:08:36 devstack sudo[87022]: pam_unix(sudo:session): session closed for user root Apr 16 15:08:36 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-59ad1938-2000-45cb-aea6-9a0599dde99d tempest-VolumesActionsTest-1145584555 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-d3e676b8-99fb-4ea4-96b5-8fc29fcd9e90" returned: 0 in 1.245s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:08:36 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-59ad1938-2000-45cb-aea6-9a0599dde99d tempest-VolumesActionsTest-1145584555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-d3e676b8-99fb-4ea4-96b5-8fc29fcd9e90 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:08:36 devstack sudo[87032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-d3e676b8-99fb-4ea4-96b5-8fc29fcd9e90 Apr 16 15:08:36 devstack sudo[87032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:08:37 devstack sudo[87032]: pam_unix(sudo:session): session closed for user root Apr 16 15:08:37 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-59ad1938-2000-45cb-aea6-9a0599dde99d tempest-VolumesActionsTest-1145584555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-d3e676b8-99fb-4ea4-96b5-8fc29fcd9e90" returned: 0 in 0.759s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:08:37 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-59ad1938-2000-45cb-aea6-9a0599dde99d tempest-VolumesActionsTest-1145584555 None] Lock "cinder-quobyte-d3e676b8-99fb-4ea4-96b5-8fc29fcd9e90" released by "delete_volume" :: held 2.081s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:08:37 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-59ad1938-2000-45cb-aea6-9a0599dde99d tempest-VolumesActionsTest-1145584555 None] Created reservations ['67c14016-dfd7-41f7-ab4e-f84b5ddcd9f0', 'a9222b73-d328-4fe9-9912-274b75b49fd9', '28e21b5e-86f4-4c91-8f68-7da4801f27de', '9b4b8c6e-eed1-48d9-97d7-5463ced52239'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:08:37 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-59ad1938-2000-45cb-aea6-9a0599dde99d tempest-VolumesActionsTest-1145584555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:08:37 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-59ad1938-2000-45cb-aea6-9a0599dde99d tempest-VolumesActionsTest-1145584555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:08:37 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-59ad1938-2000-45cb-aea6-9a0599dde99d tempest-VolumesActionsTest-1145584555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:08:37 devstack sudo[87027]: pam_unix(sudo:session): session closed for user root Apr 16 15:08:37 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-59ad1938-2000-45cb-aea6-9a0599dde99d tempest-VolumesActionsTest-1145584555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:08:37 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-59ad1938-2000-45cb-aea6-9a0599dde99d tempest-VolumesActionsTest-1145584555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:08:37 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-59ad1938-2000-45cb-aea6-9a0599dde99d tempest-VolumesActionsTest-1145584555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:08:37 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-1eeb63e1-86a3-49a5-a252-5ea7f9c625c0 tempest-ServerRescueNegativeTestJSON-1038487610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6dac7a8d-9bd5-4e83-8851-4d522b7c82c8 1073741824" returned: 0 in 1.172s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:08:37 devstack sudo[87039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:08:37 devstack sudo[87039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:08:37 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-1eeb63e1-86a3-49a5-a252-5ea7f9c625c0 tempest-ServerRescueNegativeTestJSON-1038487610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6dac7a8d-9bd5-4e83-8851-4d522b7c82c8 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:08:37 devstack sudo[87041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6dac7a8d-9bd5-4e83-8851-4d522b7c82c8 Apr 16 15:08:37 devstack sudo[87041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:08:38 devstack sudo[87041]: pam_unix(sudo:session): session closed for user root Apr 16 15:08:38 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-1eeb63e1-86a3-49a5-a252-5ea7f9c625c0 tempest-ServerRescueNegativeTestJSON-1038487610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6dac7a8d-9bd5-4e83-8851-4d522b7c82c8" returned: 0 in 0.597s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:08:38 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-1eeb63e1-86a3-49a5-a252-5ea7f9c625c0 tempest-ServerRescueNegativeTestJSON-1038487610 None] <== create_volume: return (1826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'} {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 15:08:38 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-1eeb63e1-86a3-49a5-a252-5ea7f9c625c0 tempest-ServerRescueNegativeTestJSON-1038487610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.829s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:08:38 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-1eeb63e1-86a3-49a5-a252-5ea7f9c625c0 tempest-ServerRescueNegativeTestJSON-1038487610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6b1c2ed-0db2-4619-a858-59f0b7d7ba64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6dac7a8d-9bd5-4e83-8851-4d522b7c82c8', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:08:38 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-1eeb63e1-86a3-49a5-a252-5ea7f9c625c0 tempest-ServerRescueNegativeTestJSON-1038487610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac245728-67a1-4cd3-8fcf-93d8941380d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:08:38 devstack sudo[87039]: pam_unix(sudo:session): session closed for user root Apr 16 15:08:38 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-1eeb63e1-86a3-49a5-a252-5ea7f9c625c0 tempest-ServerRescueNegativeTestJSON-1038487610 None] Volume volume-6dac7a8d-9bd5-4e83-8851-4d522b7c82c8 (6dac7a8d-9bd5-4e83-8851-4d522b7c82c8): created successfully Apr 16 15:08:38 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-1eeb63e1-86a3-49a5-a252-5ea7f9c625c0 tempest-ServerRescueNegativeTestJSON-1038487610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac245728-67a1-4cd3-8fcf-93d8941380d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:08:38 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-1eeb63e1-86a3-49a5-a252-5ea7f9c625c0 tempest-ServerRescueNegativeTestJSON-1038487610 None] Flow 'volume_create_manager' (c099be6a-18ac-4141-8bf4-a6d1ea7b725e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:08:38 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-59ad1938-2000-45cb-aea6-9a0599dde99d tempest-VolumesActionsTest-1145584555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.721s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:08:38 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-59ad1938-2000-45cb-aea6-9a0599dde99d tempest-VolumesActionsTest-1145584555 None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:08:38 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-1eeb63e1-86a3-49a5-a252-5ea7f9c625c0 tempest-ServerRescueNegativeTestJSON-1038487610 None] Created volume successfully. Apr 16 15:08:38 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-59ad1938-2000-45cb-aea6-9a0599dde99d tempest-VolumesActionsTest-1145584555 None] Deleted volume successfully. Apr 16 15:08:38 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-59ad1938-2000-45cb-aea6-9a0599dde99d tempest-VolumesActionsTest-1145584555 None] Lock "cinder-d3e676b8-99fb-4ea4-96b5-8fc29fcd9e90-delete_volume" released by "delete_volume" :: held 3.099s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:08:38 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a85d176-da40-4e79-840d-5e99e9f4bd45 tempest-VolumesActionsTest-1011119310 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82756) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 15:08:38 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-1a85d176-da40-4e79-840d-5e99e9f4bd45 tempest-VolumesActionsTest-1011119310 None] Flow 'volume_create_manager' (0545424c-6895-4a4a-9915-1837b1fd88c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:08:38 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-1a85d176-da40-4e79-840d-5e99e9f4bd45 tempest-VolumesActionsTest-1011119310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf2df025-8f7e-4df8-abfe-400b52bc5487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:08:38 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-1a85d176-da40-4e79-840d-5e99e9f4bd45 tempest-VolumesActionsTest-1011119310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf2df025-8f7e-4df8-abfe-400b52bc5487) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:08:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-75366786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=029eb179-5828-4adb-93c2-c8bbaef36099,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f62108dfb2544358974111915853b3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:08:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:08:39Z,use_quota=True,user_id='d5b67ea45a1d45bb8b7c8d44919cd8fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:08:38 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-1a85d176-da40-4e79-840d-5e99e9f4bd45 tempest-VolumesActionsTest-1011119310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7d89638-06fa-4593-a5f2-749d1eed8276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:08:38 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-1a85d176-da40-4e79-840d-5e99e9f4bd45 tempest-VolumesActionsTest-1011119310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7d89638-06fa-4593-a5f2-749d1eed8276) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:08:38 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-1a85d176-da40-4e79-840d-5e99e9f4bd45 tempest-VolumesActionsTest-1011119310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00796d18-e387-4b7d-8fe3-d7ba10ae56d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:08:38 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-1a85d176-da40-4e79-840d-5e99e9f4bd45 tempest-VolumesActionsTest-1011119310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00796d18-e387-4b7d-8fe3-d7ba10ae56d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '029eb179-5828-4adb-93c2-c8bbaef36099', 'volume_name': 'volume-029eb179-5828-4adb-93c2-c8bbaef36099', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:08:38 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-1a85d176-da40-4e79-840d-5e99e9f4bd45 tempest-VolumesActionsTest-1011119310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d8b4b25-a16a-4069-af51-82f3b408dbd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:08:38 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-1a85d176-da40-4e79-840d-5e99e9f4bd45 tempest-VolumesActionsTest-1011119310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d8b4b25-a16a-4069-af51-82f3b408dbd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:08:38 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-1a85d176-da40-4e79-840d-5e99e9f4bd45 tempest-VolumesActionsTest-1011119310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75132ac4-2f16-4a56-ac29-2362c38bfc2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:08:38 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-1a85d176-da40-4e79-840d-5e99e9f4bd45 tempest-VolumesActionsTest-1011119310 None] Volume 029eb179-5828-4adb-93c2-c8bbaef36099: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-029eb179-5828-4adb-93c2-c8bbaef36099', 'volume_size': 1} Apr 16 15:08:38 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-1a85d176-da40-4e79-840d-5e99e9f4bd45 tempest-VolumesActionsTest-1011119310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:08:38 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-1a85d176-da40-4e79-840d-5e99e9f4bd45 tempest-VolumesActionsTest-1011119310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:08:38 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-1a85d176-da40-4e79-840d-5e99e9f4bd45 tempest-VolumesActionsTest-1011119310 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:08:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-75366786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=029eb179-5828-4adb-93c2-c8bbaef36099,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f62108dfb2544358974111915853b3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:08:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:08:39Z,use_quota=True,user_id='d5b67ea45a1d45bb8b7c8d44919cd8fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)}" {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 15:08:38 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-1a85d176-da40-4e79-840d-5e99e9f4bd45 tempest-VolumesActionsTest-1011119310 None] Creating volume 029eb179-5828-4adb-93c2-c8bbaef36099 {{(pid=82756) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 15:08:38 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-1a85d176-da40-4e79-840d-5e99e9f4bd45 tempest-VolumesActionsTest-1011119310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:08:38 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-1a85d176-da40-4e79-840d-5e99e9f4bd45 tempest-VolumesActionsTest-1011119310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:08:38 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-1a85d176-da40-4e79-840d-5e99e9f4bd45 tempest-VolumesActionsTest-1011119310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:08:38 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-1a85d176-da40-4e79-840d-5e99e9f4bd45 tempest-VolumesActionsTest-1011119310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:08:38 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-1a85d176-da40-4e79-840d-5e99e9f4bd45 tempest-VolumesActionsTest-1011119310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:08:38 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-1a85d176-da40-4e79-840d-5e99e9f4bd45 tempest-VolumesActionsTest-1011119310 None] Selected osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 as target Quobyte volume. {{(pid=82756) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 15:08:38 devstack cinder-volume[82756]: INFO cinder.volume.drivers.remotefs [None req-1a85d176-da40-4e79-840d-5e99e9f4bd45 tempest-VolumesActionsTest-1011119310 None] casted to osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 Apr 16 15:08:38 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-1a85d176-da40-4e79-840d-5e99e9f4bd45 tempest-VolumesActionsTest-1011119310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-029eb179-5828-4adb-93c2-c8bbaef36099 1073741824 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:08:38 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-9be20c8f-e3cb-4e2d-8248-10e6efe604c6 tempest-VolumesNegativeTest-1876418517 None] Acquiring lock "cinder-76053374-2c15-46be-ad16-8f6bed0df272-delete_volume" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:08:38 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-9be20c8f-e3cb-4e2d-8248-10e6efe604c6 tempest-VolumesNegativeTest-1876418517 None] Lock "cinder-76053374-2c15-46be-ad16-8f6bed0df272-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:08:38 devstack sudo[87046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-029eb179-5828-4adb-93c2-c8bbaef36099 1073741824 Apr 16 15:08:38 devstack sudo[87046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:08:39 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-9be20c8f-e3cb-4e2d-8248-10e6efe604c6 tempest-VolumesNegativeTest-1876418517 None] Acquiring lock "cinder-quobyte-76053374-2c15-46be-ad16-8f6bed0df272" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:08:39 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-9be20c8f-e3cb-4e2d-8248-10e6efe604c6 tempest-VolumesNegativeTest-1876418517 None] Lock "cinder-quobyte-76053374-2c15-46be-ad16-8f6bed0df272" acquired by "delete_volume" :: waited 0.020s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:08:39 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f1d2773-98c6-48fb-a8d4-54c04e7342af]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:08:39 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-9be20c8f-e3cb-4e2d-8248-10e6efe604c6 tempest-VolumesNegativeTest-1876418517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-76053374-2c15-46be-ad16-8f6bed0df272 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:08:39 devstack sudo[87048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-76053374-2c15-46be-ad16-8f6bed0df272 Apr 16 15:08:39 devstack sudo[87048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:08:39 devstack sudo[87048]: pam_unix(sudo:session): session closed for user root Apr 16 15:08:39 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-9be20c8f-e3cb-4e2d-8248-10e6efe604c6 tempest-VolumesNegativeTest-1876418517 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-76053374-2c15-46be-ad16-8f6bed0df272" returned: 0 in 0.650s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:08:39 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-9be20c8f-e3cb-4e2d-8248-10e6efe604c6 tempest-VolumesNegativeTest-1876418517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-76053374-2c15-46be-ad16-8f6bed0df272 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:08:39 devstack sudo[87056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-76053374-2c15-46be-ad16-8f6bed0df272 Apr 16 15:08:39 devstack sudo[87056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:08:39 devstack sudo[87046]: pam_unix(sudo:session): session closed for user root Apr 16 15:08:39 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-1a85d176-da40-4e79-840d-5e99e9f4bd45 tempest-VolumesActionsTest-1011119310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-029eb179-5828-4adb-93c2-c8bbaef36099 1073741824" returned: 0 in 0.978s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:08:40 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-1a85d176-da40-4e79-840d-5e99e9f4bd45 tempest-VolumesActionsTest-1011119310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-029eb179-5828-4adb-93c2-c8bbaef36099 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:08:40 devstack sudo[87058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-029eb179-5828-4adb-93c2-c8bbaef36099 Apr 16 15:08:40 devstack sudo[87058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:08:40 devstack sudo[87056]: pam_unix(sudo:session): session closed for user root Apr 16 15:08:40 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-9be20c8f-e3cb-4e2d-8248-10e6efe604c6 tempest-VolumesNegativeTest-1876418517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-76053374-2c15-46be-ad16-8f6bed0df272" returned: 0 in 0.966s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:08:40 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-9be20c8f-e3cb-4e2d-8248-10e6efe604c6 tempest-VolumesNegativeTest-1876418517 None] Lock "cinder-quobyte-76053374-2c15-46be-ad16-8f6bed0df272" released by "delete_volume" :: held 1.646s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:08:40 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-9be20c8f-e3cb-4e2d-8248-10e6efe604c6 tempest-VolumesNegativeTest-1876418517 None] Created reservations ['468412b9-6b43-4030-93b1-42616be7e32c', 'a762d634-4d1b-4b41-b789-4f8beb568c61', 'ab036ef9-5745-41c2-ab1d-2c5be55ba559', '5f1ff17e-0030-4dd3-ab6a-b712643a3b31'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:08:40 devstack sudo[87058]: pam_unix(sudo:session): session closed for user root Apr 16 15:08:40 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-1a85d176-da40-4e79-840d-5e99e9f4bd45 tempest-VolumesActionsTest-1011119310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-029eb179-5828-4adb-93c2-c8bbaef36099" returned: 0 in 0.746s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:08:40 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-1a85d176-da40-4e79-840d-5e99e9f4bd45 tempest-VolumesActionsTest-1011119310 None] <== create_volume: return (1826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'} {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 15:08:40 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-1a85d176-da40-4e79-840d-5e99e9f4bd45 tempest-VolumesActionsTest-1011119310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.829s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:08:40 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-1a85d176-da40-4e79-840d-5e99e9f4bd45 tempest-VolumesActionsTest-1011119310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75132ac4-2f16-4a56-ac29-2362c38bfc2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-029eb179-5828-4adb-93c2-c8bbaef36099', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:08:40 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-1a85d176-da40-4e79-840d-5e99e9f4bd45 tempest-VolumesActionsTest-1011119310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b67bc91-26cf-462c-acc7-52a4e2d78896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:08:40 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-1a85d176-da40-4e79-840d-5e99e9f4bd45 tempest-VolumesActionsTest-1011119310 None] Volume volume-029eb179-5828-4adb-93c2-c8bbaef36099 (029eb179-5828-4adb-93c2-c8bbaef36099): created successfully Apr 16 15:08:40 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-1a85d176-da40-4e79-840d-5e99e9f4bd45 tempest-VolumesActionsTest-1011119310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b67bc91-26cf-462c-acc7-52a4e2d78896) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:08:40 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-1a85d176-da40-4e79-840d-5e99e9f4bd45 tempest-VolumesActionsTest-1011119310 None] Flow 'volume_create_manager' (0545424c-6895-4a4a-9915-1837b1fd88c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:08:40 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-1a85d176-da40-4e79-840d-5e99e9f4bd45 tempest-VolumesActionsTest-1011119310 None] Created volume successfully. Apr 16 15:08:40 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-9be20c8f-e3cb-4e2d-8248-10e6efe604c6 tempest-VolumesNegativeTest-1876418517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:08:40 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-9be20c8f-e3cb-4e2d-8248-10e6efe604c6 tempest-VolumesNegativeTest-1876418517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:08:40 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-9be20c8f-e3cb-4e2d-8248-10e6efe604c6 tempest-VolumesNegativeTest-1876418517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:08:40 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-9be20c8f-e3cb-4e2d-8248-10e6efe604c6 tempest-VolumesNegativeTest-1876418517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:08:40 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-9be20c8f-e3cb-4e2d-8248-10e6efe604c6 tempest-VolumesNegativeTest-1876418517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:08:40 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-9be20c8f-e3cb-4e2d-8248-10e6efe604c6 tempest-VolumesNegativeTest-1876418517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:08:40 devstack sudo[87063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:08:40 devstack sudo[87063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:08:42 devstack sudo[87063]: pam_unix(sudo:session): session closed for user root Apr 16 15:08:42 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-9be20c8f-e3cb-4e2d-8248-10e6efe604c6 tempest-VolumesNegativeTest-1876418517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 1.157s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:08:42 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-9be20c8f-e3cb-4e2d-8248-10e6efe604c6 tempest-VolumesNegativeTest-1876418517 None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:08:42 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-9be20c8f-e3cb-4e2d-8248-10e6efe604c6 tempest-VolumesNegativeTest-1876418517 None] Deleted volume successfully. Apr 16 15:08:42 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-9be20c8f-e3cb-4e2d-8248-10e6efe604c6 tempest-VolumesNegativeTest-1876418517 None] Lock "cinder-76053374-2c15-46be-ad16-8f6bed0df272-delete_volume" released by "delete_volume" :: held 3.073s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:08:42 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-436959c1-784c-46a5-b4a4-d6aec7470946 tempest-VolumesActionsTest-1011119310 None] Acquiring lock "cinder-029eb179-5828-4adb-93c2-c8bbaef36099-delete_volume" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:08:42 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-436959c1-784c-46a5-b4a4-d6aec7470946 tempest-VolumesActionsTest-1011119310 None] Lock "cinder-029eb179-5828-4adb-93c2-c8bbaef36099-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:08:42 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-436959c1-784c-46a5-b4a4-d6aec7470946 tempest-VolumesActionsTest-1011119310 None] Acquiring lock "cinder-quobyte-029eb179-5828-4adb-93c2-c8bbaef36099" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:08:42 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-436959c1-784c-46a5-b4a4-d6aec7470946 tempest-VolumesActionsTest-1011119310 None] Lock "cinder-quobyte-029eb179-5828-4adb-93c2-c8bbaef36099" acquired by "delete_volume" :: waited 0.008s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:08:42 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c74bc1f-f816-49b4-875e-31a1c476b364]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:08:42 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-436959c1-784c-46a5-b4a4-d6aec7470946 tempest-VolumesActionsTest-1011119310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-029eb179-5828-4adb-93c2-c8bbaef36099 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:08:42 devstack sudo[87072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-029eb179-5828-4adb-93c2-c8bbaef36099 Apr 16 15:08:42 devstack sudo[87072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:08:43 devstack sudo[87072]: pam_unix(sudo:session): session closed for user root Apr 16 15:08:43 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-436959c1-784c-46a5-b4a4-d6aec7470946 tempest-VolumesActionsTest-1011119310 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-029eb179-5828-4adb-93c2-c8bbaef36099" returned: 0 in 1.106s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:08:43 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-436959c1-784c-46a5-b4a4-d6aec7470946 tempest-VolumesActionsTest-1011119310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-029eb179-5828-4adb-93c2-c8bbaef36099 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:08:43 devstack sudo[87106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-029eb179-5828-4adb-93c2-c8bbaef36099 Apr 16 15:08:43 devstack sudo[87106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:08:44 devstack sudo[87106]: pam_unix(sudo:session): session closed for user root Apr 16 15:08:44 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-436959c1-784c-46a5-b4a4-d6aec7470946 tempest-VolumesActionsTest-1011119310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-029eb179-5828-4adb-93c2-c8bbaef36099" returned: 0 in 0.749s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:08:44 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-436959c1-784c-46a5-b4a4-d6aec7470946 tempest-VolumesActionsTest-1011119310 None] Lock "cinder-quobyte-029eb179-5828-4adb-93c2-c8bbaef36099" released by "delete_volume" :: held 1.892s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:08:44 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-436959c1-784c-46a5-b4a4-d6aec7470946 tempest-VolumesActionsTest-1011119310 None] Created reservations ['a111aa48-5598-4feb-a539-daefb815ef38', '8d015dd3-41df-4993-801c-958885324305', '304349de-0f60-4f4d-9036-3d1acf171c1b', 'cc752aba-1ba4-4ed2-bb61-14502658be0e'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:08:44 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-436959c1-784c-46a5-b4a4-d6aec7470946 tempest-VolumesActionsTest-1011119310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:08:44 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-436959c1-784c-46a5-b4a4-d6aec7470946 tempest-VolumesActionsTest-1011119310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:08:44 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-436959c1-784c-46a5-b4a4-d6aec7470946 tempest-VolumesActionsTest-1011119310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:08:44 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-436959c1-784c-46a5-b4a4-d6aec7470946 tempest-VolumesActionsTest-1011119310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:08:44 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-436959c1-784c-46a5-b4a4-d6aec7470946 tempest-VolumesActionsTest-1011119310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:08:44 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-436959c1-784c-46a5-b4a4-d6aec7470946 tempest-VolumesActionsTest-1011119310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:08:44 devstack sudo[87123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:08:44 devstack sudo[87123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:08:44 devstack sudo[87123]: pam_unix(sudo:session): session closed for user root Apr 16 15:08:44 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-436959c1-784c-46a5-b4a4-d6aec7470946 tempest-VolumesActionsTest-1011119310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.541s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:08:44 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-436959c1-784c-46a5-b4a4-d6aec7470946 tempest-VolumesActionsTest-1011119310 None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:08:44 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-436959c1-784c-46a5-b4a4-d6aec7470946 tempest-VolumesActionsTest-1011119310 None] Deleted volume successfully. Apr 16 15:08:44 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-436959c1-784c-46a5-b4a4-d6aec7470946 tempest-VolumesActionsTest-1011119310 None] Lock "cinder-029eb179-5828-4adb-93c2-c8bbaef36099-delete_volume" released by "delete_volume" :: held 2.627s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:08:51 devstack cinder-volume[82756]: DEBUG oslo_service.periodic_task [None req-9570f02d-5ef9-412b-993f-520a9e5bfa81 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82756) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 16 15:08:51 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-9570f02d-5ef9-412b-993f-520a9e5bfa81 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:08:51 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-9570f02d-5ef9-412b-993f-520a9e5bfa81 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:08:51 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-9570f02d-5ef9-412b-993f-520a9e5bfa81 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:08:51 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-9570f02d-5ef9-412b-993f-520a9e5bfa81 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:08:51 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-9570f02d-5ef9-412b-993f-520a9e5bfa81 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:08:51 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-9570f02d-5ef9-412b-993f-520a9e5bfa81 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:08:51 devstack sudo[87161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:08:51 devstack sudo[87161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:08:52 devstack sudo[87161]: pam_unix(sudo:session): session closed for user root Apr 16 15:08:52 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-9570f02d-5ef9-412b-993f-520a9e5bfa81 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 1.150s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:08:52 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-9570f02d-5ef9-412b-993f-520a9e5bfa81 None None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:08:53 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0a76cd6-26bb-4e29-a420-5b5548a87a16 tempest-VolumesSnapshotTestJSON-1827115803 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82756) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 15:08:53 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-d0a76cd6-26bb-4e29-a420-5b5548a87a16 tempest-VolumesSnapshotTestJSON-1827115803 None] Flow 'volume_create_manager' (fc0704a1-5293-4621-a5e6-16066d1dfa4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:08:53 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-d0a76cd6-26bb-4e29-a420-5b5548a87a16 tempest-VolumesSnapshotTestJSON-1827115803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0546dfcc-cc66-47ec-b8c3-3b579218e9c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:08:53 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-d0a76cd6-26bb-4e29-a420-5b5548a87a16 tempest-VolumesSnapshotTestJSON-1827115803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0546dfcc-cc66-47ec-b8c3-3b579218e9c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:08:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-42834789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70b5beb8-b235-468e-a328-da05baf30faf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e188a76e5efd467e8c860aa308f861b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:08:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:08:53Z,use_quota=True,user_id='0c5eb9cbc4334877925458d81eec542d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:08:53 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-d0a76cd6-26bb-4e29-a420-5b5548a87a16 tempest-VolumesSnapshotTestJSON-1827115803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60a2a8fe-9b48-460f-b7d4-8291a1247d86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:08:53 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-d0a76cd6-26bb-4e29-a420-5b5548a87a16 tempest-VolumesSnapshotTestJSON-1827115803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60a2a8fe-9b48-460f-b7d4-8291a1247d86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:08:53 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-d0a76cd6-26bb-4e29-a420-5b5548a87a16 tempest-VolumesSnapshotTestJSON-1827115803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (429bed18-d183-4213-aa8b-0670d68a5693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:08:53 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-d0a76cd6-26bb-4e29-a420-5b5548a87a16 tempest-VolumesSnapshotTestJSON-1827115803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (429bed18-d183-4213-aa8b-0670d68a5693) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70b5beb8-b235-468e-a328-da05baf30faf', 'volume_name': 'volume-70b5beb8-b235-468e-a328-da05baf30faf', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:08:53 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-d0a76cd6-26bb-4e29-a420-5b5548a87a16 tempest-VolumesSnapshotTestJSON-1827115803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11a06c5b-c40a-4067-9528-ccb91d0c5e75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:08:53 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-d0a76cd6-26bb-4e29-a420-5b5548a87a16 tempest-VolumesSnapshotTestJSON-1827115803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11a06c5b-c40a-4067-9528-ccb91d0c5e75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:08:53 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-d0a76cd6-26bb-4e29-a420-5b5548a87a16 tempest-VolumesSnapshotTestJSON-1827115803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51177e0c-74a2-4657-9981-015e4effbf85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:08:53 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-d0a76cd6-26bb-4e29-a420-5b5548a87a16 tempest-VolumesSnapshotTestJSON-1827115803 None] Volume 70b5beb8-b235-468e-a328-da05baf30faf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70b5beb8-b235-468e-a328-da05baf30faf', 'volume_size': 1} Apr 16 15:08:53 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-d0a76cd6-26bb-4e29-a420-5b5548a87a16 tempest-VolumesSnapshotTestJSON-1827115803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:08:53 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-d0a76cd6-26bb-4e29-a420-5b5548a87a16 tempest-VolumesSnapshotTestJSON-1827115803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:08:53 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-d0a76cd6-26bb-4e29-a420-5b5548a87a16 tempest-VolumesSnapshotTestJSON-1827115803 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:08:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-42834789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70b5beb8-b235-468e-a328-da05baf30faf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e188a76e5efd467e8c860aa308f861b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:08:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:08:53Z,use_quota=True,user_id='0c5eb9cbc4334877925458d81eec542d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)}" {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 15:08:53 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-d0a76cd6-26bb-4e29-a420-5b5548a87a16 tempest-VolumesSnapshotTestJSON-1827115803 None] Creating volume 70b5beb8-b235-468e-a328-da05baf30faf {{(pid=82756) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 15:08:53 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-d0a76cd6-26bb-4e29-a420-5b5548a87a16 tempest-VolumesSnapshotTestJSON-1827115803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:08:53 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-d0a76cd6-26bb-4e29-a420-5b5548a87a16 tempest-VolumesSnapshotTestJSON-1827115803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:08:53 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-d0a76cd6-26bb-4e29-a420-5b5548a87a16 tempest-VolumesSnapshotTestJSON-1827115803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:08:53 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-d0a76cd6-26bb-4e29-a420-5b5548a87a16 tempest-VolumesSnapshotTestJSON-1827115803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:08:53 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-d0a76cd6-26bb-4e29-a420-5b5548a87a16 tempest-VolumesSnapshotTestJSON-1827115803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:08:53 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-d0a76cd6-26bb-4e29-a420-5b5548a87a16 tempest-VolumesSnapshotTestJSON-1827115803 None] Selected osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 as target Quobyte volume. {{(pid=82756) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 15:08:53 devstack cinder-volume[82756]: INFO cinder.volume.drivers.remotefs [None req-d0a76cd6-26bb-4e29-a420-5b5548a87a16 tempest-VolumesSnapshotTestJSON-1827115803 None] casted to osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 Apr 16 15:08:53 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-d0a76cd6-26bb-4e29-a420-5b5548a87a16 tempest-VolumesSnapshotTestJSON-1827115803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-70b5beb8-b235-468e-a328-da05baf30faf 1073741824 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:08:53 devstack sudo[87165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-70b5beb8-b235-468e-a328-da05baf30faf 1073741824 Apr 16 15:08:53 devstack sudo[87165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:08:54 devstack sudo[87165]: pam_unix(sudo:session): session closed for user root Apr 16 15:08:54 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-d0a76cd6-26bb-4e29-a420-5b5548a87a16 tempest-VolumesSnapshotTestJSON-1827115803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-70b5beb8-b235-468e-a328-da05baf30faf 1073741824" returned: 0 in 0.961s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:08:54 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-d0a76cd6-26bb-4e29-a420-5b5548a87a16 tempest-VolumesSnapshotTestJSON-1827115803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-70b5beb8-b235-468e-a328-da05baf30faf {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:08:54 devstack sudo[87206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-70b5beb8-b235-468e-a328-da05baf30faf Apr 16 15:08:54 devstack sudo[87206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:08:55 devstack sudo[87206]: pam_unix(sudo:session): session closed for user root Apr 16 15:08:55 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-d0a76cd6-26bb-4e29-a420-5b5548a87a16 tempest-VolumesSnapshotTestJSON-1827115803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-70b5beb8-b235-468e-a328-da05baf30faf" returned: 0 in 0.853s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:08:55 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-d0a76cd6-26bb-4e29-a420-5b5548a87a16 tempest-VolumesSnapshotTestJSON-1827115803 None] <== create_volume: return (1851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'} {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 15:08:55 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-d0a76cd6-26bb-4e29-a420-5b5548a87a16 tempest-VolumesSnapshotTestJSON-1827115803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.854s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:08:55 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-d0a76cd6-26bb-4e29-a420-5b5548a87a16 tempest-VolumesSnapshotTestJSON-1827115803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51177e0c-74a2-4657-9981-015e4effbf85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70b5beb8-b235-468e-a328-da05baf30faf', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:08:55 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-d0a76cd6-26bb-4e29-a420-5b5548a87a16 tempest-VolumesSnapshotTestJSON-1827115803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c08775c-c710-44ca-acdc-0b4fead844fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:08:55 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-d0a76cd6-26bb-4e29-a420-5b5548a87a16 tempest-VolumesSnapshotTestJSON-1827115803 None] Volume volume-70b5beb8-b235-468e-a328-da05baf30faf (70b5beb8-b235-468e-a328-da05baf30faf): created successfully Apr 16 15:08:55 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-d0a76cd6-26bb-4e29-a420-5b5548a87a16 tempest-VolumesSnapshotTestJSON-1827115803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c08775c-c710-44ca-acdc-0b4fead844fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:08:55 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-d0a76cd6-26bb-4e29-a420-5b5548a87a16 tempest-VolumesSnapshotTestJSON-1827115803 None] Flow 'volume_create_manager' (fc0704a1-5293-4621-a5e6-16066d1dfa4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:08:55 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-d0a76cd6-26bb-4e29-a420-5b5548a87a16 tempest-VolumesSnapshotTestJSON-1827115803 None] Created volume successfully. Apr 16 15:08:55 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-c008b9e0-986f-414a-9ae5-92833ecb6c89 tempest-VolumesSnapshotTestJSON-1827115803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:08:55 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-c008b9e0-986f-414a-9ae5-92833ecb6c89 tempest-VolumesSnapshotTestJSON-1827115803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:08:55 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-c008b9e0-986f-414a-9ae5-92833ecb6c89 tempest-VolumesSnapshotTestJSON-1827115803 None] Creating offline snapshot 1b3b0ba8-05fc-4f84-845e-0d2726e47410 of volume 70b5beb8-b235-468e-a328-da05baf30faf {{(pid=82756) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 16 15:08:55 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed90fbb2-f2d1-4eef-a29f-80dff152cd01]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:08:55 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-c008b9e0-986f-414a-9ae5-92833ecb6c89 tempest-VolumesSnapshotTestJSON-1827115803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-70b5beb8-b235-468e-a328-da05baf30faf {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:08:56 devstack sudo[87263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-70b5beb8-b235-468e-a328-da05baf30faf Apr 16 15:08:56 devstack sudo[87263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:08:56 devstack sudo[87263]: pam_unix(sudo:session): session closed for user root Apr 16 15:08:56 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-c008b9e0-986f-414a-9ae5-92833ecb6c89 tempest-VolumesSnapshotTestJSON-1827115803 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-70b5beb8-b235-468e-a328-da05baf30faf" returned: 0 in 0.855s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:08:56 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-c008b9e0-986f-414a-9ae5-92833ecb6c89 tempest-VolumesSnapshotTestJSON-1827115803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-70b5beb8-b235-468e-a328-da05baf30faf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-70b5beb8-b235-468e-a328-da05baf30faf.1b3b0ba8-05fc-4f84-845e-0d2726e47410 1G {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:08:56 devstack sudo[87270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-70b5beb8-b235-468e-a328-da05baf30faf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-70b5beb8-b235-468e-a328-da05baf30faf.1b3b0ba8-05fc-4f84-845e-0d2726e47410 1G Apr 16 15:08:56 devstack sudo[87270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:08:56 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-d1cd8847-1dc4-43f0-9ac0-a68abd292654 tempest-ServerRescueNegativeTestJSON-1038487610 None] Acquiring lock "cinder-6dac7a8d-9bd5-4e83-8851-4d522b7c82c8-delete_volume" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:08:56 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-d1cd8847-1dc4-43f0-9ac0-a68abd292654 tempest-ServerRescueNegativeTestJSON-1038487610 None] Lock "cinder-6dac7a8d-9bd5-4e83-8851-4d522b7c82c8-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:08:57 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-d1cd8847-1dc4-43f0-9ac0-a68abd292654 tempest-ServerRescueNegativeTestJSON-1038487610 None] Acquiring lock "cinder-quobyte-6dac7a8d-9bd5-4e83-8851-4d522b7c82c8" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:08:57 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-d1cd8847-1dc4-43f0-9ac0-a68abd292654 tempest-ServerRescueNegativeTestJSON-1038487610 None] Lock "cinder-quobyte-6dac7a8d-9bd5-4e83-8851-4d522b7c82c8" acquired by "delete_volume" :: waited 0.022s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:08:57 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b921623-009a-4c10-bda5-54d29658c61e]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:08:57 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-d1cd8847-1dc4-43f0-9ac0-a68abd292654 tempest-ServerRescueNegativeTestJSON-1038487610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6dac7a8d-9bd5-4e83-8851-4d522b7c82c8 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:08:57 devstack sudo[87272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6dac7a8d-9bd5-4e83-8851-4d522b7c82c8 Apr 16 15:08:57 devstack sudo[87272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:08:57 devstack sudo[87270]: pam_unix(sudo:session): session closed for user root Apr 16 15:08:57 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-c008b9e0-986f-414a-9ae5-92833ecb6c89 tempest-VolumesSnapshotTestJSON-1827115803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-70b5beb8-b235-468e-a328-da05baf30faf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-70b5beb8-b235-468e-a328-da05baf30faf.1b3b0ba8-05fc-4f84-845e-0d2726e47410 1G" returned: 0 in 1.075s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:08:57 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-c008b9e0-986f-414a-9ae5-92833ecb6c89 tempest-VolumesSnapshotTestJSON-1827115803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70b5beb8-b235-468e-a328-da05baf30faf -F qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-70b5beb8-b235-468e-a328-da05baf30faf.1b3b0ba8-05fc-4f84-845e-0d2726e47410 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:08:57 devstack sudo[87280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70b5beb8-b235-468e-a328-da05baf30faf -F qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-70b5beb8-b235-468e-a328-da05baf30faf.1b3b0ba8-05fc-4f84-845e-0d2726e47410 Apr 16 15:08:57 devstack sudo[87280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:08:57 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e56a2a4-9be4-42c3-a047-e5488ebea852 tempest-AbsoluteLimitsTests-1126615852 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82756) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 15:08:57 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-0e56a2a4-9be4-42c3-a047-e5488ebea852 tempest-AbsoluteLimitsTests-1126615852 None] Flow 'volume_create_manager' (dd547944-9826-49af-9b5b-45c1d76b7dc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:08:57 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-0e56a2a4-9be4-42c3-a047-e5488ebea852 tempest-AbsoluteLimitsTests-1126615852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (905be41a-de8b-4360-827a-ad7df2e6f7b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:08:58 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-0e56a2a4-9be4-42c3-a047-e5488ebea852 tempest-AbsoluteLimitsTests-1126615852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (905be41a-de8b-4360-827a-ad7df2e6f7b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:08:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1292250074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bf8d5fd-0884-4ea1-a8a1-451ea565f548,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3598a6557c3e44e08e09ffb35e252308',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:08:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:08:58Z,use_quota=True,user_id='298cd5db4960463b8ac1980140d3bf1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:08:58 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-0e56a2a4-9be4-42c3-a047-e5488ebea852 tempest-AbsoluteLimitsTests-1126615852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7d059e7-7509-4508-ba1e-cbf91f9d8d05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:08:58 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-0e56a2a4-9be4-42c3-a047-e5488ebea852 tempest-AbsoluteLimitsTests-1126615852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7d059e7-7509-4508-ba1e-cbf91f9d8d05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:08:58 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-0e56a2a4-9be4-42c3-a047-e5488ebea852 tempest-AbsoluteLimitsTests-1126615852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (745a170c-1580-4d92-be1b-a8096581e073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:08:58 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-0e56a2a4-9be4-42c3-a047-e5488ebea852 tempest-AbsoluteLimitsTests-1126615852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (745a170c-1580-4d92-be1b-a8096581e073) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bf8d5fd-0884-4ea1-a8a1-451ea565f548', 'volume_name': 'volume-3bf8d5fd-0884-4ea1-a8a1-451ea565f548', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:08:58 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-0e56a2a4-9be4-42c3-a047-e5488ebea852 tempest-AbsoluteLimitsTests-1126615852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a27c6370-da4f-46b8-bfb5-06cd304fec30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:08:58 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-0e56a2a4-9be4-42c3-a047-e5488ebea852 tempest-AbsoluteLimitsTests-1126615852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a27c6370-da4f-46b8-bfb5-06cd304fec30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:08:58 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-0e56a2a4-9be4-42c3-a047-e5488ebea852 tempest-AbsoluteLimitsTests-1126615852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0870b261-b14d-4b24-bbe8-f40469a4ee89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:08:58 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-0e56a2a4-9be4-42c3-a047-e5488ebea852 tempest-AbsoluteLimitsTests-1126615852 None] Volume 3bf8d5fd-0884-4ea1-a8a1-451ea565f548: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bf8d5fd-0884-4ea1-a8a1-451ea565f548', 'volume_size': 1} Apr 16 15:08:58 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-0e56a2a4-9be4-42c3-a047-e5488ebea852 tempest-AbsoluteLimitsTests-1126615852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:08:58 devstack sudo[87272]: pam_unix(sudo:session): session closed for user root Apr 16 15:08:58 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-d1cd8847-1dc4-43f0-9ac0-a68abd292654 tempest-ServerRescueNegativeTestJSON-1038487610 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6dac7a8d-9bd5-4e83-8851-4d522b7c82c8" returned: 0 in 0.907s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:08:58 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-d1cd8847-1dc4-43f0-9ac0-a68abd292654 tempest-ServerRescueNegativeTestJSON-1038487610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6dac7a8d-9bd5-4e83-8851-4d522b7c82c8 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:08:58 devstack sudo[87282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6dac7a8d-9bd5-4e83-8851-4d522b7c82c8 Apr 16 15:08:58 devstack sudo[87282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:08:58 devstack sudo[87280]: pam_unix(sudo:session): session closed for user root Apr 16 15:08:58 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-c008b9e0-986f-414a-9ae5-92833ecb6c89 tempest-VolumesSnapshotTestJSON-1827115803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70b5beb8-b235-468e-a328-da05baf30faf -F qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-70b5beb8-b235-468e-a328-da05baf30faf.1b3b0ba8-05fc-4f84-845e-0d2726e47410" returned: 0 in 0.652s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:08:58 devstack cinder-volume[82756]: WARNING cinder.volume.drivers.remotefs [None req-c008b9e0-986f-414a-9ae5-92833ecb6c89 tempest-VolumesSnapshotTestJSON-1827115803 None] /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-70b5beb8-b235-468e-a328-da05baf30faf.1b3b0ba8-05fc-4f84-845e-0d2726e47410 is being set with open permissions: ugo+rw Apr 16 15:08:58 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-c008b9e0-986f-414a-9ae5-92833ecb6c89 tempest-VolumesSnapshotTestJSON-1827115803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-70b5beb8-b235-468e-a328-da05baf30faf.1b3b0ba8-05fc-4f84-845e-0d2726e47410 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:08:58 devstack sudo[87282]: pam_unix(sudo:session): session closed for user root Apr 16 15:08:58 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-d1cd8847-1dc4-43f0-9ac0-a68abd292654 tempest-ServerRescueNegativeTestJSON-1038487610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6dac7a8d-9bd5-4e83-8851-4d522b7c82c8" returned: 0 in 0.450s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:08:58 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-d1cd8847-1dc4-43f0-9ac0-a68abd292654 tempest-ServerRescueNegativeTestJSON-1038487610 None] Lock "cinder-quobyte-6dac7a8d-9bd5-4e83-8851-4d522b7c82c8" released by "delete_volume" :: held 1.477s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:08:58 devstack sudo[87288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-70b5beb8-b235-468e-a328-da05baf30faf.1b3b0ba8-05fc-4f84-845e-0d2726e47410 Apr 16 15:08:58 devstack sudo[87288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:08:58 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-d1cd8847-1dc4-43f0-9ac0-a68abd292654 tempest-ServerRescueNegativeTestJSON-1038487610 None] Created reservations ['76c6b07e-f0fe-46a7-8d5e-625b41e0bd71', 'f2115b7a-badd-4ed5-b91f-c5bb6b1892ea', 'c8ab6033-84bb-44d1-9213-90210c081c56', '2ed0dbef-ddd4-4f44-b13e-29f2a91b472e'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:08:58 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-d1cd8847-1dc4-43f0-9ac0-a68abd292654 tempest-ServerRescueNegativeTestJSON-1038487610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:08:58 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-d1cd8847-1dc4-43f0-9ac0-a68abd292654 tempest-ServerRescueNegativeTestJSON-1038487610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:08:58 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-d1cd8847-1dc4-43f0-9ac0-a68abd292654 tempest-ServerRescueNegativeTestJSON-1038487610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:08:58 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-d1cd8847-1dc4-43f0-9ac0-a68abd292654 tempest-ServerRescueNegativeTestJSON-1038487610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:08:58 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-d1cd8847-1dc4-43f0-9ac0-a68abd292654 tempest-ServerRescueNegativeTestJSON-1038487610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:08:58 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-d1cd8847-1dc4-43f0-9ac0-a68abd292654 tempest-ServerRescueNegativeTestJSON-1038487610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:08:58 devstack sudo[87290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:08:58 devstack sudo[87290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:08:59 devstack sudo[87288]: pam_unix(sudo:session): session closed for user root Apr 16 15:08:59 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-c008b9e0-986f-414a-9ae5-92833ecb6c89 tempest-VolumesSnapshotTestJSON-1827115803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-70b5beb8-b235-468e-a328-da05baf30faf.1b3b0ba8-05fc-4f84-845e-0d2726e47410" returned: 0 in 0.511s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:08:59 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-c008b9e0-986f-414a-9ae5-92833ecb6c89 tempest-VolumesSnapshotTestJSON-1827115803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-70b5beb8-b235-468e-a328-da05baf30faf.info {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:08:59 devstack sudo[87290]: pam_unix(sudo:session): session closed for user root Apr 16 15:08:59 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-d1cd8847-1dc4-43f0-9ac0-a68abd292654 tempest-ServerRescueNegativeTestJSON-1038487610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.433s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:08:59 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-d1cd8847-1dc4-43f0-9ac0-a68abd292654 tempest-ServerRescueNegativeTestJSON-1038487610 None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:08:59 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-d1cd8847-1dc4-43f0-9ac0-a68abd292654 tempest-ServerRescueNegativeTestJSON-1038487610 None] Deleted volume successfully. Apr 16 15:08:59 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-d1cd8847-1dc4-43f0-9ac0-a68abd292654 tempest-ServerRescueNegativeTestJSON-1038487610 None] Lock "cinder-6dac7a8d-9bd5-4e83-8851-4d522b7c82c8-delete_volume" released by "delete_volume" :: held 2.123s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:08:59 devstack sudo[87296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-70b5beb8-b235-468e-a328-da05baf30faf.info Apr 16 15:08:59 devstack sudo[87296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:08:59 devstack sudo[87296]: pam_unix(sudo:session): session closed for user root Apr 16 15:08:59 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-c008b9e0-986f-414a-9ae5-92833ecb6c89 tempest-VolumesSnapshotTestJSON-1827115803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-70b5beb8-b235-468e-a328-da05baf30faf.info" returned: 0 in 0.498s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:08:59 devstack cinder-volume[82756]: WARNING cinder.volume.drivers.remotefs [None req-c008b9e0-986f-414a-9ae5-92833ecb6c89 tempest-VolumesSnapshotTestJSON-1827115803 None] /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-70b5beb8-b235-468e-a328-da05baf30faf.info is being set with open permissions: ugo+rw Apr 16 15:08:59 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-c008b9e0-986f-414a-9ae5-92833ecb6c89 tempest-VolumesSnapshotTestJSON-1827115803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-70b5beb8-b235-468e-a328-da05baf30faf.info {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:08:59 devstack sudo[87301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-70b5beb8-b235-468e-a328-da05baf30faf.info Apr 16 15:08:59 devstack sudo[87301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:08:59 devstack sudo[87301]: pam_unix(sudo:session): session closed for user root Apr 16 15:08:59 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-c008b9e0-986f-414a-9ae5-92833ecb6c89 tempest-VolumesSnapshotTestJSON-1827115803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-70b5beb8-b235-468e-a328-da05baf30faf.info" returned: 0 in 0.462s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:09:00 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-c008b9e0-986f-414a-9ae5-92833ecb6c89 tempest-VolumesSnapshotTestJSON-1827115803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.169s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:09:00 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-0e56a2a4-9be4-42c3-a047-e5488ebea852 tempest-AbsoluteLimitsTests-1126615852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.995s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:09:00 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-0e56a2a4-9be4-42c3-a047-e5488ebea852 tempest-AbsoluteLimitsTests-1126615852 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:08:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1292250074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bf8d5fd-0884-4ea1-a8a1-451ea565f548,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3598a6557c3e44e08e09ffb35e252308',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:08:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:08:58Z,use_quota=True,user_id='298cd5db4960463b8ac1980140d3bf1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)}" {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 15:09:00 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-0e56a2a4-9be4-42c3-a047-e5488ebea852 tempest-AbsoluteLimitsTests-1126615852 None] Creating volume 3bf8d5fd-0884-4ea1-a8a1-451ea565f548 {{(pid=82756) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 15:09:00 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-0e56a2a4-9be4-42c3-a047-e5488ebea852 tempest-AbsoluteLimitsTests-1126615852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:09:00 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-0e56a2a4-9be4-42c3-a047-e5488ebea852 tempest-AbsoluteLimitsTests-1126615852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:09:00 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-0e56a2a4-9be4-42c3-a047-e5488ebea852 tempest-AbsoluteLimitsTests-1126615852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:09:00 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-0e56a2a4-9be4-42c3-a047-e5488ebea852 tempest-AbsoluteLimitsTests-1126615852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:09:00 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-0e56a2a4-9be4-42c3-a047-e5488ebea852 tempest-AbsoluteLimitsTests-1126615852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:09:00 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-0e56a2a4-9be4-42c3-a047-e5488ebea852 tempest-AbsoluteLimitsTests-1126615852 None] Selected osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 as target Quobyte volume. {{(pid=82756) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 15:09:00 devstack cinder-volume[82756]: INFO cinder.volume.drivers.remotefs [None req-0e56a2a4-9be4-42c3-a047-e5488ebea852 tempest-AbsoluteLimitsTests-1126615852 None] casted to osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 Apr 16 15:09:00 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-0e56a2a4-9be4-42c3-a047-e5488ebea852 tempest-AbsoluteLimitsTests-1126615852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-3bf8d5fd-0884-4ea1-a8a1-451ea565f548 1073741824 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:09:00 devstack sudo[87304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-3bf8d5fd-0884-4ea1-a8a1-451ea565f548 1073741824 Apr 16 15:09:00 devstack sudo[87304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:09:00 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-c008b9e0-986f-414a-9ae5-92833ecb6c89 tempest-VolumesSnapshotTestJSON-1827115803 None] Create snapshot completed successfully Apr 16 15:09:00 devstack sudo[87304]: pam_unix(sudo:session): session closed for user root Apr 16 15:09:00 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-0e56a2a4-9be4-42c3-a047-e5488ebea852 tempest-AbsoluteLimitsTests-1126615852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-3bf8d5fd-0884-4ea1-a8a1-451ea565f548 1073741824" returned: 0 in 0.550s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:09:00 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-0e56a2a4-9be4-42c3-a047-e5488ebea852 tempest-AbsoluteLimitsTests-1126615852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-3bf8d5fd-0884-4ea1-a8a1-451ea565f548 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:09:00 devstack sudo[87367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-3bf8d5fd-0884-4ea1-a8a1-451ea565f548 Apr 16 15:09:00 devstack sudo[87367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:09:01 devstack sudo[87367]: pam_unix(sudo:session): session closed for user root Apr 16 15:09:01 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-0e56a2a4-9be4-42c3-a047-e5488ebea852 tempest-AbsoluteLimitsTests-1126615852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-3bf8d5fd-0884-4ea1-a8a1-451ea565f548" returned: 0 in 0.465s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:09:01 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-0e56a2a4-9be4-42c3-a047-e5488ebea852 tempest-AbsoluteLimitsTests-1126615852 None] <== create_volume: return (1048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'} {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 15:09:01 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-0e56a2a4-9be4-42c3-a047-e5488ebea852 tempest-AbsoluteLimitsTests-1126615852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.051s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:09:01 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-0e56a2a4-9be4-42c3-a047-e5488ebea852 tempest-AbsoluteLimitsTests-1126615852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0870b261-b14d-4b24-bbe8-f40469a4ee89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bf8d5fd-0884-4ea1-a8a1-451ea565f548', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:09:01 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-0e56a2a4-9be4-42c3-a047-e5488ebea852 tempest-AbsoluteLimitsTests-1126615852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0978348e-ca2a-4b25-8d20-c9a2985e701f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:09:01 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-0e56a2a4-9be4-42c3-a047-e5488ebea852 tempest-AbsoluteLimitsTests-1126615852 None] Volume volume-3bf8d5fd-0884-4ea1-a8a1-451ea565f548 (3bf8d5fd-0884-4ea1-a8a1-451ea565f548): created successfully Apr 16 15:09:01 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-0e56a2a4-9be4-42c3-a047-e5488ebea852 tempest-AbsoluteLimitsTests-1126615852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0978348e-ca2a-4b25-8d20-c9a2985e701f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:09:01 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-0e56a2a4-9be4-42c3-a047-e5488ebea852 tempest-AbsoluteLimitsTests-1126615852 None] Flow 'volume_create_manager' (dd547944-9826-49af-9b5b-45c1d76b7dc1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:09:01 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-0e56a2a4-9be4-42c3-a047-e5488ebea852 tempest-AbsoluteLimitsTests-1126615852 None] Created volume successfully. Apr 16 15:09:01 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-a8a46bbd-b194-4a62-bf62-82b4761c139a tempest-VolumesSnapshotTestJSON-1827115803 None] Acquiring lock "cinder-1b3b0ba8-05fc-4f84-845e-0d2726e47410-delete_snapshot" by "delete_snapshot" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:09:01 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-a8a46bbd-b194-4a62-bf62-82b4761c139a tempest-VolumesSnapshotTestJSON-1827115803 None] Lock "cinder-1b3b0ba8-05fc-4f84-845e-0d2726e47410-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:09:01 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-a8a46bbd-b194-4a62-bf62-82b4761c139a tempest-VolumesSnapshotTestJSON-1827115803 None] Acquiring lock "cinder-quobyte-70b5beb8-b235-468e-a328-da05baf30faf" by "delete_snapshot" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:09:01 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-a8a46bbd-b194-4a62-bf62-82b4761c139a tempest-VolumesSnapshotTestJSON-1827115803 None] Lock "cinder-quobyte-70b5beb8-b235-468e-a328-da05baf30faf" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:09:01 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-a8a46bbd-b194-4a62-bf62-82b4761c139a tempest-VolumesSnapshotTestJSON-1827115803 None] Acquiring lock "cinder-quobyte-1b3b0ba8-05fc-4f84-845e-0d2726e47410" by "_delete_snapshot" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:09:01 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-a8a46bbd-b194-4a62-bf62-82b4761c139a tempest-VolumesSnapshotTestJSON-1827115803 None] Lock "cinder-quobyte-1b3b0ba8-05fc-4f84-845e-0d2726e47410" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:09:01 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-a8a46bbd-b194-4a62-bf62-82b4761c139a tempest-VolumesSnapshotTestJSON-1827115803 None] Deleting offline snapshot 1b3b0ba8-05fc-4f84-845e-0d2726e47410 of volume 70b5beb8-b235-468e-a328-da05baf30faf {{(pid=82756) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 15:09:01 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-a8a46bbd-b194-4a62-bf62-82b4761c139a tempest-VolumesSnapshotTestJSON-1827115803 None] snapshot_file for this snap is: volume-70b5beb8-b235-468e-a328-da05baf30faf.1b3b0ba8-05fc-4f84-845e-0d2726e47410 {{(pid=82756) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 15:09:01 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[67fd93ca-80ec-47e9-b095-35abab89c8bb]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:09:01 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-a8a46bbd-b194-4a62-bf62-82b4761c139a tempest-VolumesSnapshotTestJSON-1827115803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-70b5beb8-b235-468e-a328-da05baf30faf.1b3b0ba8-05fc-4f84-845e-0d2726e47410 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:09:01 devstack sudo[87370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-70b5beb8-b235-468e-a328-da05baf30faf.1b3b0ba8-05fc-4f84-845e-0d2726e47410 Apr 16 15:09:01 devstack sudo[87370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:09:01 devstack sudo[87370]: pam_unix(sudo:session): session closed for user root Apr 16 15:09:01 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-a8a46bbd-b194-4a62-bf62-82b4761c139a tempest-VolumesSnapshotTestJSON-1827115803 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-70b5beb8-b235-468e-a328-da05baf30faf.1b3b0ba8-05fc-4f84-845e-0d2726e47410" returned: 0 in 0.480s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:09:01 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-a8a46bbd-b194-4a62-bf62-82b4761c139a tempest-VolumesSnapshotTestJSON-1827115803 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-70b5beb8-b235-468e-a328-da05baf30faf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82756) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 15:09:01 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[59ec4677-4eed-44ec-bd85-92fff29f4e79]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:09:01 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-a8a46bbd-b194-4a62-bf62-82b4761c139a tempest-VolumesSnapshotTestJSON-1827115803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-70b5beb8-b235-468e-a328-da05baf30faf {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:09:01 devstack sudo[87382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-70b5beb8-b235-468e-a328-da05baf30faf Apr 16 15:09:01 devstack sudo[87382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:09:02 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-cc1ca401-eb3e-4713-8f2e-4fca07cfc1cc tempest-AbsoluteLimitsTests-1126615852 None] Acquiring lock "cinder-3bf8d5fd-0884-4ea1-a8a1-451ea565f548-delete_volume" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:09:02 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-cc1ca401-eb3e-4713-8f2e-4fca07cfc1cc tempest-AbsoluteLimitsTests-1126615852 None] Lock "cinder-3bf8d5fd-0884-4ea1-a8a1-451ea565f548-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:09:02 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-cc1ca401-eb3e-4713-8f2e-4fca07cfc1cc tempest-AbsoluteLimitsTests-1126615852 None] Acquiring lock "cinder-quobyte-3bf8d5fd-0884-4ea1-a8a1-451ea565f548" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:09:02 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-cc1ca401-eb3e-4713-8f2e-4fca07cfc1cc tempest-AbsoluteLimitsTests-1126615852 None] Lock "cinder-quobyte-3bf8d5fd-0884-4ea1-a8a1-451ea565f548" acquired by "delete_volume" :: waited 0.009s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:09:02 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f329736-b3fa-4c22-ac40-89f1ecc61c24]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:09:02 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-cc1ca401-eb3e-4713-8f2e-4fca07cfc1cc tempest-AbsoluteLimitsTests-1126615852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-3bf8d5fd-0884-4ea1-a8a1-451ea565f548 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:09:02 devstack sudo[87388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-3bf8d5fd-0884-4ea1-a8a1-451ea565f548 Apr 16 15:09:02 devstack sudo[87388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:09:02 devstack sudo[87382]: pam_unix(sudo:session): session closed for user root Apr 16 15:09:02 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-a8a46bbd-b194-4a62-bf62-82b4761c139a tempest-VolumesSnapshotTestJSON-1827115803 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-70b5beb8-b235-468e-a328-da05baf30faf" returned: 0 in 0.755s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:09:02 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-a8a46bbd-b194-4a62-bf62-82b4761c139a tempest-VolumesSnapshotTestJSON-1827115803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-70b5beb8-b235-468e-a328-da05baf30faf.1b3b0ba8-05fc-4f84-845e-0d2726e47410 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:09:02 devstack sudo[87391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-70b5beb8-b235-468e-a328-da05baf30faf.1b3b0ba8-05fc-4f84-845e-0d2726e47410 Apr 16 15:09:02 devstack sudo[87391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:09:03 devstack sudo[87391]: pam_unix(sudo:session): session closed for user root Apr 16 15:09:03 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-a8a46bbd-b194-4a62-bf62-82b4761c139a tempest-VolumesSnapshotTestJSON-1827115803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-70b5beb8-b235-468e-a328-da05baf30faf.1b3b0ba8-05fc-4f84-845e-0d2726e47410" returned: 0 in 0.734s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:09:03 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-a8a46bbd-b194-4a62-bf62-82b4761c139a tempest-VolumesSnapshotTestJSON-1827115803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-70b5beb8-b235-468e-a328-da05baf30faf.1b3b0ba8-05fc-4f84-845e-0d2726e47410 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:09:03 devstack sudo[87400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-70b5beb8-b235-468e-a328-da05baf30faf.1b3b0ba8-05fc-4f84-845e-0d2726e47410 Apr 16 15:09:03 devstack sudo[87400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:09:03 devstack sudo[87388]: pam_unix(sudo:session): session closed for user root Apr 16 15:09:03 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-cc1ca401-eb3e-4713-8f2e-4fca07cfc1cc tempest-AbsoluteLimitsTests-1126615852 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-3bf8d5fd-0884-4ea1-a8a1-451ea565f548" returned: 0 in 1.263s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:09:03 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-cc1ca401-eb3e-4713-8f2e-4fca07cfc1cc tempest-AbsoluteLimitsTests-1126615852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-3bf8d5fd-0884-4ea1-a8a1-451ea565f548 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:09:03 devstack sudo[87404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-3bf8d5fd-0884-4ea1-a8a1-451ea565f548 Apr 16 15:09:03 devstack sudo[87404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:09:04 devstack sudo[87400]: pam_unix(sudo:session): session closed for user root Apr 16 15:09:04 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-a8a46bbd-b194-4a62-bf62-82b4761c139a tempest-VolumesSnapshotTestJSON-1827115803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-70b5beb8-b235-468e-a328-da05baf30faf.1b3b0ba8-05fc-4f84-845e-0d2726e47410" returned: 0 in 0.762s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:09:04 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-a8a46bbd-b194-4a62-bf62-82b4761c139a tempest-VolumesSnapshotTestJSON-1827115803 None] Lock "cinder-quobyte-1b3b0ba8-05fc-4f84-845e-0d2726e47410" released by "_delete_snapshot" :: held 2.789s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:09:04 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-a8a46bbd-b194-4a62-bf62-82b4761c139a tempest-VolumesSnapshotTestJSON-1827115803 None] Lock "cinder-quobyte-70b5beb8-b235-468e-a328-da05baf30faf" released by "delete_snapshot" :: held 2.801s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:09:04 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-a8a46bbd-b194-4a62-bf62-82b4761c139a tempest-VolumesSnapshotTestJSON-1827115803 None] Created reservations ['84e05a49-a121-4841-9b94-3f75636b0fb2', '0b601a32-ea3c-4958-9429-835081a90e40', '20ed782f-2bd2-40ca-9fa6-b90f3ca8b42f', '9bed8b40-757e-4de9-b02a-85fc13ede8a6'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:09:04 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-a8a46bbd-b194-4a62-bf62-82b4761c139a tempest-VolumesSnapshotTestJSON-1827115803 None] Delete snapshot completed successfully. Apr 16 15:09:04 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-a8a46bbd-b194-4a62-bf62-82b4761c139a tempest-VolumesSnapshotTestJSON-1827115803 None] Lock "cinder-1b3b0ba8-05fc-4f84-845e-0d2726e47410-delete_snapshot" released by "delete_snapshot" :: held 2.982s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:09:04 devstack sudo[87404]: pam_unix(sudo:session): session closed for user root Apr 16 15:09:04 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-cc1ca401-eb3e-4713-8f2e-4fca07cfc1cc tempest-AbsoluteLimitsTests-1126615852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-3bf8d5fd-0884-4ea1-a8a1-451ea565f548" returned: 0 in 0.608s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:09:04 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-cc1ca401-eb3e-4713-8f2e-4fca07cfc1cc tempest-AbsoluteLimitsTests-1126615852 None] Lock "cinder-quobyte-3bf8d5fd-0884-4ea1-a8a1-451ea565f548" released by "delete_volume" :: held 1.891s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:09:04 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-cc1ca401-eb3e-4713-8f2e-4fca07cfc1cc tempest-AbsoluteLimitsTests-1126615852 None] Created reservations ['314e8cfb-b7bf-45a6-ae51-d74c437e5f72', '039d20f5-d6dc-4e2f-9077-655df4e7411b', '66e44a84-d9d6-478b-8407-d95e9db71eda', '12aa2d0f-d3d1-4820-b184-6bbb84ab24b0'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:09:04 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-cc1ca401-eb3e-4713-8f2e-4fca07cfc1cc tempest-AbsoluteLimitsTests-1126615852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:09:04 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-cc1ca401-eb3e-4713-8f2e-4fca07cfc1cc tempest-AbsoluteLimitsTests-1126615852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:09:04 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-cc1ca401-eb3e-4713-8f2e-4fca07cfc1cc tempest-AbsoluteLimitsTests-1126615852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:09:04 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-cc1ca401-eb3e-4713-8f2e-4fca07cfc1cc tempest-AbsoluteLimitsTests-1126615852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:09:04 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-cc1ca401-eb3e-4713-8f2e-4fca07cfc1cc tempest-AbsoluteLimitsTests-1126615852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:09:04 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-cc1ca401-eb3e-4713-8f2e-4fca07cfc1cc tempest-AbsoluteLimitsTests-1126615852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:09:04 devstack sudo[87408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:09:04 devstack sudo[87408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:09:04 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [None req-624cc90b-b62a-46c3-810a-a05b8c85102b tempest-VolumesSnapshotTestJSON-1827115803 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82756) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 15:09:05 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-624cc90b-b62a-46c3-810a-a05b8c85102b tempest-VolumesSnapshotTestJSON-1827115803 None] Flow 'volume_create_manager' (f2f9facc-bff8-462b-9308-b3b6d4bc7e24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:09:05 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-624cc90b-b62a-46c3-810a-a05b8c85102b tempest-VolumesSnapshotTestJSON-1827115803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60d5e787-4495-4670-8e54-c7a73f194925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:09:05 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-624cc90b-b62a-46c3-810a-a05b8c85102b tempest-VolumesSnapshotTestJSON-1827115803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60d5e787-4495-4670-8e54-c7a73f194925) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:09:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-941816407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14a4c862-6a20-4759-8283-c993f06e3d25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e188a76e5efd467e8c860aa308f861b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:09:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:09:05Z,use_quota=True,user_id='0c5eb9cbc4334877925458d81eec542d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:09:05 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-624cc90b-b62a-46c3-810a-a05b8c85102b tempest-VolumesSnapshotTestJSON-1827115803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5c1f19c-45fd-4dd5-bd7d-2c647d2d41df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:09:05 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-624cc90b-b62a-46c3-810a-a05b8c85102b tempest-VolumesSnapshotTestJSON-1827115803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5c1f19c-45fd-4dd5-bd7d-2c647d2d41df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:09:05 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-624cc90b-b62a-46c3-810a-a05b8c85102b tempest-VolumesSnapshotTestJSON-1827115803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21a41a68-e871-4bff-88ed-22eb08cba5d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:09:05 devstack sudo[87408]: pam_unix(sudo:session): session closed for user root Apr 16 15:09:05 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-624cc90b-b62a-46c3-810a-a05b8c85102b tempest-VolumesSnapshotTestJSON-1827115803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21a41a68-e871-4bff-88ed-22eb08cba5d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14a4c862-6a20-4759-8283-c993f06e3d25', 'volume_name': 'volume-14a4c862-6a20-4759-8283-c993f06e3d25', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:09:05 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-624cc90b-b62a-46c3-810a-a05b8c85102b tempest-VolumesSnapshotTestJSON-1827115803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d375908-2ccf-470a-b8b3-199443da4484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:09:05 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-624cc90b-b62a-46c3-810a-a05b8c85102b tempest-VolumesSnapshotTestJSON-1827115803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d375908-2ccf-470a-b8b3-199443da4484) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:09:05 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-624cc90b-b62a-46c3-810a-a05b8c85102b tempest-VolumesSnapshotTestJSON-1827115803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d07672b-75eb-4bd3-89bb-2e7766ab82b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:09:05 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-624cc90b-b62a-46c3-810a-a05b8c85102b tempest-VolumesSnapshotTestJSON-1827115803 None] Volume 14a4c862-6a20-4759-8283-c993f06e3d25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14a4c862-6a20-4759-8283-c993f06e3d25', 'volume_size': 1} Apr 16 15:09:05 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-624cc90b-b62a-46c3-810a-a05b8c85102b tempest-VolumesSnapshotTestJSON-1827115803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:09:05 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-624cc90b-b62a-46c3-810a-a05b8c85102b tempest-VolumesSnapshotTestJSON-1827115803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:09:05 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-624cc90b-b62a-46c3-810a-a05b8c85102b tempest-VolumesSnapshotTestJSON-1827115803 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:09:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-941816407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14a4c862-6a20-4759-8283-c993f06e3d25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e188a76e5efd467e8c860aa308f861b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:09:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:09:05Z,use_quota=True,user_id='0c5eb9cbc4334877925458d81eec542d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)}" {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 15:09:05 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-624cc90b-b62a-46c3-810a-a05b8c85102b tempest-VolumesSnapshotTestJSON-1827115803 None] Creating volume 14a4c862-6a20-4759-8283-c993f06e3d25 {{(pid=82756) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 15:09:05 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-624cc90b-b62a-46c3-810a-a05b8c85102b tempest-VolumesSnapshotTestJSON-1827115803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:09:05 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-624cc90b-b62a-46c3-810a-a05b8c85102b tempest-VolumesSnapshotTestJSON-1827115803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:09:05 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-624cc90b-b62a-46c3-810a-a05b8c85102b tempest-VolumesSnapshotTestJSON-1827115803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:09:05 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-624cc90b-b62a-46c3-810a-a05b8c85102b tempest-VolumesSnapshotTestJSON-1827115803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:09:05 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-624cc90b-b62a-46c3-810a-a05b8c85102b tempest-VolumesSnapshotTestJSON-1827115803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:09:05 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-624cc90b-b62a-46c3-810a-a05b8c85102b tempest-VolumesSnapshotTestJSON-1827115803 None] Selected osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 as target Quobyte volume. {{(pid=82756) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 15:09:05 devstack cinder-volume[82756]: INFO cinder.volume.drivers.remotefs [None req-624cc90b-b62a-46c3-810a-a05b8c85102b tempest-VolumesSnapshotTestJSON-1827115803 None] casted to osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 Apr 16 15:09:05 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-624cc90b-b62a-46c3-810a-a05b8c85102b tempest-VolumesSnapshotTestJSON-1827115803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-14a4c862-6a20-4759-8283-c993f06e3d25 1073741824 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:09:05 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-cc1ca401-eb3e-4713-8f2e-4fca07cfc1cc tempest-AbsoluteLimitsTests-1126615852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.862s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:09:05 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-cc1ca401-eb3e-4713-8f2e-4fca07cfc1cc tempest-AbsoluteLimitsTests-1126615852 None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:09:05 devstack sudo[87411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-14a4c862-6a20-4759-8283-c993f06e3d25 1073741824 Apr 16 15:09:05 devstack sudo[87411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:09:05 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-cc1ca401-eb3e-4713-8f2e-4fca07cfc1cc tempest-AbsoluteLimitsTests-1126615852 None] Deleted volume successfully. Apr 16 15:09:05 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-cc1ca401-eb3e-4713-8f2e-4fca07cfc1cc tempest-AbsoluteLimitsTests-1126615852 None] Lock "cinder-3bf8d5fd-0884-4ea1-a8a1-451ea565f548-delete_volume" released by "delete_volume" :: held 2.917s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:09:05 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-395494d3-b927-4780-b521-c7ec2752cf4d tempest-VolumesActionsTest-570492233 None] Acquiring lock "cinder-c1fe4c2f-0039-4d10-b121-1dbbbdb434fa" by "attach_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:09:05 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-395494d3-b927-4780-b521-c7ec2752cf4d tempest-VolumesActionsTest-570492233 None] Lock "cinder-c1fe4c2f-0039-4d10-b121-1dbbbdb434fa" acquired by "attach_volume" :: waited 0.022s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:09:05 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-395494d3-b927-4780-b521-c7ec2752cf4d tempest-VolumesActionsTest-570492233 None] Attaching volume c1fe4c2f-0039-4d10-b121-1dbbbdb434fa to instance 875bafd1-36e0-41a1-8093-fdb4d75763ac at mountpoint /dev/vdb on host None. Apr 16 15:09:05 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-395494d3-b927-4780-b521-c7ec2752cf4d tempest-VolumesActionsTest-570492233 None] Attach volume completed successfully. Apr 16 15:09:05 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-395494d3-b927-4780-b521-c7ec2752cf4d tempest-VolumesActionsTest-570492233 None] Lock "cinder-c1fe4c2f-0039-4d10-b121-1dbbbdb434fa" released by "attach_volume" :: held 0.116s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:09:06 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-9e058a11-cf8a-4cca-ba09-afae19c94745 tempest-VolumesActionsTest-570492233 None] Acquiring lock "cinder-c1fe4c2f-0039-4d10-b121-1dbbbdb434fa-detach_volume" by "detach_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:09:06 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-9e058a11-cf8a-4cca-ba09-afae19c94745 tempest-VolumesActionsTest-570492233 None] Lock "cinder-c1fe4c2f-0039-4d10-b121-1dbbbdb434fa-detach_volume" acquired by "detach_volume" :: waited 0.020s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:09:06 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-9e058a11-cf8a-4cca-ba09-afae19c94745 tempest-VolumesActionsTest-570492233 None] Detaching volume c1fe4c2f-0039-4d10-b121-1dbbbdb434fa from instance 875bafd1-36e0-41a1-8093-fdb4d75763ac. Apr 16 15:09:06 devstack sudo[87411]: pam_unix(sudo:session): session closed for user root Apr 16 15:09:06 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-624cc90b-b62a-46c3-810a-a05b8c85102b tempest-VolumesSnapshotTestJSON-1827115803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-14a4c862-6a20-4759-8283-c993f06e3d25 1073741824" returned: 0 in 0.968s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:09:06 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-9e058a11-cf8a-4cca-ba09-afae19c94745 tempest-VolumesActionsTest-570492233 None] Detach volume completed successfully. Apr 16 15:09:06 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-624cc90b-b62a-46c3-810a-a05b8c85102b tempest-VolumesSnapshotTestJSON-1827115803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-14a4c862-6a20-4759-8283-c993f06e3d25 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:09:06 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-9e058a11-cf8a-4cca-ba09-afae19c94745 tempest-VolumesActionsTest-570492233 None] Lock "cinder-c1fe4c2f-0039-4d10-b121-1dbbbdb434fa-detach_volume" released by "detach_volume" :: held 0.141s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:09:06 devstack sudo[87416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-14a4c862-6a20-4759-8283-c993f06e3d25 Apr 16 15:09:06 devstack sudo[87416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:09:07 devstack sudo[87416]: pam_unix(sudo:session): session closed for user root Apr 16 15:09:07 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-624cc90b-b62a-46c3-810a-a05b8c85102b tempest-VolumesSnapshotTestJSON-1827115803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-14a4c862-6a20-4759-8283-c993f06e3d25" returned: 0 in 0.851s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:09:07 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-624cc90b-b62a-46c3-810a-a05b8c85102b tempest-VolumesSnapshotTestJSON-1827115803 None] <== create_volume: return (1880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'} {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 15:09:07 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-624cc90b-b62a-46c3-810a-a05b8c85102b tempest-VolumesSnapshotTestJSON-1827115803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.882s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:09:07 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-624cc90b-b62a-46c3-810a-a05b8c85102b tempest-VolumesSnapshotTestJSON-1827115803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d07672b-75eb-4bd3-89bb-2e7766ab82b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14a4c862-6a20-4759-8283-c993f06e3d25', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:09:07 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-624cc90b-b62a-46c3-810a-a05b8c85102b tempest-VolumesSnapshotTestJSON-1827115803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e966f164-a6c7-4417-95e6-3e77133f3956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:09:07 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-624cc90b-b62a-46c3-810a-a05b8c85102b tempest-VolumesSnapshotTestJSON-1827115803 None] Volume volume-14a4c862-6a20-4759-8283-c993f06e3d25 (14a4c862-6a20-4759-8283-c993f06e3d25): created successfully Apr 16 15:09:07 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-624cc90b-b62a-46c3-810a-a05b8c85102b tempest-VolumesSnapshotTestJSON-1827115803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e966f164-a6c7-4417-95e6-3e77133f3956) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:09:07 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-624cc90b-b62a-46c3-810a-a05b8c85102b tempest-VolumesSnapshotTestJSON-1827115803 None] Flow 'volume_create_manager' (f2f9facc-bff8-462b-9308-b3b6d4bc7e24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:09:07 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-624cc90b-b62a-46c3-810a-a05b8c85102b tempest-VolumesSnapshotTestJSON-1827115803 None] Created volume successfully. Apr 16 15:09:08 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-7ba4a4b8-31c9-4be7-b6e0-7ab649681791 tempest-VolumesSnapshotTestJSON-1827115803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:09:08 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-7ba4a4b8-31c9-4be7-b6e0-7ab649681791 tempest-VolumesSnapshotTestJSON-1827115803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:09:08 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-7ba4a4b8-31c9-4be7-b6e0-7ab649681791 tempest-VolumesSnapshotTestJSON-1827115803 None] Creating offline snapshot 96477a24-9f3f-4387-90ff-f4f0dd05dafe of volume 14a4c862-6a20-4759-8283-c993f06e3d25 {{(pid=82756) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 16 15:09:08 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[15d527b2-2f62-4ab1-9e7b-97a48c0476bd]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:09:08 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-7ba4a4b8-31c9-4be7-b6e0-7ab649681791 tempest-VolumesSnapshotTestJSON-1827115803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-14a4c862-6a20-4759-8283-c993f06e3d25 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:09:08 devstack sudo[87481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-14a4c862-6a20-4759-8283-c993f06e3d25 Apr 16 15:09:08 devstack sudo[87481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:09:09 devstack sudo[87481]: pam_unix(sudo:session): session closed for user root Apr 16 15:09:09 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-7ba4a4b8-31c9-4be7-b6e0-7ab649681791 tempest-VolumesSnapshotTestJSON-1827115803 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-14a4c862-6a20-4759-8283-c993f06e3d25" returned: 0 in 0.542s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:09:09 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-7ba4a4b8-31c9-4be7-b6e0-7ab649681791 tempest-VolumesSnapshotTestJSON-1827115803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-14a4c862-6a20-4759-8283-c993f06e3d25,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-14a4c862-6a20-4759-8283-c993f06e3d25.96477a24-9f3f-4387-90ff-f4f0dd05dafe 1G {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:09:09 devstack sudo[87488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-14a4c862-6a20-4759-8283-c993f06e3d25,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-14a4c862-6a20-4759-8283-c993f06e3d25.96477a24-9f3f-4387-90ff-f4f0dd05dafe 1G Apr 16 15:09:09 devstack sudo[87488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:09:09 devstack sudo[87488]: pam_unix(sudo:session): session closed for user root Apr 16 15:09:09 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-7ba4a4b8-31c9-4be7-b6e0-7ab649681791 tempest-VolumesSnapshotTestJSON-1827115803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-14a4c862-6a20-4759-8283-c993f06e3d25,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-14a4c862-6a20-4759-8283-c993f06e3d25.96477a24-9f3f-4387-90ff-f4f0dd05dafe 1G" returned: 0 in 0.714s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:09:09 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-7ba4a4b8-31c9-4be7-b6e0-7ab649681791 tempest-VolumesSnapshotTestJSON-1827115803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14a4c862-6a20-4759-8283-c993f06e3d25 -F qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-14a4c862-6a20-4759-8283-c993f06e3d25.96477a24-9f3f-4387-90ff-f4f0dd05dafe {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:09:09 devstack sudo[87496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14a4c862-6a20-4759-8283-c993f06e3d25 -F qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-14a4c862-6a20-4759-8283-c993f06e3d25.96477a24-9f3f-4387-90ff-f4f0dd05dafe Apr 16 15:09:09 devstack sudo[87496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:09:09 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [None req-36c91fed-316a-48c9-91c2-6e1ba30e0472 tempest-VolumesTransfersTest-2042875671 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82756) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 15:09:09 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-36c91fed-316a-48c9-91c2-6e1ba30e0472 tempest-VolumesTransfersTest-2042875671 None] Flow 'volume_create_manager' (7cdddb66-bced-4528-b57a-6181dd2af0ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:09:09 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-36c91fed-316a-48c9-91c2-6e1ba30e0472 tempest-VolumesTransfersTest-2042875671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21860de8-bab9-4bdb-901a-d704fad5b3c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:09:09 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-36c91fed-316a-48c9-91c2-6e1ba30e0472 tempest-VolumesTransfersTest-2042875671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21860de8-bab9-4bdb-901a-d704fad5b3c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:09:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1358948528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d099e0aa-b7ec-428c-96ce-3670a9d600c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c275319c01b4ada96ca8f1ecd099870',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:09:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:09:10Z,use_quota=True,user_id='8cfab9df560249fdbbe49f0121ae33b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:09:09 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-36c91fed-316a-48c9-91c2-6e1ba30e0472 tempest-VolumesTransfersTest-2042875671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (894e5520-8c91-4011-8a67-aa07b1a36d3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:09:09 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-36c91fed-316a-48c9-91c2-6e1ba30e0472 tempest-VolumesTransfersTest-2042875671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (894e5520-8c91-4011-8a67-aa07b1a36d3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:09:09 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-36c91fed-316a-48c9-91c2-6e1ba30e0472 tempest-VolumesTransfersTest-2042875671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be5f7435-0dde-41e8-8f1a-809cd7ae4b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:09:09 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-36c91fed-316a-48c9-91c2-6e1ba30e0472 tempest-VolumesTransfersTest-2042875671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be5f7435-0dde-41e8-8f1a-809cd7ae4b43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd099e0aa-b7ec-428c-96ce-3670a9d600c2', 'volume_name': 'volume-d099e0aa-b7ec-428c-96ce-3670a9d600c2', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:09:09 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-36c91fed-316a-48c9-91c2-6e1ba30e0472 tempest-VolumesTransfersTest-2042875671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b70c19e-c8f7-4a17-90c9-8f6f9520cd10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:09:09 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-36c91fed-316a-48c9-91c2-6e1ba30e0472 tempest-VolumesTransfersTest-2042875671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b70c19e-c8f7-4a17-90c9-8f6f9520cd10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:09:09 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-36c91fed-316a-48c9-91c2-6e1ba30e0472 tempest-VolumesTransfersTest-2042875671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (686af0bc-db2e-4bf3-9799-7eed09128c4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:09:09 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-36c91fed-316a-48c9-91c2-6e1ba30e0472 tempest-VolumesTransfersTest-2042875671 None] Volume d099e0aa-b7ec-428c-96ce-3670a9d600c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d099e0aa-b7ec-428c-96ce-3670a9d600c2', 'volume_size': 1} Apr 16 15:09:09 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-36c91fed-316a-48c9-91c2-6e1ba30e0472 tempest-VolumesTransfersTest-2042875671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:09:10 devstack sudo[87496]: pam_unix(sudo:session): session closed for user root Apr 16 15:09:10 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-7ba4a4b8-31c9-4be7-b6e0-7ab649681791 tempest-VolumesSnapshotTestJSON-1827115803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14a4c862-6a20-4759-8283-c993f06e3d25 -F qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-14a4c862-6a20-4759-8283-c993f06e3d25.96477a24-9f3f-4387-90ff-f4f0dd05dafe" returned: 0 in 0.422s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:09:10 devstack cinder-volume[82756]: WARNING cinder.volume.drivers.remotefs [None req-7ba4a4b8-31c9-4be7-b6e0-7ab649681791 tempest-VolumesSnapshotTestJSON-1827115803 None] /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-14a4c862-6a20-4759-8283-c993f06e3d25.96477a24-9f3f-4387-90ff-f4f0dd05dafe is being set with open permissions: ugo+rw Apr 16 15:09:10 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-7ba4a4b8-31c9-4be7-b6e0-7ab649681791 tempest-VolumesSnapshotTestJSON-1827115803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-14a4c862-6a20-4759-8283-c993f06e3d25.96477a24-9f3f-4387-90ff-f4f0dd05dafe {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:09:10 devstack sudo[87501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-14a4c862-6a20-4759-8283-c993f06e3d25.96477a24-9f3f-4387-90ff-f4f0dd05dafe Apr 16 15:09:10 devstack sudo[87501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:09:10 devstack sudo[87501]: pam_unix(sudo:session): session closed for user root Apr 16 15:09:10 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-7ba4a4b8-31c9-4be7-b6e0-7ab649681791 tempest-VolumesSnapshotTestJSON-1827115803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-14a4c862-6a20-4759-8283-c993f06e3d25.96477a24-9f3f-4387-90ff-f4f0dd05dafe" returned: 0 in 0.409s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:09:10 devstack cinder-volume[82756]: DEBUG dbcounter [-] [82756] Writing DB stats cinder:SELECT=93,cinder:UPDATE=103,cinder:DELETE=12,cinder:INSERT=26 {{(pid=82756) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 15:09:10 devstack cinder-volume[82756]: DEBUG dbcounter [-] [82756] Writing DB stats cinder:UPDATE=110,cinder:DELETE=7,cinder:INSERT=24,cinder:SELECT=86 {{(pid=82756) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 15:09:10 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-7ba4a4b8-31c9-4be7-b6e0-7ab649681791 tempest-VolumesSnapshotTestJSON-1827115803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-14a4c862-6a20-4759-8283-c993f06e3d25.info {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:09:10 devstack sudo[87504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-14a4c862-6a20-4759-8283-c993f06e3d25.info Apr 16 15:09:10 devstack sudo[87504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:09:11 devstack sudo[87504]: pam_unix(sudo:session): session closed for user root Apr 16 15:09:11 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-7ba4a4b8-31c9-4be7-b6e0-7ab649681791 tempest-VolumesSnapshotTestJSON-1827115803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-14a4c862-6a20-4759-8283-c993f06e3d25.info" returned: 0 in 0.480s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:09:11 devstack cinder-volume[82756]: WARNING cinder.volume.drivers.remotefs [None req-7ba4a4b8-31c9-4be7-b6e0-7ab649681791 tempest-VolumesSnapshotTestJSON-1827115803 None] /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-14a4c862-6a20-4759-8283-c993f06e3d25.info is being set with open permissions: ugo+rw Apr 16 15:09:11 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-7ba4a4b8-31c9-4be7-b6e0-7ab649681791 tempest-VolumesSnapshotTestJSON-1827115803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-14a4c862-6a20-4759-8283-c993f06e3d25.info {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:09:11 devstack sudo[87507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-14a4c862-6a20-4759-8283-c993f06e3d25.info Apr 16 15:09:11 devstack sudo[87507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:09:11 devstack sudo[87507]: pam_unix(sudo:session): session closed for user root Apr 16 15:09:11 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-7ba4a4b8-31c9-4be7-b6e0-7ab649681791 tempest-VolumesSnapshotTestJSON-1827115803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-14a4c862-6a20-4759-8283-c993f06e3d25.info" returned: 0 in 0.407s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:09:11 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-7ba4a4b8-31c9-4be7-b6e0-7ab649681791 tempest-VolumesSnapshotTestJSON-1827115803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.080s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:09:11 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-36c91fed-316a-48c9-91c2-6e1ba30e0472 tempest-VolumesTransfersTest-2042875671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.641s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:09:11 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-36c91fed-316a-48c9-91c2-6e1ba30e0472 tempest-VolumesTransfersTest-2042875671 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:09:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1358948528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d099e0aa-b7ec-428c-96ce-3670a9d600c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c275319c01b4ada96ca8f1ecd099870',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:09:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:09:10Z,use_quota=True,user_id='8cfab9df560249fdbbe49f0121ae33b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)}" {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 15:09:11 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-36c91fed-316a-48c9-91c2-6e1ba30e0472 tempest-VolumesTransfersTest-2042875671 None] Creating volume d099e0aa-b7ec-428c-96ce-3670a9d600c2 {{(pid=82756) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 15:09:11 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-36c91fed-316a-48c9-91c2-6e1ba30e0472 tempest-VolumesTransfersTest-2042875671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:09:11 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-36c91fed-316a-48c9-91c2-6e1ba30e0472 tempest-VolumesTransfersTest-2042875671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:09:11 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-36c91fed-316a-48c9-91c2-6e1ba30e0472 tempest-VolumesTransfersTest-2042875671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:09:11 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-36c91fed-316a-48c9-91c2-6e1ba30e0472 tempest-VolumesTransfersTest-2042875671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:09:11 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-36c91fed-316a-48c9-91c2-6e1ba30e0472 tempest-VolumesTransfersTest-2042875671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:09:11 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-36c91fed-316a-48c9-91c2-6e1ba30e0472 tempest-VolumesTransfersTest-2042875671 None] Selected osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 as target Quobyte volume. {{(pid=82756) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 15:09:11 devstack cinder-volume[82756]: INFO cinder.volume.drivers.remotefs [None req-36c91fed-316a-48c9-91c2-6e1ba30e0472 tempest-VolumesTransfersTest-2042875671 None] casted to osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 Apr 16 15:09:11 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-36c91fed-316a-48c9-91c2-6e1ba30e0472 tempest-VolumesTransfersTest-2042875671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-d099e0aa-b7ec-428c-96ce-3670a9d600c2 1073741824 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:09:11 devstack sudo[87510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-d099e0aa-b7ec-428c-96ce-3670a9d600c2 1073741824 Apr 16 15:09:11 devstack sudo[87510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:09:11 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-7ba4a4b8-31c9-4be7-b6e0-7ab649681791 tempest-VolumesSnapshotTestJSON-1827115803 None] Create snapshot completed successfully Apr 16 15:09:12 devstack sudo[87510]: pam_unix(sudo:session): session closed for user root Apr 16 15:09:12 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-36c91fed-316a-48c9-91c2-6e1ba30e0472 tempest-VolumesTransfersTest-2042875671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-d099e0aa-b7ec-428c-96ce-3670a9d600c2 1073741824" returned: 0 in 0.602s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:09:12 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-36c91fed-316a-48c9-91c2-6e1ba30e0472 tempest-VolumesTransfersTest-2042875671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-d099e0aa-b7ec-428c-96ce-3670a9d600c2 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:09:12 devstack sudo[87515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-d099e0aa-b7ec-428c-96ce-3670a9d600c2 Apr 16 15:09:12 devstack sudo[87515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:09:12 devstack sudo[87515]: pam_unix(sudo:session): session closed for user root Apr 16 15:09:12 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-36c91fed-316a-48c9-91c2-6e1ba30e0472 tempest-VolumesTransfersTest-2042875671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-d099e0aa-b7ec-428c-96ce-3670a9d600c2" returned: 0 in 0.473s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:09:12 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-36c91fed-316a-48c9-91c2-6e1ba30e0472 tempest-VolumesTransfersTest-2042875671 None] <== create_volume: return (1098ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'} {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 15:09:12 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-36c91fed-316a-48c9-91c2-6e1ba30e0472 tempest-VolumesTransfersTest-2042875671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.101s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:09:12 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-36c91fed-316a-48c9-91c2-6e1ba30e0472 tempest-VolumesTransfersTest-2042875671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (686af0bc-db2e-4bf3-9799-7eed09128c4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d099e0aa-b7ec-428c-96ce-3670a9d600c2', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:09:12 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-36c91fed-316a-48c9-91c2-6e1ba30e0472 tempest-VolumesTransfersTest-2042875671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29553137-adbb-4b11-bd3c-09d82bd18b6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:09:12 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-36c91fed-316a-48c9-91c2-6e1ba30e0472 tempest-VolumesTransfersTest-2042875671 None] Volume volume-d099e0aa-b7ec-428c-96ce-3670a9d600c2 (d099e0aa-b7ec-428c-96ce-3670a9d600c2): created successfully Apr 16 15:09:12 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-36c91fed-316a-48c9-91c2-6e1ba30e0472 tempest-VolumesTransfersTest-2042875671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29553137-adbb-4b11-bd3c-09d82bd18b6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:09:12 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-36c91fed-316a-48c9-91c2-6e1ba30e0472 tempest-VolumesTransfersTest-2042875671 None] Flow 'volume_create_manager' (7cdddb66-bced-4528-b57a-6181dd2af0ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:09:12 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-36c91fed-316a-48c9-91c2-6e1ba30e0472 tempest-VolumesTransfersTest-2042875671 None] Created volume successfully. Apr 16 15:09:12 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a018eda-6147-4557-8cde-03d0f62ece31 tempest-VolumesSnapshotTestJSON-1827115803 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82756) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 15:09:13 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-1a018eda-6147-4557-8cde-03d0f62ece31 tempest-VolumesSnapshotTestJSON-1827115803 None] Flow 'volume_create_manager' (ee9ba9c6-0810-4a81-bc1e-5bce6e9fa794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:09:13 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-1a018eda-6147-4557-8cde-03d0f62ece31 tempest-VolumesSnapshotTestJSON-1827115803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bed942f8-e89d-4f80-9292-a4002293fa02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:09:13 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-1a018eda-6147-4557-8cde-03d0f62ece31 tempest-VolumesSnapshotTestJSON-1827115803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bed942f8-e89d-4f80-9292-a4002293fa02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:09:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-803340973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da91d0c6-4a0c-4c3f-9924-da8469f9a4d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e188a76e5efd467e8c860aa308f861b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:09:13Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=96477a24-9f3f-4387-90ff-f4f0dd05dafe,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:09:13Z,use_quota=True,user_id='0c5eb9cbc4334877925458d81eec542d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:09:13 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-1a018eda-6147-4557-8cde-03d0f62ece31 tempest-VolumesSnapshotTestJSON-1827115803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74d48d09-4d5f-42e7-aa2a-28acfdff53d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:09:13 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-1a018eda-6147-4557-8cde-03d0f62ece31 tempest-VolumesSnapshotTestJSON-1827115803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74d48d09-4d5f-42e7-aa2a-28acfdff53d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:09:13 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-1a018eda-6147-4557-8cde-03d0f62ece31 tempest-VolumesSnapshotTestJSON-1827115803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a151ff62-e205-4259-ae5b-fe607cfe89c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:09:13 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-1a018eda-6147-4557-8cde-03d0f62ece31 tempest-VolumesSnapshotTestJSON-1827115803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a151ff62-e205-4259-ae5b-fe607cfe89c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'da91d0c6-4a0c-4c3f-9924-da8469f9a4d9', 'volume_name': 'volume-da91d0c6-4a0c-4c3f-9924-da8469f9a4d9', 'volume_size': 2, 'snapshot_id': '96477a24-9f3f-4387-90ff-f4f0dd05dafe'}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:09:13 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-1a018eda-6147-4557-8cde-03d0f62ece31 tempest-VolumesSnapshotTestJSON-1827115803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (361a15f7-2d46-4812-a78b-6a78e78f5391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:09:13 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-1a018eda-6147-4557-8cde-03d0f62ece31 tempest-VolumesSnapshotTestJSON-1827115803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (361a15f7-2d46-4812-a78b-6a78e78f5391) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:09:13 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-1a018eda-6147-4557-8cde-03d0f62ece31 tempest-VolumesSnapshotTestJSON-1827115803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d56176da-a2e5-4746-8957-5d416ac7b6ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:09:13 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-1a018eda-6147-4557-8cde-03d0f62ece31 tempest-VolumesSnapshotTestJSON-1827115803 None] Volume da91d0c6-4a0c-4c3f-9924-da8469f9a4d9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-da91d0c6-4a0c-4c3f-9924-da8469f9a4d9', 'volume_size': 2, 'snapshot_id': '96477a24-9f3f-4387-90ff-f4f0dd05dafe'} Apr 16 15:09:13 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-1a018eda-6147-4557-8cde-03d0f62ece31 tempest-VolumesSnapshotTestJSON-1827115803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:09:13 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-1a018eda-6147-4557-8cde-03d0f62ece31 tempest-VolumesSnapshotTestJSON-1827115803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:09:13 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-1a018eda-6147-4557-8cde-03d0f62ece31 tempest-VolumesSnapshotTestJSON-1827115803 None] Acquiring lock "cinder-quobyte-96477a24-9f3f-4387-90ff-f4f0dd05dafe-da91d0c6-4a0c-4c3f-9924-da8469f9a4d9" by "_create_volume_from_snapshot" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:09:13 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-1a018eda-6147-4557-8cde-03d0f62ece31 tempest-VolumesSnapshotTestJSON-1827115803 None] Lock "cinder-quobyte-96477a24-9f3f-4387-90ff-f4f0dd05dafe-da91d0c6-4a0c-4c3f-9924-da8469f9a4d9" acquired by "_create_volume_from_snapshot" :: waited 0.010s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:09:13 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-1a018eda-6147-4557-8cde-03d0f62ece31 tempest-VolumesSnapshotTestJSON-1827115803 None] Creating volume da91d0c6-4a0c-4c3f-9924-da8469f9a4d9 from snapshot 96477a24-9f3f-4387-90ff-f4f0dd05dafe {{(pid=82756) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 16 15:09:13 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-1a018eda-6147-4557-8cde-03d0f62ece31 tempest-VolumesSnapshotTestJSON-1827115803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:09:13 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-1a018eda-6147-4557-8cde-03d0f62ece31 tempest-VolumesSnapshotTestJSON-1827115803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:09:13 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-1a018eda-6147-4557-8cde-03d0f62ece31 tempest-VolumesSnapshotTestJSON-1827115803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:09:13 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-1a018eda-6147-4557-8cde-03d0f62ece31 tempest-VolumesSnapshotTestJSON-1827115803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:09:13 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-1a018eda-6147-4557-8cde-03d0f62ece31 tempest-VolumesSnapshotTestJSON-1827115803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:09:13 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-1a018eda-6147-4557-8cde-03d0f62ece31 tempest-VolumesSnapshotTestJSON-1827115803 None] Selected osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 as target Quobyte volume. {{(pid=82756) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 15:09:13 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-1a018eda-6147-4557-8cde-03d0f62ece31 tempest-VolumesSnapshotTestJSON-1827115803 None] Acquiring lock "cinder-quobyte-da91d0c6-4a0c-4c3f-9924-da8469f9a4d9" by "_copy_volume_from_snapshot" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:09:13 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-1a018eda-6147-4557-8cde-03d0f62ece31 tempest-VolumesSnapshotTestJSON-1827115803 None] Lock "cinder-quobyte-da91d0c6-4a0c-4c3f-9924-da8469f9a4d9" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:09:13 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-1a018eda-6147-4557-8cde-03d0f62ece31 tempest-VolumesSnapshotTestJSON-1827115803 None] snapshot: 96477a24-9f3f-4387-90ff-f4f0dd05dafe, volume: da91d0c6-4a0c-4c3f-9924-da8469f9a4d9, {{(pid=82756) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 16 15:09:13 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-1a018eda-6147-4557-8cde-03d0f62ece31 tempest-VolumesSnapshotTestJSON-1827115803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:09:13 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-1a018eda-6147-4557-8cde-03d0f62ece31 tempest-VolumesSnapshotTestJSON-1827115803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:09:13 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-1a018eda-6147-4557-8cde-03d0f62ece31 tempest-VolumesSnapshotTestJSON-1827115803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:09:13 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-1a018eda-6147-4557-8cde-03d0f62ece31 tempest-VolumesSnapshotTestJSON-1827115803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:09:13 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-1a018eda-6147-4557-8cde-03d0f62ece31 tempest-VolumesSnapshotTestJSON-1827115803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:09:13 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e8ee6c0-c64e-41d2-a104-1e139a7009ae]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:09:13 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-1a018eda-6147-4557-8cde-03d0f62ece31 tempest-VolumesSnapshotTestJSON-1827115803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-14a4c862-6a20-4759-8283-c993f06e3d25.96477a24-9f3f-4387-90ff-f4f0dd05dafe {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:09:13 devstack sudo[87518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-14a4c862-6a20-4759-8283-c993f06e3d25.96477a24-9f3f-4387-90ff-f4f0dd05dafe Apr 16 15:09:13 devstack sudo[87518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:09:13 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-3c367d85-c146-4eca-b287-9f53703da6b4 tempest-VolumesTransfersTest-1537372329 None] Transfer volume completed successfully. Apr 16 15:09:13 devstack sudo[87518]: pam_unix(sudo:session): session closed for user root Apr 16 15:09:13 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-1a018eda-6147-4557-8cde-03d0f62ece31 tempest-VolumesSnapshotTestJSON-1827115803 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-14a4c862-6a20-4759-8283-c993f06e3d25.96477a24-9f3f-4387-90ff-f4f0dd05dafe" returned: 0 in 0.694s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:09:13 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-1a018eda-6147-4557-8cde-03d0f62ece31 tempest-VolumesSnapshotTestJSON-1827115803 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-14a4c862-6a20-4759-8283-c993f06e3d25(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82756) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 15:09:13 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-1a018eda-6147-4557-8cde-03d0f62ece31 tempest-VolumesSnapshotTestJSON-1827115803 None] will copy from snapshot at /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-14a4c862-6a20-4759-8283-c993f06e3d25 {{(pid=82756) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 16 15:09:13 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-1a018eda-6147-4557-8cde-03d0f62ece31 tempest-VolumesSnapshotTestJSON-1827115803 None] Creating direct copy from snapshot {{(pid=82756) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 16 15:09:13 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1430095-9f91-4e5b-8efd-bee1b1a63a39]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:09:13 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-1a018eda-6147-4557-8cde-03d0f62ece31 tempest-VolumesSnapshotTestJSON-1827115803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-14a4c862-6a20-4759-8283-c993f06e3d25 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:09:14 devstack sudo[87525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-14a4c862-6a20-4759-8283-c993f06e3d25 Apr 16 15:09:14 devstack sudo[87525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:09:14 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-46739076-5443-458e-b8ec-8fe02528be39 tempest-VolumesTransfersTest-608901207 None] Acquiring lock "cinder-d099e0aa-b7ec-428c-96ce-3670a9d600c2-delete_volume" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:09:14 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-46739076-5443-458e-b8ec-8fe02528be39 tempest-VolumesTransfersTest-608901207 None] Lock "cinder-d099e0aa-b7ec-428c-96ce-3670a9d600c2-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:09:14 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-46739076-5443-458e-b8ec-8fe02528be39 tempest-VolumesTransfersTest-608901207 None] Acquiring lock "cinder-quobyte-d099e0aa-b7ec-428c-96ce-3670a9d600c2" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:09:14 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-46739076-5443-458e-b8ec-8fe02528be39 tempest-VolumesTransfersTest-608901207 None] Lock "cinder-quobyte-d099e0aa-b7ec-428c-96ce-3670a9d600c2" acquired by "delete_volume" :: waited 0.013s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:09:14 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[4939db71-289a-4c91-856a-d4fea24ed711]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:09:14 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-46739076-5443-458e-b8ec-8fe02528be39 tempest-VolumesTransfersTest-608901207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-d099e0aa-b7ec-428c-96ce-3670a9d600c2 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:09:14 devstack sudo[87525]: pam_unix(sudo:session): session closed for user root Apr 16 15:09:14 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-1a018eda-6147-4557-8cde-03d0f62ece31 tempest-VolumesSnapshotTestJSON-1827115803 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-14a4c862-6a20-4759-8283-c993f06e3d25" returned: 0 in 0.688s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:09:14 devstack cinder-volume[82756]: DEBUG cinder.utils [None req-1a018eda-6147-4557-8cde-03d0f62ece31 tempest-VolumesSnapshotTestJSON-1827115803 None] Path /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-da91d0c6-4a0c-4c3f-9924-da8469f9a4d9 not found in is_blk_device check {{(pid=82756) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 16 15:09:14 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-1a018eda-6147-4557-8cde-03d0f62ece31 tempest-VolumesSnapshotTestJSON-1827115803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-14a4c862-6a20-4759-8283-c993f06e3d25 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-da91d0c6-4a0c-4c3f-9924-da8469f9a4d9 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:09:14 devstack sudo[87531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-14a4c862-6a20-4759-8283-c993f06e3d25 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-da91d0c6-4a0c-4c3f-9924-da8469f9a4d9 Apr 16 15:09:14 devstack sudo[87531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:09:14 devstack sudo[87530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-d099e0aa-b7ec-428c-96ce-3670a9d600c2 Apr 16 15:09:14 devstack sudo[87530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:09:15 devstack sudo[87530]: pam_unix(sudo:session): session closed for user root Apr 16 15:09:15 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-46739076-5443-458e-b8ec-8fe02528be39 tempest-VolumesTransfersTest-608901207 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-d099e0aa-b7ec-428c-96ce-3670a9d600c2" returned: 0 in 0.599s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:09:15 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-46739076-5443-458e-b8ec-8fe02528be39 tempest-VolumesTransfersTest-608901207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-d099e0aa-b7ec-428c-96ce-3670a9d600c2 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:09:15 devstack sudo[87538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-d099e0aa-b7ec-428c-96ce-3670a9d600c2 Apr 16 15:09:15 devstack sudo[87538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:09:16 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-d2628e06-cec8-4250-84a7-84c7ac38e8bf tempest-VolumesActionsTest-570492233 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:09:16 devstack sudo[87538]: pam_unix(sudo:session): session closed for user root Apr 16 15:09:16 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-46739076-5443-458e-b8ec-8fe02528be39 tempest-VolumesTransfersTest-608901207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-d099e0aa-b7ec-428c-96ce-3670a9d600c2" returned: 0 in 1.677s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:09:16 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-46739076-5443-458e-b8ec-8fe02528be39 tempest-VolumesTransfersTest-608901207 None] Lock "cinder-quobyte-d099e0aa-b7ec-428c-96ce-3670a9d600c2" released by "delete_volume" :: held 2.304s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:09:16 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-46739076-5443-458e-b8ec-8fe02528be39 tempest-VolumesTransfersTest-608901207 None] Created reservations ['9639d919-d49a-411a-a628-ba610adf5752', '81adf6e1-1669-4e2f-87c1-0213d6ec3cae', '79c6de10-5ddd-49b3-8ba1-11c05b2bcc11', 'c65f5725-a35c-4613-9469-70d236dc3ec5'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:09:17 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-46739076-5443-458e-b8ec-8fe02528be39 tempest-VolumesTransfersTest-608901207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:09:17 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-46739076-5443-458e-b8ec-8fe02528be39 tempest-VolumesTransfersTest-608901207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:09:17 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-46739076-5443-458e-b8ec-8fe02528be39 tempest-VolumesTransfersTest-608901207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:09:17 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-46739076-5443-458e-b8ec-8fe02528be39 tempest-VolumesTransfersTest-608901207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:09:17 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-46739076-5443-458e-b8ec-8fe02528be39 tempest-VolumesTransfersTest-608901207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:09:17 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-46739076-5443-458e-b8ec-8fe02528be39 tempest-VolumesTransfersTest-608901207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:09:17 devstack sudo[87553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:09:17 devstack sudo[87553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:09:17 devstack sudo[87531]: pam_unix(sudo:session): session closed for user root Apr 16 15:09:17 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-1a018eda-6147-4557-8cde-03d0f62ece31 tempest-VolumesSnapshotTestJSON-1827115803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-14a4c862-6a20-4759-8283-c993f06e3d25 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-da91d0c6-4a0c-4c3f-9924-da8469f9a4d9" returned: 0 in 2.534s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:09:17 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[600cc7e9-b3c4-4e58-bb51-b34fd1cbeb53]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:09:17 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-1a018eda-6147-4557-8cde-03d0f62ece31 tempest-VolumesSnapshotTestJSON-1827115803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-14a4c862-6a20-4759-8283-c993f06e3d25 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:09:17 devstack sudo[87555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-14a4c862-6a20-4759-8283-c993f06e3d25 Apr 16 15:09:17 devstack sudo[87555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:09:17 devstack sudo[87553]: pam_unix(sudo:session): session closed for user root Apr 16 15:09:17 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-46739076-5443-458e-b8ec-8fe02528be39 tempest-VolumesTransfersTest-608901207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.428s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:09:17 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-46739076-5443-458e-b8ec-8fe02528be39 tempest-VolumesTransfersTest-608901207 None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:09:17 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-46739076-5443-458e-b8ec-8fe02528be39 tempest-VolumesTransfersTest-608901207 None] Deleted volume successfully. Apr 16 15:09:17 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-46739076-5443-458e-b8ec-8fe02528be39 tempest-VolumesTransfersTest-608901207 None] Lock "cinder-d099e0aa-b7ec-428c-96ce-3670a9d600c2-delete_volume" released by "delete_volume" :: held 3.062s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:09:17 devstack sudo[87555]: pam_unix(sudo:session): session closed for user root Apr 16 15:09:17 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-1a018eda-6147-4557-8cde-03d0f62ece31 tempest-VolumesSnapshotTestJSON-1827115803 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-14a4c862-6a20-4759-8283-c993f06e3d25" returned: 0 in 0.636s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:09:17 devstack cinder-volume[82756]: DEBUG cinder.image.image_utils [None req-1a018eda-6147-4557-8cde-03d0f62ece31 tempest-VolumesSnapshotTestJSON-1827115803 None] Image conversion details: src /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-14a4c862-6a20-4759-8283-c993f06e3d25, size 1024.00 MB, duration 2.54 sec, destination /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-da91d0c6-4a0c-4c3f-9924-da8469f9a4d9 {{(pid=82756) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 15:09:17 devstack cinder-volume[82756]: INFO cinder.image.image_utils [None req-1a018eda-6147-4557-8cde-03d0f62ece31 tempest-VolumesSnapshotTestJSON-1827115803 None] Converted 1024.00 MB image at 403.93 MB/s Apr 16 15:09:17 devstack cinder-volume[82756]: WARNING cinder.volume.drivers.remotefs [None req-1a018eda-6147-4557-8cde-03d0f62ece31 tempest-VolumesSnapshotTestJSON-1827115803 None] /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-da91d0c6-4a0c-4c3f-9924-da8469f9a4d9 is being set with open permissions: ugo+rw Apr 16 15:09:17 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-1a018eda-6147-4557-8cde-03d0f62ece31 tempest-VolumesSnapshotTestJSON-1827115803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-da91d0c6-4a0c-4c3f-9924-da8469f9a4d9 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:09:17 devstack sudo[87561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-da91d0c6-4a0c-4c3f-9924-da8469f9a4d9 Apr 16 15:09:17 devstack sudo[87561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:09:18 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [None req-06714842-83b2-4a94-af47-c1e4b7907088 tempest-VolumesTransfersTest-2042875671 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82756) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 15:09:18 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-06714842-83b2-4a94-af47-c1e4b7907088 tempest-VolumesTransfersTest-2042875671 None] Flow 'volume_create_manager' (081351bf-5da5-4d6a-82d5-735196e89fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:09:18 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-06714842-83b2-4a94-af47-c1e4b7907088 tempest-VolumesTransfersTest-2042875671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0eb65613-8365-4d5c-87da-2742767bfe64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:09:18 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-06714842-83b2-4a94-af47-c1e4b7907088 tempest-VolumesTransfersTest-2042875671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0eb65613-8365-4d5c-87da-2742767bfe64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:09:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-854067013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad5b0f47-5590-40a2-811d-d7fefacea90d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c275319c01b4ada96ca8f1ecd099870',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:09:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:09:18Z,use_quota=True,user_id='8cfab9df560249fdbbe49f0121ae33b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:09:18 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-06714842-83b2-4a94-af47-c1e4b7907088 tempest-VolumesTransfersTest-2042875671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1c3cd97-635e-4d1d-9c38-322f3d5701e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:09:18 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-06714842-83b2-4a94-af47-c1e4b7907088 tempest-VolumesTransfersTest-2042875671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1c3cd97-635e-4d1d-9c38-322f3d5701e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:09:18 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-06714842-83b2-4a94-af47-c1e4b7907088 tempest-VolumesTransfersTest-2042875671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (237a5347-cd48-4913-af3e-d2baf2f088a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:09:18 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-06714842-83b2-4a94-af47-c1e4b7907088 tempest-VolumesTransfersTest-2042875671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (237a5347-cd48-4913-af3e-d2baf2f088a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad5b0f47-5590-40a2-811d-d7fefacea90d', 'volume_name': 'volume-ad5b0f47-5590-40a2-811d-d7fefacea90d', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:09:18 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-06714842-83b2-4a94-af47-c1e4b7907088 tempest-VolumesTransfersTest-2042875671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6258801-c4de-4d85-8b95-eb05ed138388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:09:18 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-06714842-83b2-4a94-af47-c1e4b7907088 tempest-VolumesTransfersTest-2042875671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6258801-c4de-4d85-8b95-eb05ed138388) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:09:18 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-06714842-83b2-4a94-af47-c1e4b7907088 tempest-VolumesTransfersTest-2042875671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (970e389d-2dec-4fa3-8379-bacb55a1bccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:09:18 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-06714842-83b2-4a94-af47-c1e4b7907088 tempest-VolumesTransfersTest-2042875671 None] Volume ad5b0f47-5590-40a2-811d-d7fefacea90d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad5b0f47-5590-40a2-811d-d7fefacea90d', 'volume_size': 1} Apr 16 15:09:18 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-06714842-83b2-4a94-af47-c1e4b7907088 tempest-VolumesTransfersTest-2042875671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:09:18 devstack sudo[87561]: pam_unix(sudo:session): session closed for user root Apr 16 15:09:18 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-1a018eda-6147-4557-8cde-03d0f62ece31 tempest-VolumesSnapshotTestJSON-1827115803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-da91d0c6-4a0c-4c3f-9924-da8469f9a4d9" returned: 0 in 0.470s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:09:18 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-1a018eda-6147-4557-8cde-03d0f62ece31 tempest-VolumesSnapshotTestJSON-1827115803 None] Lock "cinder-quobyte-da91d0c6-4a0c-4c3f-9924-da8469f9a4d9" released by "_copy_volume_from_snapshot" :: held 5.108s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:09:18 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-1a018eda-6147-4557-8cde-03d0f62ece31 tempest-VolumesSnapshotTestJSON-1827115803 None] Lock "cinder-quobyte-96477a24-9f3f-4387-90ff-f4f0dd05dafe-da91d0c6-4a0c-4c3f-9924-da8469f9a4d9" released by "_create_volume_from_snapshot" :: held 5.157s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:09:18 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-1a018eda-6147-4557-8cde-03d0f62ece31 tempest-VolumesSnapshotTestJSON-1827115803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.168s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:09:18 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-d2628e06-cec8-4250-84a7-84c7ac38e8bf tempest-VolumesActionsTest-570492233 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.493s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:09:18 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[abdbaa4a-5b7f-4107-a369-52f92db22beb]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:09:18 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-d2628e06-cec8-4250-84a7-84c7ac38e8bf tempest-VolumesActionsTest-570492233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c1fe4c2f-0039-4d10-b121-1dbbbdb434fa {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:09:18 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-1a018eda-6147-4557-8cde-03d0f62ece31 tempest-VolumesSnapshotTestJSON-1827115803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d56176da-a2e5-4746-8957-5d416ac7b6ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da91d0c6-4a0c-4c3f-9924-da8469f9a4d9', 'volume_size': 2, 'snapshot_id': '96477a24-9f3f-4387-90ff-f4f0dd05dafe'}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:09:18 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-1a018eda-6147-4557-8cde-03d0f62ece31 tempest-VolumesSnapshotTestJSON-1827115803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9214fac0-4eec-481f-a829-4b3ae8c10ebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:09:18 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-1a018eda-6147-4557-8cde-03d0f62ece31 tempest-VolumesSnapshotTestJSON-1827115803 None] Volume volume-da91d0c6-4a0c-4c3f-9924-da8469f9a4d9 (da91d0c6-4a0c-4c3f-9924-da8469f9a4d9): created successfully Apr 16 15:09:18 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-1a018eda-6147-4557-8cde-03d0f62ece31 tempest-VolumesSnapshotTestJSON-1827115803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9214fac0-4eec-481f-a829-4b3ae8c10ebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:09:18 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-1a018eda-6147-4557-8cde-03d0f62ece31 tempest-VolumesSnapshotTestJSON-1827115803 None] Flow 'volume_create_manager' (ee9ba9c6-0810-4a81-bc1e-5bce6e9fa794) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:09:18 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-1a018eda-6147-4557-8cde-03d0f62ece31 tempest-VolumesSnapshotTestJSON-1827115803 None] Created volume successfully. Apr 16 15:09:18 devstack sudo[87564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c1fe4c2f-0039-4d10-b121-1dbbbdb434fa Apr 16 15:09:18 devstack sudo[87564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:09:18 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-e9838473-8cbf-4ed4-a93c-5902de43793c tempest-VolumesSnapshotTestJSON-1827115803 None] Acquiring lock "cinder-da91d0c6-4a0c-4c3f-9924-da8469f9a4d9-delete_volume" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:09:18 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-e9838473-8cbf-4ed4-a93c-5902de43793c tempest-VolumesSnapshotTestJSON-1827115803 None] Lock "cinder-da91d0c6-4a0c-4c3f-9924-da8469f9a4d9-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:09:18 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-e9838473-8cbf-4ed4-a93c-5902de43793c tempest-VolumesSnapshotTestJSON-1827115803 None] Acquiring lock "cinder-quobyte-da91d0c6-4a0c-4c3f-9924-da8469f9a4d9" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:09:18 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-e9838473-8cbf-4ed4-a93c-5902de43793c tempest-VolumesSnapshotTestJSON-1827115803 None] Lock "cinder-quobyte-da91d0c6-4a0c-4c3f-9924-da8469f9a4d9" acquired by "delete_volume" :: waited 0.012s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:09:18 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[cce48088-fda6-4774-abe5-04ed930da629]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:09:18 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-e9838473-8cbf-4ed4-a93c-5902de43793c tempest-VolumesSnapshotTestJSON-1827115803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-da91d0c6-4a0c-4c3f-9924-da8469f9a4d9 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:09:18 devstack sudo[87566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-da91d0c6-4a0c-4c3f-9924-da8469f9a4d9 Apr 16 15:09:18 devstack sudo[87566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:09:18 devstack sudo[87564]: pam_unix(sudo:session): session closed for user root Apr 16 15:09:18 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-d2628e06-cec8-4250-84a7-84c7ac38e8bf tempest-VolumesActionsTest-570492233 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c1fe4c2f-0039-4d10-b121-1dbbbdb434fa" returned: 0 in 0.571s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:09:18 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1cc1f6b-bbe2-404b-b013-9bf41ec15334]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:09:18 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-d2628e06-cec8-4250-84a7-84c7ac38e8bf tempest-VolumesActionsTest-570492233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c1fe4c2f-0039-4d10-b121-1dbbbdb434fa {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:09:18 devstack sudo[87571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c1fe4c2f-0039-4d10-b121-1dbbbdb434fa Apr 16 15:09:18 devstack sudo[87571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:09:19 devstack sudo[87566]: pam_unix(sudo:session): session closed for user root Apr 16 15:09:19 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-e9838473-8cbf-4ed4-a93c-5902de43793c tempest-VolumesSnapshotTestJSON-1827115803 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-da91d0c6-4a0c-4c3f-9924-da8469f9a4d9" returned: 0 in 0.576s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:09:19 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-e9838473-8cbf-4ed4-a93c-5902de43793c tempest-VolumesSnapshotTestJSON-1827115803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-da91d0c6-4a0c-4c3f-9924-da8469f9a4d9 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:09:19 devstack sudo[87576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-da91d0c6-4a0c-4c3f-9924-da8469f9a4d9 Apr 16 15:09:19 devstack sudo[87576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:09:19 devstack sudo[87571]: pam_unix(sudo:session): session closed for user root Apr 16 15:09:19 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-d2628e06-cec8-4250-84a7-84c7ac38e8bf tempest-VolumesActionsTest-570492233 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c1fe4c2f-0039-4d10-b121-1dbbbdb434fa" returned: 0 in 0.589s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:09:19 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-d2628e06-cec8-4250-84a7-84c7ac38e8bf tempest-VolumesActionsTest-570492233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c1fe4c2f-0039-4d10-b121-1dbbbdb434fa /opt/stack/data/cinder/conversion/c1fe4c2f-0039-4d10-b121-1dbbbdb434fa.temp_image.8255f6a6-5416-49a1-8006-37f922b2ca01n47d3t6c.img {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:09:19 devstack sudo[87581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c1fe4c2f-0039-4d10-b121-1dbbbdb434fa /opt/stack/data/cinder/conversion/c1fe4c2f-0039-4d10-b121-1dbbbdb434fa.temp_image.8255f6a6-5416-49a1-8006-37f922b2ca01n47d3t6c.img Apr 16 15:09:19 devstack sudo[87581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:09:19 devstack sudo[87576]: pam_unix(sudo:session): session closed for user root Apr 16 15:09:19 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-e9838473-8cbf-4ed4-a93c-5902de43793c tempest-VolumesSnapshotTestJSON-1827115803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-da91d0c6-4a0c-4c3f-9924-da8469f9a4d9" returned: 0 in 0.418s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:09:19 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-e9838473-8cbf-4ed4-a93c-5902de43793c tempest-VolumesSnapshotTestJSON-1827115803 None] Lock "cinder-quobyte-da91d0c6-4a0c-4c3f-9924-da8469f9a4d9" released by "delete_volume" :: held 1.021s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:09:19 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-e9838473-8cbf-4ed4-a93c-5902de43793c tempest-VolumesSnapshotTestJSON-1827115803 None] Created reservations ['6e072753-62f7-4d1d-9fbe-3327a076c37f', '7bfaa17c-935c-4483-b5d1-9dce34c64f12', 'bfca506b-5859-44c9-9fd8-c9ea921d5e36', '7fe7511e-8c44-4ed4-8087-8c024e008f27'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:09:19 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-e9838473-8cbf-4ed4-a93c-5902de43793c tempest-VolumesSnapshotTestJSON-1827115803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:09:19 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-e9838473-8cbf-4ed4-a93c-5902de43793c tempest-VolumesSnapshotTestJSON-1827115803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:09:19 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-e9838473-8cbf-4ed4-a93c-5902de43793c tempest-VolumesSnapshotTestJSON-1827115803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:09:19 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-e9838473-8cbf-4ed4-a93c-5902de43793c tempest-VolumesSnapshotTestJSON-1827115803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:09:19 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-e9838473-8cbf-4ed4-a93c-5902de43793c tempest-VolumesSnapshotTestJSON-1827115803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:09:19 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-e9838473-8cbf-4ed4-a93c-5902de43793c tempest-VolumesSnapshotTestJSON-1827115803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:09:19 devstack sudo[87584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:09:19 devstack sudo[87584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:09:20 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-9372d60f-900c-4493-a1e4-776c24cda803 tempest-VolumesSnapshotTestJSON-1827115803 None] Acquiring lock "cinder-96477a24-9f3f-4387-90ff-f4f0dd05dafe-delete_snapshot" by "delete_snapshot" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:09:20 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-9372d60f-900c-4493-a1e4-776c24cda803 tempest-VolumesSnapshotTestJSON-1827115803 None] Lock "cinder-96477a24-9f3f-4387-90ff-f4f0dd05dafe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:09:20 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-9372d60f-900c-4493-a1e4-776c24cda803 tempest-VolumesSnapshotTestJSON-1827115803 None] Acquiring lock "cinder-quobyte-14a4c862-6a20-4759-8283-c993f06e3d25" by "delete_snapshot" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:09:20 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-9372d60f-900c-4493-a1e4-776c24cda803 tempest-VolumesSnapshotTestJSON-1827115803 None] Lock "cinder-quobyte-14a4c862-6a20-4759-8283-c993f06e3d25" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:09:20 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-9372d60f-900c-4493-a1e4-776c24cda803 tempest-VolumesSnapshotTestJSON-1827115803 None] Acquiring lock "cinder-quobyte-96477a24-9f3f-4387-90ff-f4f0dd05dafe" by "_delete_snapshot" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:09:21 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-9372d60f-900c-4493-a1e4-776c24cda803 tempest-VolumesSnapshotTestJSON-1827115803 None] Lock "cinder-quobyte-96477a24-9f3f-4387-90ff-f4f0dd05dafe" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:09:21 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-9372d60f-900c-4493-a1e4-776c24cda803 tempest-VolumesSnapshotTestJSON-1827115803 None] Deleting offline snapshot 96477a24-9f3f-4387-90ff-f4f0dd05dafe of volume 14a4c862-6a20-4759-8283-c993f06e3d25 {{(pid=82756) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 15:09:21 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-9372d60f-900c-4493-a1e4-776c24cda803 tempest-VolumesSnapshotTestJSON-1827115803 None] snapshot_file for this snap is: volume-14a4c862-6a20-4759-8283-c993f06e3d25.96477a24-9f3f-4387-90ff-f4f0dd05dafe {{(pid=82756) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 15:09:21 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f058a1a-daaf-4854-b155-f74f9da266b1]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:09:21 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-9372d60f-900c-4493-a1e4-776c24cda803 tempest-VolumesSnapshotTestJSON-1827115803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-14a4c862-6a20-4759-8283-c993f06e3d25.96477a24-9f3f-4387-90ff-f4f0dd05dafe {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:09:21 devstack sudo[87597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-14a4c862-6a20-4759-8283-c993f06e3d25.96477a24-9f3f-4387-90ff-f4f0dd05dafe Apr 16 15:09:21 devstack sudo[87597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:09:21 devstack sudo[87584]: pam_unix(sudo:session): session closed for user root Apr 16 15:09:21 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-e9838473-8cbf-4ed4-a93c-5902de43793c tempest-VolumesSnapshotTestJSON-1827115803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 1.871s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:09:21 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-e9838473-8cbf-4ed4-a93c-5902de43793c tempest-VolumesSnapshotTestJSON-1827115803 None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:09:21 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-e9838473-8cbf-4ed4-a93c-5902de43793c tempest-VolumesSnapshotTestJSON-1827115803 None] Deleted volume successfully. Apr 16 15:09:21 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-e9838473-8cbf-4ed4-a93c-5902de43793c tempest-VolumesSnapshotTestJSON-1827115803 None] Lock "cinder-da91d0c6-4a0c-4c3f-9924-da8469f9a4d9-delete_volume" released by "delete_volume" :: held 3.084s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:09:21 devstack sudo[87581]: pam_unix(sudo:session): session closed for user root Apr 16 15:09:21 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-d2628e06-cec8-4250-84a7-84c7ac38e8bf tempest-VolumesActionsTest-570492233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c1fe4c2f-0039-4d10-b121-1dbbbdb434fa /opt/stack/data/cinder/conversion/c1fe4c2f-0039-4d10-b121-1dbbbdb434fa.temp_image.8255f6a6-5416-49a1-8006-37f922b2ca01n47d3t6c.img" returned: 0 in 2.337s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:09:21 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[061c4c38-3466-4bac-b39f-471ecdf66f4e]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:09:21 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-d2628e06-cec8-4250-84a7-84c7ac38e8bf tempest-VolumesActionsTest-570492233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c1fe4c2f-0039-4d10-b121-1dbbbdb434fa {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:09:21 devstack sudo[87599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c1fe4c2f-0039-4d10-b121-1dbbbdb434fa Apr 16 15:09:21 devstack sudo[87599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:09:22 devstack sudo[87597]: pam_unix(sudo:session): session closed for user root Apr 16 15:09:22 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-9372d60f-900c-4493-a1e4-776c24cda803 tempest-VolumesSnapshotTestJSON-1827115803 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-14a4c862-6a20-4759-8283-c993f06e3d25.96477a24-9f3f-4387-90ff-f4f0dd05dafe" returned: 0 in 1.061s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:09:22 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-9372d60f-900c-4493-a1e4-776c24cda803 tempest-VolumesSnapshotTestJSON-1827115803 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-14a4c862-6a20-4759-8283-c993f06e3d25(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82756) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 15:09:22 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[1956ff0f-d9eb-4b2c-a991-c30ca56308a9]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:09:22 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-9372d60f-900c-4493-a1e4-776c24cda803 tempest-VolumesSnapshotTestJSON-1827115803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-14a4c862-6a20-4759-8283-c993f06e3d25 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:09:22 devstack sudo[87605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-14a4c862-6a20-4759-8283-c993f06e3d25 Apr 16 15:09:22 devstack sudo[87605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:09:22 devstack sudo[87599]: pam_unix(sudo:session): session closed for user root Apr 16 15:09:22 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-d2628e06-cec8-4250-84a7-84c7ac38e8bf tempest-VolumesActionsTest-570492233 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c1fe4c2f-0039-4d10-b121-1dbbbdb434fa" returned: 0 in 0.661s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:09:22 devstack cinder-volume[82756]: DEBUG cinder.image.image_utils [None req-d2628e06-cec8-4250-84a7-84c7ac38e8bf tempest-VolumesActionsTest-570492233 None] Image conversion details: src /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c1fe4c2f-0039-4d10-b121-1dbbbdb434fa, size 1024.00 MB, duration 2.34 sec, destination /opt/stack/data/cinder/conversion/c1fe4c2f-0039-4d10-b121-1dbbbdb434fa.temp_image.8255f6a6-5416-49a1-8006-37f922b2ca01n47d3t6c.img {{(pid=82756) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 15:09:22 devstack cinder-volume[82756]: INFO cinder.image.image_utils [None req-d2628e06-cec8-4250-84a7-84c7ac38e8bf tempest-VolumesActionsTest-570492233 None] Converted 1024.00 MB image at 437.94 MB/s Apr 16 15:09:22 devstack cinder-volume[82756]: DEBUG cinder.image.image_utils [None req-d2628e06-cec8-4250-84a7-84c7ac38e8bf tempest-VolumesActionsTest-570492233 None] 8255f6a6-5416-49a1-8006-37f922b2ca01 was raw, no need to convert to raw {{(pid=82756) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}} Apr 16 15:09:22 devstack sudo[87605]: pam_unix(sudo:session): session closed for user root Apr 16 15:09:22 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-9372d60f-900c-4493-a1e4-776c24cda803 tempest-VolumesSnapshotTestJSON-1827115803 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-14a4c862-6a20-4759-8283-c993f06e3d25" returned: 0 in 0.570s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:09:22 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-9372d60f-900c-4493-a1e4-776c24cda803 tempest-VolumesSnapshotTestJSON-1827115803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-14a4c862-6a20-4759-8283-c993f06e3d25.96477a24-9f3f-4387-90ff-f4f0dd05dafe {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:09:22 devstack sudo[87613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-14a4c862-6a20-4759-8283-c993f06e3d25.96477a24-9f3f-4387-90ff-f4f0dd05dafe Apr 16 15:09:22 devstack sudo[87613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:09:23 devstack sudo[87613]: pam_unix(sudo:session): session closed for user root Apr 16 15:09:23 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-9372d60f-900c-4493-a1e4-776c24cda803 tempest-VolumesSnapshotTestJSON-1827115803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-14a4c862-6a20-4759-8283-c993f06e3d25.96477a24-9f3f-4387-90ff-f4f0dd05dafe" returned: 0 in 0.679s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:09:23 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-9372d60f-900c-4493-a1e4-776c24cda803 tempest-VolumesSnapshotTestJSON-1827115803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-14a4c862-6a20-4759-8283-c993f06e3d25.96477a24-9f3f-4387-90ff-f4f0dd05dafe {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:09:23 devstack sudo[87619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-14a4c862-6a20-4759-8283-c993f06e3d25.96477a24-9f3f-4387-90ff-f4f0dd05dafe Apr 16 15:09:23 devstack sudo[87619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:09:24 devstack sudo[87619]: pam_unix(sudo:session): session closed for user root Apr 16 15:09:24 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-9372d60f-900c-4493-a1e4-776c24cda803 tempest-VolumesSnapshotTestJSON-1827115803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-14a4c862-6a20-4759-8283-c993f06e3d25.96477a24-9f3f-4387-90ff-f4f0dd05dafe" returned: 0 in 0.646s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:09:24 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-9372d60f-900c-4493-a1e4-776c24cda803 tempest-VolumesSnapshotTestJSON-1827115803 None] Lock "cinder-quobyte-96477a24-9f3f-4387-90ff-f4f0dd05dafe" released by "_delete_snapshot" :: held 3.039s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:09:24 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-9372d60f-900c-4493-a1e4-776c24cda803 tempest-VolumesSnapshotTestJSON-1827115803 None] Lock "cinder-quobyte-14a4c862-6a20-4759-8283-c993f06e3d25" released by "delete_snapshot" :: held 3.062s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:09:24 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-9372d60f-900c-4493-a1e4-776c24cda803 tempest-VolumesSnapshotTestJSON-1827115803 None] Created reservations ['788146b1-dfcf-47ed-a6c6-357eb4f08b1e', '9673cb01-7a79-4f57-b018-0d92640fee3c', '557e27f5-8597-439d-a205-69e29d3daff1', '2d2958d4-2996-4b9d-a128-148da0b3444b'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:09:24 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-9372d60f-900c-4493-a1e4-776c24cda803 tempest-VolumesSnapshotTestJSON-1827115803 None] Delete snapshot completed successfully. Apr 16 15:09:24 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-9372d60f-900c-4493-a1e4-776c24cda803 tempest-VolumesSnapshotTestJSON-1827115803 None] Lock "cinder-96477a24-9f3f-4387-90ff-f4f0dd05dafe-delete_snapshot" released by "delete_snapshot" :: held 3.163s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:09:24 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-ccc06aa3-0538-4898-ac56-bd863f743202 tempest-VolumesSnapshotTestJSON-1827115803 None] Acquiring lock "cinder-14a4c862-6a20-4759-8283-c993f06e3d25-delete_volume" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:09:24 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-ccc06aa3-0538-4898-ac56-bd863f743202 tempest-VolumesSnapshotTestJSON-1827115803 None] Lock "cinder-14a4c862-6a20-4759-8283-c993f06e3d25-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:09:24 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-ccc06aa3-0538-4898-ac56-bd863f743202 tempest-VolumesSnapshotTestJSON-1827115803 None] Acquiring lock "cinder-quobyte-14a4c862-6a20-4759-8283-c993f06e3d25" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:09:24 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-ccc06aa3-0538-4898-ac56-bd863f743202 tempest-VolumesSnapshotTestJSON-1827115803 None] Lock "cinder-quobyte-14a4c862-6a20-4759-8283-c993f06e3d25" acquired by "delete_volume" :: waited 0.015s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:09:24 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[2af2f9db-0ffd-44d1-b897-bcfcac6e8de3]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:09:24 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-ccc06aa3-0538-4898-ac56-bd863f743202 tempest-VolumesSnapshotTestJSON-1827115803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-14a4c862-6a20-4759-8283-c993f06e3d25 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:09:24 devstack sudo[87622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-14a4c862-6a20-4759-8283-c993f06e3d25 Apr 16 15:09:24 devstack sudo[87622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:09:25 devstack sudo[87622]: pam_unix(sudo:session): session closed for user root Apr 16 15:09:25 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-ccc06aa3-0538-4898-ac56-bd863f743202 tempest-VolumesSnapshotTestJSON-1827115803 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-14a4c862-6a20-4759-8283-c993f06e3d25" returned: 0 in 0.722s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:09:25 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-ccc06aa3-0538-4898-ac56-bd863f743202 tempest-VolumesSnapshotTestJSON-1827115803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-14a4c862-6a20-4759-8283-c993f06e3d25 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:09:25 devstack sudo[87627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-14a4c862-6a20-4759-8283-c993f06e3d25 Apr 16 15:09:25 devstack sudo[87627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:09:25 devstack sudo[87627]: pam_unix(sudo:session): session closed for user root Apr 16 15:09:25 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-ccc06aa3-0538-4898-ac56-bd863f743202 tempest-VolumesSnapshotTestJSON-1827115803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-14a4c862-6a20-4759-8283-c993f06e3d25" returned: 0 in 0.584s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:09:25 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-ccc06aa3-0538-4898-ac56-bd863f743202 tempest-VolumesSnapshotTestJSON-1827115803 None] Lock "cinder-quobyte-14a4c862-6a20-4759-8283-c993f06e3d25" released by "delete_volume" :: held 1.358s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:09:25 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-ccc06aa3-0538-4898-ac56-bd863f743202 tempest-VolumesSnapshotTestJSON-1827115803 None] Created reservations ['7d575810-6296-4721-88a6-5b7e17a5deac', 'acf5e584-b71c-4d77-9d4e-08554af87070', '2fed45fb-a8f4-4fa1-a6a8-7de53a7fdedc', '0640385e-976d-4138-9353-178a86152def'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:09:25 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-ccc06aa3-0538-4898-ac56-bd863f743202 tempest-VolumesSnapshotTestJSON-1827115803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:09:25 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-ccc06aa3-0538-4898-ac56-bd863f743202 tempest-VolumesSnapshotTestJSON-1827115803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:09:25 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-ccc06aa3-0538-4898-ac56-bd863f743202 tempest-VolumesSnapshotTestJSON-1827115803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:09:25 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-ccc06aa3-0538-4898-ac56-bd863f743202 tempest-VolumesSnapshotTestJSON-1827115803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:09:25 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-ccc06aa3-0538-4898-ac56-bd863f743202 tempest-VolumesSnapshotTestJSON-1827115803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:09:25 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-ccc06aa3-0538-4898-ac56-bd863f743202 tempest-VolumesSnapshotTestJSON-1827115803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:09:25 devstack sudo[87630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:09:25 devstack sudo[87630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:09:26 devstack sudo[87630]: pam_unix(sudo:session): session closed for user root Apr 16 15:09:26 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-ccc06aa3-0538-4898-ac56-bd863f743202 tempest-VolumesSnapshotTestJSON-1827115803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.589s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:09:26 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-ccc06aa3-0538-4898-ac56-bd863f743202 tempest-VolumesSnapshotTestJSON-1827115803 None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:09:26 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-ccc06aa3-0538-4898-ac56-bd863f743202 tempest-VolumesSnapshotTestJSON-1827115803 None] Deleted volume successfully. Apr 16 15:09:26 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-ccc06aa3-0538-4898-ac56-bd863f743202 tempest-VolumesSnapshotTestJSON-1827115803 None] Lock "cinder-14a4c862-6a20-4759-8283-c993f06e3d25-delete_volume" released by "delete_volume" :: held 2.158s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:09:26 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd821765-f205-4163-95f5-60884723eb7e tempest-VolumesSnapshotTestJSON-1827115803 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82756) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 15:09:26 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-fd821765-f205-4163-95f5-60884723eb7e tempest-VolumesSnapshotTestJSON-1827115803 None] Flow 'volume_create_manager' (3fc45cad-5863-4a25-ba21-341e64802018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:09:26 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-fd821765-f205-4163-95f5-60884723eb7e tempest-VolumesSnapshotTestJSON-1827115803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4811e22-4f76-47a7-a9e1-eb1a92e05127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:09:27 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-fd821765-f205-4163-95f5-60884723eb7e tempest-VolumesSnapshotTestJSON-1827115803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4811e22-4f76-47a7-a9e1-eb1a92e05127) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:09:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-871817503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3525e5e2-ed94-4593-9b35-a690401c704f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e188a76e5efd467e8c860aa308f861b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:09:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:09:27Z,use_quota=True,user_id='0c5eb9cbc4334877925458d81eec542d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:09:27 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-fd821765-f205-4163-95f5-60884723eb7e tempest-VolumesSnapshotTestJSON-1827115803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b821ae48-a3a0-4eb3-91bd-7edba8e0f830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:09:27 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-fd821765-f205-4163-95f5-60884723eb7e tempest-VolumesSnapshotTestJSON-1827115803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b821ae48-a3a0-4eb3-91bd-7edba8e0f830) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:09:27 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-fd821765-f205-4163-95f5-60884723eb7e tempest-VolumesSnapshotTestJSON-1827115803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11543186-baba-40dd-b469-9542ce21c83b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:09:27 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-fd821765-f205-4163-95f5-60884723eb7e tempest-VolumesSnapshotTestJSON-1827115803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11543186-baba-40dd-b469-9542ce21c83b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3525e5e2-ed94-4593-9b35-a690401c704f', 'volume_name': 'volume-3525e5e2-ed94-4593-9b35-a690401c704f', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:09:27 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-fd821765-f205-4163-95f5-60884723eb7e tempest-VolumesSnapshotTestJSON-1827115803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2714261-5d78-43d6-bd44-0deca7898daa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:09:27 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-fd821765-f205-4163-95f5-60884723eb7e tempest-VolumesSnapshotTestJSON-1827115803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2714261-5d78-43d6-bd44-0deca7898daa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:09:27 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-fd821765-f205-4163-95f5-60884723eb7e tempest-VolumesSnapshotTestJSON-1827115803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce846bd9-db8d-4e7a-9141-81d32e7478b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:09:27 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-fd821765-f205-4163-95f5-60884723eb7e tempest-VolumesSnapshotTestJSON-1827115803 None] Volume 3525e5e2-ed94-4593-9b35-a690401c704f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3525e5e2-ed94-4593-9b35-a690401c704f', 'volume_size': 1} Apr 16 15:09:27 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-fd821765-f205-4163-95f5-60884723eb7e tempest-VolumesSnapshotTestJSON-1827115803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:09:33 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-d2628e06-cec8-4250-84a7-84c7ac38e8bf tempest-VolumesActionsTest-570492233 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 15.324s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:09:33 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-d2628e06-cec8-4250-84a7-84c7ac38e8bf tempest-VolumesActionsTest-570492233 None] Uploaded volume to glance image-id: 8255f6a6-5416-49a1-8006-37f922b2ca01. {{(pid=82756) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 16 15:09:33 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-06714842-83b2-4a94-af47-c1e4b7907088 tempest-VolumesTransfersTest-2042875671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.364s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:09:33 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-06714842-83b2-4a94-af47-c1e4b7907088 tempest-VolumesTransfersTest-2042875671 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:09:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-854067013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad5b0f47-5590-40a2-811d-d7fefacea90d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c275319c01b4ada96ca8f1ecd099870',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:09:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:09:18Z,use_quota=True,user_id='8cfab9df560249fdbbe49f0121ae33b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)}" {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 15:09:33 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-06714842-83b2-4a94-af47-c1e4b7907088 tempest-VolumesTransfersTest-2042875671 None] Creating volume ad5b0f47-5590-40a2-811d-d7fefacea90d {{(pid=82756) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 15:09:33 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-06714842-83b2-4a94-af47-c1e4b7907088 tempest-VolumesTransfersTest-2042875671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:09:33 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-06714842-83b2-4a94-af47-c1e4b7907088 tempest-VolumesTransfersTest-2042875671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:09:33 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-06714842-83b2-4a94-af47-c1e4b7907088 tempest-VolumesTransfersTest-2042875671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:09:33 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-06714842-83b2-4a94-af47-c1e4b7907088 tempest-VolumesTransfersTest-2042875671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:09:33 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-06714842-83b2-4a94-af47-c1e4b7907088 tempest-VolumesTransfersTest-2042875671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:09:33 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-06714842-83b2-4a94-af47-c1e4b7907088 tempest-VolumesTransfersTest-2042875671 None] Selected osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 as target Quobyte volume. {{(pid=82756) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 15:09:33 devstack cinder-volume[82756]: INFO cinder.volume.drivers.remotefs [None req-06714842-83b2-4a94-af47-c1e4b7907088 tempest-VolumesTransfersTest-2042875671 None] casted to osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 Apr 16 15:09:33 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-06714842-83b2-4a94-af47-c1e4b7907088 tempest-VolumesTransfersTest-2042875671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-ad5b0f47-5590-40a2-811d-d7fefacea90d 1073741824 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:09:33 devstack sudo[87638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-ad5b0f47-5590-40a2-811d-d7fefacea90d 1073741824 Apr 16 15:09:33 devstack sudo[87638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:09:33 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-d2628e06-cec8-4250-84a7-84c7ac38e8bf tempest-VolumesActionsTest-570492233 None] Copy volume to image completed successfully. Apr 16 15:09:34 devstack sudo[87638]: pam_unix(sudo:session): session closed for user root Apr 16 15:09:34 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-06714842-83b2-4a94-af47-c1e4b7907088 tempest-VolumesTransfersTest-2042875671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-ad5b0f47-5590-40a2-811d-d7fefacea90d 1073741824" returned: 0 in 0.482s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:09:34 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-06714842-83b2-4a94-af47-c1e4b7907088 tempest-VolumesTransfersTest-2042875671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-ad5b0f47-5590-40a2-811d-d7fefacea90d {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:09:34 devstack sudo[87643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-ad5b0f47-5590-40a2-811d-d7fefacea90d Apr 16 15:09:34 devstack sudo[87643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:09:34 devstack sudo[87643]: pam_unix(sudo:session): session closed for user root Apr 16 15:09:34 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-06714842-83b2-4a94-af47-c1e4b7907088 tempest-VolumesTransfersTest-2042875671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-ad5b0f47-5590-40a2-811d-d7fefacea90d" returned: 0 in 0.603s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:09:34 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-06714842-83b2-4a94-af47-c1e4b7907088 tempest-VolumesTransfersTest-2042875671 None] <== create_volume: return (1111ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'} {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 15:09:34 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-06714842-83b2-4a94-af47-c1e4b7907088 tempest-VolumesTransfersTest-2042875671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.114s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:09:34 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-fd821765-f205-4163-95f5-60884723eb7e tempest-VolumesSnapshotTestJSON-1827115803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.692s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:09:34 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-fd821765-f205-4163-95f5-60884723eb7e tempest-VolumesSnapshotTestJSON-1827115803 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:09:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-871817503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3525e5e2-ed94-4593-9b35-a690401c704f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e188a76e5efd467e8c860aa308f861b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:09:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:09:27Z,use_quota=True,user_id='0c5eb9cbc4334877925458d81eec542d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)}" {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 15:09:34 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-fd821765-f205-4163-95f5-60884723eb7e tempest-VolumesSnapshotTestJSON-1827115803 None] Creating volume 3525e5e2-ed94-4593-9b35-a690401c704f {{(pid=82756) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 15:09:34 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-fd821765-f205-4163-95f5-60884723eb7e tempest-VolumesSnapshotTestJSON-1827115803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:09:34 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-fd821765-f205-4163-95f5-60884723eb7e tempest-VolumesSnapshotTestJSON-1827115803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:09:34 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-fd821765-f205-4163-95f5-60884723eb7e tempest-VolumesSnapshotTestJSON-1827115803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:09:34 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-fd821765-f205-4163-95f5-60884723eb7e tempest-VolumesSnapshotTestJSON-1827115803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:09:34 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-fd821765-f205-4163-95f5-60884723eb7e tempest-VolumesSnapshotTestJSON-1827115803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:09:34 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-fd821765-f205-4163-95f5-60884723eb7e tempest-VolumesSnapshotTestJSON-1827115803 None] Selected osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 as target Quobyte volume. {{(pid=82756) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 15:09:34 devstack cinder-volume[82756]: INFO cinder.volume.drivers.remotefs [None req-fd821765-f205-4163-95f5-60884723eb7e tempest-VolumesSnapshotTestJSON-1827115803 None] casted to osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 Apr 16 15:09:34 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-fd821765-f205-4163-95f5-60884723eb7e tempest-VolumesSnapshotTestJSON-1827115803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-3525e5e2-ed94-4593-9b35-a690401c704f 1073741824 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:09:34 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-06714842-83b2-4a94-af47-c1e4b7907088 tempest-VolumesTransfersTest-2042875671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (970e389d-2dec-4fa3-8379-bacb55a1bccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad5b0f47-5590-40a2-811d-d7fefacea90d', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:09:34 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-06714842-83b2-4a94-af47-c1e4b7907088 tempest-VolumesTransfersTest-2042875671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8447ff1-2ede-49db-8a72-45abfb3ecbfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:09:34 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-06714842-83b2-4a94-af47-c1e4b7907088 tempest-VolumesTransfersTest-2042875671 None] Volume volume-ad5b0f47-5590-40a2-811d-d7fefacea90d (ad5b0f47-5590-40a2-811d-d7fefacea90d): created successfully Apr 16 15:09:34 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-06714842-83b2-4a94-af47-c1e4b7907088 tempest-VolumesTransfersTest-2042875671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8447ff1-2ede-49db-8a72-45abfb3ecbfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:09:34 devstack sudo[87646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-3525e5e2-ed94-4593-9b35-a690401c704f 1073741824 Apr 16 15:09:34 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-06714842-83b2-4a94-af47-c1e4b7907088 tempest-VolumesTransfersTest-2042875671 None] Flow 'volume_create_manager' (081351bf-5da5-4d6a-82d5-735196e89fa8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:09:34 devstack sudo[87646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:09:34 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-06714842-83b2-4a94-af47-c1e4b7907088 tempest-VolumesTransfersTest-2042875671 None] Created volume successfully. Apr 16 15:09:34 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-c98b71c2-9022-4b99-acb0-4b4469ea1280 tempest-VolumesActionsTest-570492233 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:09:35 devstack sudo[87646]: pam_unix(sudo:session): session closed for user root Apr 16 15:09:35 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-fd821765-f205-4163-95f5-60884723eb7e tempest-VolumesSnapshotTestJSON-1827115803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-3525e5e2-ed94-4593-9b35-a690401c704f 1073741824" returned: 0 in 0.736s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:09:35 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-fd821765-f205-4163-95f5-60884723eb7e tempest-VolumesSnapshotTestJSON-1827115803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-3525e5e2-ed94-4593-9b35-a690401c704f {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:09:35 devstack sudo[87653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-3525e5e2-ed94-4593-9b35-a690401c704f Apr 16 15:09:35 devstack sudo[87653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:09:35 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-8d5be3cb-a705-4a89-b7dc-197480460ffc tempest-VolumesTransfersTest-608901207 None] Acquiring lock "cinder-ad5b0f47-5590-40a2-811d-d7fefacea90d-delete_volume" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:09:35 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-8d5be3cb-a705-4a89-b7dc-197480460ffc tempest-VolumesTransfersTest-608901207 None] Lock "cinder-ad5b0f47-5590-40a2-811d-d7fefacea90d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:09:35 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-8d5be3cb-a705-4a89-b7dc-197480460ffc tempest-VolumesTransfersTest-608901207 None] Acquiring lock "cinder-quobyte-ad5b0f47-5590-40a2-811d-d7fefacea90d" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:09:35 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-8d5be3cb-a705-4a89-b7dc-197480460ffc tempest-VolumesTransfersTest-608901207 None] Lock "cinder-quobyte-ad5b0f47-5590-40a2-811d-d7fefacea90d" acquired by "delete_volume" :: waited 0.007s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:09:35 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c524add-ca9b-4243-b365-c7a7e1d990d9]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:09:35 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-8d5be3cb-a705-4a89-b7dc-197480460ffc tempest-VolumesTransfersTest-608901207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-ad5b0f47-5590-40a2-811d-d7fefacea90d {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:09:35 devstack sudo[87656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-ad5b0f47-5590-40a2-811d-d7fefacea90d Apr 16 15:09:35 devstack sudo[87656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:09:36 devstack sudo[87653]: pam_unix(sudo:session): session closed for user root Apr 16 15:09:36 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-fd821765-f205-4163-95f5-60884723eb7e tempest-VolumesSnapshotTestJSON-1827115803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-3525e5e2-ed94-4593-9b35-a690401c704f" returned: 0 in 0.518s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:09:36 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-fd821765-f205-4163-95f5-60884723eb7e tempest-VolumesSnapshotTestJSON-1827115803 None] <== create_volume: return (1284ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'} {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 15:09:36 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-fd821765-f205-4163-95f5-60884723eb7e tempest-VolumesSnapshotTestJSON-1827115803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.287s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:09:36 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-c98b71c2-9022-4b99-acb0-4b4469ea1280 tempest-VolumesActionsTest-570492233 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.066s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:09:36 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[1559b490-4635-451a-beb6-5c7eb3c3196e]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:09:36 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-c98b71c2-9022-4b99-acb0-4b4469ea1280 tempest-VolumesActionsTest-570492233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c1fe4c2f-0039-4d10-b121-1dbbbdb434fa {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:09:36 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-fd821765-f205-4163-95f5-60884723eb7e tempest-VolumesSnapshotTestJSON-1827115803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce846bd9-db8d-4e7a-9141-81d32e7478b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3525e5e2-ed94-4593-9b35-a690401c704f', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:09:36 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-fd821765-f205-4163-95f5-60884723eb7e tempest-VolumesSnapshotTestJSON-1827115803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9600dc2f-91d6-413b-9f0d-937ba255fed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:09:36 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-fd821765-f205-4163-95f5-60884723eb7e tempest-VolumesSnapshotTestJSON-1827115803 None] Volume volume-3525e5e2-ed94-4593-9b35-a690401c704f (3525e5e2-ed94-4593-9b35-a690401c704f): created successfully Apr 16 15:09:36 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-fd821765-f205-4163-95f5-60884723eb7e tempest-VolumesSnapshotTestJSON-1827115803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9600dc2f-91d6-413b-9f0d-937ba255fed0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:09:36 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-fd821765-f205-4163-95f5-60884723eb7e tempest-VolumesSnapshotTestJSON-1827115803 None] Flow 'volume_create_manager' (3fc45cad-5863-4a25-ba21-341e64802018) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:09:36 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-fd821765-f205-4163-95f5-60884723eb7e tempest-VolumesSnapshotTestJSON-1827115803 None] Created volume successfully. Apr 16 15:09:36 devstack sudo[87659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c1fe4c2f-0039-4d10-b121-1dbbbdb434fa Apr 16 15:09:36 devstack sudo[87659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:09:36 devstack sudo[87656]: pam_unix(sudo:session): session closed for user root Apr 16 15:09:36 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-8d5be3cb-a705-4a89-b7dc-197480460ffc tempest-VolumesTransfersTest-608901207 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-ad5b0f47-5590-40a2-811d-d7fefacea90d" returned: 0 in 0.532s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:09:36 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-8d5be3cb-a705-4a89-b7dc-197480460ffc tempest-VolumesTransfersTest-608901207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-ad5b0f47-5590-40a2-811d-d7fefacea90d {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:09:36 devstack sudo[87673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-ad5b0f47-5590-40a2-811d-d7fefacea90d Apr 16 15:09:36 devstack sudo[87673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:09:36 devstack sudo[87659]: pam_unix(sudo:session): session closed for user root Apr 16 15:09:36 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-c98b71c2-9022-4b99-acb0-4b4469ea1280 tempest-VolumesActionsTest-570492233 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c1fe4c2f-0039-4d10-b121-1dbbbdb434fa" returned: 0 in 0.597s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:09:36 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-b0e42434-f589-4e49-bb01-4755c020b6bf tempest-VolumesSnapshotTestJSON-1827115803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:09:36 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6dd78a6-73d6-4735-9df1-07b6e8a9ad39]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:09:36 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-c98b71c2-9022-4b99-acb0-4b4469ea1280 tempest-VolumesActionsTest-570492233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c1fe4c2f-0039-4d10-b121-1dbbbdb434fa {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:09:36 devstack sudo[87684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c1fe4c2f-0039-4d10-b121-1dbbbdb434fa Apr 16 15:09:36 devstack sudo[87684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:09:36 devstack sudo[87673]: pam_unix(sudo:session): session closed for user root Apr 16 15:09:36 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-8d5be3cb-a705-4a89-b7dc-197480460ffc tempest-VolumesTransfersTest-608901207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-ad5b0f47-5590-40a2-811d-d7fefacea90d" returned: 0 in 0.539s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:09:36 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-8d5be3cb-a705-4a89-b7dc-197480460ffc tempest-VolumesTransfersTest-608901207 None] Lock "cinder-quobyte-ad5b0f47-5590-40a2-811d-d7fefacea90d" released by "delete_volume" :: held 1.095s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:09:36 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-8d5be3cb-a705-4a89-b7dc-197480460ffc tempest-VolumesTransfersTest-608901207 None] Created reservations ['202a33d4-a58b-4646-b6de-6c4846b9a4ab', '8cfc85d3-60de-4e4c-96df-bdb41514b0f9', '98d28092-f554-4b9f-90b2-83bff075af06', 'b93dca86-8036-40aa-9f26-f0487ae38727'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:09:36 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-8d5be3cb-a705-4a89-b7dc-197480460ffc tempest-VolumesTransfersTest-608901207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:09:36 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-8d5be3cb-a705-4a89-b7dc-197480460ffc tempest-VolumesTransfersTest-608901207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:09:36 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-8d5be3cb-a705-4a89-b7dc-197480460ffc tempest-VolumesTransfersTest-608901207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:09:36 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-8d5be3cb-a705-4a89-b7dc-197480460ffc tempest-VolumesTransfersTest-608901207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:09:36 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-8d5be3cb-a705-4a89-b7dc-197480460ffc tempest-VolumesTransfersTest-608901207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:09:36 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-8d5be3cb-a705-4a89-b7dc-197480460ffc tempest-VolumesTransfersTest-608901207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:09:36 devstack sudo[87687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:09:36 devstack sudo[87687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:09:37 devstack sudo[87684]: pam_unix(sudo:session): session closed for user root Apr 16 15:09:37 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-c98b71c2-9022-4b99-acb0-4b4469ea1280 tempest-VolumesActionsTest-570492233 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c1fe4c2f-0039-4d10-b121-1dbbbdb434fa" returned: 0 in 0.533s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:09:37 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-c98b71c2-9022-4b99-acb0-4b4469ea1280 tempest-VolumesActionsTest-570492233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c1fe4c2f-0039-4d10-b121-1dbbbdb434fa /opt/stack/data/cinder/conversion/c1fe4c2f-0039-4d10-b121-1dbbbdb434fa.temp_image.72b7403d-474f-4b71-9788-aefd718f973a5adpmbr_.img {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:09:37 devstack sudo[87692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c1fe4c2f-0039-4d10-b121-1dbbbdb434fa /opt/stack/data/cinder/conversion/c1fe4c2f-0039-4d10-b121-1dbbbdb434fa.temp_image.72b7403d-474f-4b71-9788-aefd718f973a5adpmbr_.img Apr 16 15:09:37 devstack sudo[87692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:09:37 devstack sudo[87687]: pam_unix(sudo:session): session closed for user root Apr 16 15:09:37 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-8d5be3cb-a705-4a89-b7dc-197480460ffc tempest-VolumesTransfersTest-608901207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.432s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:09:37 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-8d5be3cb-a705-4a89-b7dc-197480460ffc tempest-VolumesTransfersTest-608901207 None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:09:37 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-8d5be3cb-a705-4a89-b7dc-197480460ffc tempest-VolumesTransfersTest-608901207 None] Deleted volume successfully. Apr 16 15:09:37 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-8d5be3cb-a705-4a89-b7dc-197480460ffc tempest-VolumesTransfersTest-608901207 None] Lock "cinder-ad5b0f47-5590-40a2-811d-d7fefacea90d-delete_volume" released by "delete_volume" :: held 1.700s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:09:39 devstack sudo[87692]: pam_unix(sudo:session): session closed for user root Apr 16 15:09:39 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-c98b71c2-9022-4b99-acb0-4b4469ea1280 tempest-VolumesActionsTest-570492233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c1fe4c2f-0039-4d10-b121-1dbbbdb434fa /opt/stack/data/cinder/conversion/c1fe4c2f-0039-4d10-b121-1dbbbdb434fa.temp_image.72b7403d-474f-4b71-9788-aefd718f973a5adpmbr_.img" returned: 0 in 2.421s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:09:39 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4683a5a-e603-4feb-931b-2c990c8bb47f]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:09:39 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-c98b71c2-9022-4b99-acb0-4b4469ea1280 tempest-VolumesActionsTest-570492233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c1fe4c2f-0039-4d10-b121-1dbbbdb434fa {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:09:39 devstack sudo[87708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c1fe4c2f-0039-4d10-b121-1dbbbdb434fa Apr 16 15:09:39 devstack sudo[87708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:09:40 devstack sudo[87708]: pam_unix(sudo:session): session closed for user root Apr 16 15:09:40 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-c98b71c2-9022-4b99-acb0-4b4469ea1280 tempest-VolumesActionsTest-570492233 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c1fe4c2f-0039-4d10-b121-1dbbbdb434fa" returned: 0 in 0.624s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:09:40 devstack cinder-volume[82756]: DEBUG cinder.image.image_utils [None req-c98b71c2-9022-4b99-acb0-4b4469ea1280 tempest-VolumesActionsTest-570492233 None] Image conversion details: src /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c1fe4c2f-0039-4d10-b121-1dbbbdb434fa, size 1024.00 MB, duration 2.42 sec, destination /opt/stack/data/cinder/conversion/c1fe4c2f-0039-4d10-b121-1dbbbdb434fa.temp_image.72b7403d-474f-4b71-9788-aefd718f973a5adpmbr_.img {{(pid=82756) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 15:09:40 devstack cinder-volume[82756]: INFO cinder.image.image_utils [None req-c98b71c2-9022-4b99-acb0-4b4469ea1280 tempest-VolumesActionsTest-570492233 None] Converted 1024.00 MB image at 422.66 MB/s Apr 16 15:09:40 devstack cinder-volume[82756]: DEBUG cinder.image.image_utils [None req-c98b71c2-9022-4b99-acb0-4b4469ea1280 tempest-VolumesActionsTest-570492233 None] 72b7403d-474f-4b71-9788-aefd718f973a was raw, converting to qcow2 {{(pid=82756) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}} Apr 16 15:09:40 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec785bfe-d412-48cf-bd2c-504d09c177fc]: (4, 'raw') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:09:40 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-c98b71c2-9022-4b99-acb0-4b4469ea1280 tempest-VolumesActionsTest-570492233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/c1fe4c2f-0039-4d10-b121-1dbbbdb434fa.temp_image.72b7403d-474f-4b71-9788-aefd718f973a5adpmbr_.img {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:09:40 devstack sudo[87713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/c1fe4c2f-0039-4d10-b121-1dbbbdb434fa.temp_image.72b7403d-474f-4b71-9788-aefd718f973a5adpmbr_.img Apr 16 15:09:40 devstack sudo[87713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:09:40 devstack sudo[87713]: pam_unix(sudo:session): session closed for user root Apr 16 15:09:40 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-c98b71c2-9022-4b99-acb0-4b4469ea1280 tempest-VolumesActionsTest-570492233 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/c1fe4c2f-0039-4d10-b121-1dbbbdb434fa.temp_image.72b7403d-474f-4b71-9788-aefd718f973a5adpmbr_.img" returned: 0 in 0.502s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:09:40 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-c98b71c2-9022-4b99-acb0-4b4469ea1280 tempest-VolumesActionsTest-570492233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/c1fe4c2f-0039-4d10-b121-1dbbbdb434fa.temp_image.72b7403d-474f-4b71-9788-aefd718f973a5adpmbr_.img {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:09:40 devstack sudo[87717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/c1fe4c2f-0039-4d10-b121-1dbbbdb434fa.temp_image.72b7403d-474f-4b71-9788-aefd718f973a5adpmbr_.img Apr 16 15:09:40 devstack sudo[87717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:09:41 devstack sudo[87717]: pam_unix(sudo:session): session closed for user root Apr 16 15:09:41 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-c98b71c2-9022-4b99-acb0-4b4469ea1280 tempest-VolumesActionsTest-570492233 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/c1fe4c2f-0039-4d10-b121-1dbbbdb434fa.temp_image.72b7403d-474f-4b71-9788-aefd718f973a5adpmbr_.img" returned: 1 in 0.603s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:09:41 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-c98b71c2-9022-4b99-acb0-4b4469ea1280 tempest-VolumesActionsTest-570492233 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/c1fe4c2f-0039-4d10-b121-1dbbbdb434fa.temp_image.72b7403d-474f-4b71-9788-aefd718f973a5adpmbr_.img' failed. Not Retrying. {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 16 15:09:41 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-c98b71c2-9022-4b99-acb0-4b4469ea1280 tempest-VolumesActionsTest-570492233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/c1fe4c2f-0039-4d10-b121-1dbbbdb434fa.temp_image.72b7403d-474f-4b71-9788-aefd718f973a5adpmbr_.img /opt/stack/data/cinder/conversion/vol_upload_z9dwds1u {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:09:41 devstack sudo[87747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/c1fe4c2f-0039-4d10-b121-1dbbbdb434fa.temp_image.72b7403d-474f-4b71-9788-aefd718f973a5adpmbr_.img /opt/stack/data/cinder/conversion/vol_upload_z9dwds1u Apr 16 15:09:41 devstack sudo[87747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:09:41 devstack sudo[87747]: pam_unix(sudo:session): session closed for user root Apr 16 15:09:41 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-c98b71c2-9022-4b99-acb0-4b4469ea1280 tempest-VolumesActionsTest-570492233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/c1fe4c2f-0039-4d10-b121-1dbbbdb434fa.temp_image.72b7403d-474f-4b71-9788-aefd718f973a5adpmbr_.img /opt/stack/data/cinder/conversion/vol_upload_z9dwds1u" returned: 0 in 0.603s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:09:41 devstack cinder-volume[82756]: DEBUG cinder.image.image_utils [None req-c98b71c2-9022-4b99-acb0-4b4469ea1280 tempest-VolumesActionsTest-570492233 None] Image conversion details: src /opt/stack/data/cinder/conversion/c1fe4c2f-0039-4d10-b121-1dbbbdb434fa.temp_image.72b7403d-474f-4b71-9788-aefd718f973a5adpmbr_.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_z9dwds1u {{(pid=82756) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 15:09:41 devstack cinder-volume[82756]: INFO cinder.image.image_utils [None req-c98b71c2-9022-4b99-acb0-4b4469ea1280 tempest-VolumesActionsTest-570492233 None] Converted 1024.00 MB image at 1024.00 MB/s Apr 16 15:09:41 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[70fefad6-364b-45f2-8c6a-b86f5ae7c340]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:09:41 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-c98b71c2-9022-4b99-acb0-4b4469ea1280 tempest-VolumesActionsTest-570492233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_z9dwds1u {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:09:42 devstack sudo[87755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_z9dwds1u Apr 16 15:09:42 devstack sudo[87755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:09:42 devstack sudo[87755]: pam_unix(sudo:session): session closed for user root Apr 16 15:09:42 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-c98b71c2-9022-4b99-acb0-4b4469ea1280 tempest-VolumesActionsTest-570492233 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_z9dwds1u" returned: 0 in 0.610s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:09:43 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [None req-6559d6d8-e51f-454a-abee-5222ae9648f1 tempest-VolumesExtendTest-595654496 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82756) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 15:09:43 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-6559d6d8-e51f-454a-abee-5222ae9648f1 tempest-VolumesExtendTest-595654496 None] Flow 'volume_create_manager' (300e55da-91cf-488a-a70f-5b47fa923984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:09:43 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-6559d6d8-e51f-454a-abee-5222ae9648f1 tempest-VolumesExtendTest-595654496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2580f48-8e18-488c-bfb5-1c214f5a8cf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:09:43 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-6559d6d8-e51f-454a-abee-5222ae9648f1 tempest-VolumesExtendTest-595654496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2580f48-8e18-488c-bfb5-1c214f5a8cf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:09:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-639938565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcb0f077-b300-43e4-bb78-2c889d3ac83c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='079e7c0fd5814d439f65c42ce9367359',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:09:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:09:43Z,use_quota=True,user_id='f438223713b1407e98774448ae7410f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:09:43 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-6559d6d8-e51f-454a-abee-5222ae9648f1 tempest-VolumesExtendTest-595654496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da42d91c-fa53-40ae-9fd0-b66edf34538e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:09:43 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-6559d6d8-e51f-454a-abee-5222ae9648f1 tempest-VolumesExtendTest-595654496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da42d91c-fa53-40ae-9fd0-b66edf34538e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:09:43 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-6559d6d8-e51f-454a-abee-5222ae9648f1 tempest-VolumesExtendTest-595654496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f1537a5-c1bd-47b3-bbbe-fa168d123b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:09:43 devstack cinder-volume[82756]: DEBUG cinder.image.glance [None req-6559d6d8-e51f-454a-abee-5222ae9648f1 tempest-VolumesExtendTest-595654496 None] Creating Keystone auth plugin from conf {{(pid=82756) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 16 15:09:43 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-6559d6d8-e51f-454a-abee-5222ae9648f1 tempest-VolumesExtendTest-595654496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f1537a5-c1bd-47b3-bbbe-fa168d123b34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'fcb0f077-b300-43e4-bb78-2c889d3ac83c', 'volume_name': 'volume-fcb0f077-b300-43e4-bb78-2c889d3ac83c', 'volume_size': 1, 'image_id': 'b5f01913-4ea7-4cdb-8c76-10fda64d06e5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b5f01913-4ea7-4cdb-8c76-10fda64d06e5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '42394d2631114f428489519b24c78a03', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b5f01913-4ea7-4cdb-8c76-10fda64d06e5', 'created_at': datetime.datetime(2026, 4, 16, 13, 0, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 16, 13, 0, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b5f01913-4ea7-4cdb-8c76-10fda64d06e5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:09:43 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-6559d6d8-e51f-454a-abee-5222ae9648f1 tempest-VolumesExtendTest-595654496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (027b7085-bb35-41ae-aff1-f4189aa9c62d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:09:43 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-6559d6d8-e51f-454a-abee-5222ae9648f1 tempest-VolumesExtendTest-595654496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (027b7085-bb35-41ae-aff1-f4189aa9c62d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:09:43 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-6559d6d8-e51f-454a-abee-5222ae9648f1 tempest-VolumesExtendTest-595654496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4428ddf4-e90e-4cfd-825a-7f8cd9896d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:09:43 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-6559d6d8-e51f-454a-abee-5222ae9648f1 tempest-VolumesExtendTest-595654496 None] Volume fcb0f077-b300-43e4-bb78-2c889d3ac83c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-fcb0f077-b300-43e4-bb78-2c889d3ac83c', 'volume_size': 1, 'image_id': 'b5f01913-4ea7-4cdb-8c76-10fda64d06e5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b5f01913-4ea7-4cdb-8c76-10fda64d06e5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '42394d2631114f428489519b24c78a03', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b5f01913-4ea7-4cdb-8c76-10fda64d06e5', 'created_at': datetime.datetime(2026, 4, 16, 13, 0, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 16, 13, 0, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b5f01913-4ea7-4cdb-8c76-10fda64d06e5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 16 15:09:43 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [None req-6559d6d8-e51f-454a-abee-5222ae9648f1 tempest-VolumesExtendTest-595654496 None] Trying to clone fcb0f077-b300-43e4-bb78-2c889d3ac83c from image b5f01913-4ea7-4cdb-8c76-10fda64d06e5 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b5f01913-4ea7-4cdb-8c76-10fda64d06e5', 'metadata': {}}]). {{(pid=82756) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 16 15:09:43 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-c98b71c2-9022-4b99-acb0-4b4469ea1280 tempest-VolumesActionsTest-570492233 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 7.843s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:09:43 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-c98b71c2-9022-4b99-acb0-4b4469ea1280 tempest-VolumesActionsTest-570492233 None] Uploaded volume to glance image-id: 72b7403d-474f-4b71-9788-aefd718f973a. {{(pid=82756) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 16 15:09:43 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-b0e42434-f589-4e49-bb01-4755c020b6bf tempest-VolumesSnapshotTestJSON-1827115803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.254s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:09:43 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-c98b71c2-9022-4b99-acb0-4b4469ea1280 tempest-VolumesActionsTest-570492233 None] Copy volume to image completed successfully. Apr 16 15:09:43 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-b0e42434-f589-4e49-bb01-4755c020b6bf tempest-VolumesSnapshotTestJSON-1827115803 None] Creating offline snapshot 7cfd194d-12f0-4cb1-899c-76f9c9d8f457 of volume 3525e5e2-ed94-4593-9b35-a690401c704f {{(pid=82756) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 16 15:09:43 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fce1a1e-f9a3-492f-b6ba-cb82c4d13943]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:09:43 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-b0e42434-f589-4e49-bb01-4755c020b6bf tempest-VolumesSnapshotTestJSON-1827115803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-3525e5e2-ed94-4593-9b35-a690401c704f {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:09:43 devstack cinder-volume[82756]: DEBUG cinder.image.image_utils [None req-6559d6d8-e51f-454a-abee-5222ae9648f1 tempest-VolumesExtendTest-595654496 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b5f01913-4ea7-4cdb-8c76-10fda64d06e5_g1uu7lwadevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82756) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 16 15:09:43 devstack cinder-volume[82756]: INFO cinder.image.image_utils [None req-6559d6d8-e51f-454a-abee-5222ae9648f1 tempest-VolumesExtendTest-595654496 None] Image download 20.69 MB at 20.69 MB/s Apr 16 15:09:44 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[222820c4-afc6-45cc-9ba3-ce853599b541]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:09:44 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-6559d6d8-e51f-454a-abee-5222ae9648f1 tempest-VolumesExtendTest-595654496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5f01913-4ea7-4cdb-8c76-10fda64d06e5_g1uu7lwadevstack@QuobyteHD {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:09:44 devstack sudo[87762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-3525e5e2-ed94-4593-9b35-a690401c704f Apr 16 15:09:44 devstack sudo[87762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:09:44 devstack sudo[87764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5f01913-4ea7-4cdb-8c76-10fda64d06e5_g1uu7lwadevstack@QuobyteHD Apr 16 15:09:44 devstack sudo[87764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:09:44 devstack sudo[87764]: pam_unix(sudo:session): session closed for user root Apr 16 15:09:44 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-6559d6d8-e51f-454a-abee-5222ae9648f1 tempest-VolumesExtendTest-595654496 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5f01913-4ea7-4cdb-8c76-10fda64d06e5_g1uu7lwadevstack@QuobyteHD" returned: 0 in 0.776s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:09:44 devstack cinder-volume[82756]: DEBUG cinder.image.image_utils [None req-6559d6d8-e51f-454a-abee-5222ae9648f1 tempest-VolumesExtendTest-595654496 None] Temporary image b5f01913-4ea7-4cdb-8c76-10fda64d06e5 is fetched for user f438223713b1407e98774448ae7410f4. {{(pid=82756) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 16 15:09:44 devstack sudo[87762]: pam_unix(sudo:session): session closed for user root Apr 16 15:09:44 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-b0e42434-f589-4e49-bb01-4755c020b6bf tempest-VolumesSnapshotTestJSON-1827115803 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-3525e5e2-ed94-4593-9b35-a690401c704f" returned: 0 in 0.900s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:09:44 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-b0e42434-f589-4e49-bb01-4755c020b6bf tempest-VolumesSnapshotTestJSON-1827115803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-3525e5e2-ed94-4593-9b35-a690401c704f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-3525e5e2-ed94-4593-9b35-a690401c704f.7cfd194d-12f0-4cb1-899c-76f9c9d8f457 1G {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:09:44 devstack sudo[87775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-3525e5e2-ed94-4593-9b35-a690401c704f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-3525e5e2-ed94-4593-9b35-a690401c704f.7cfd194d-12f0-4cb1-899c-76f9c9d8f457 1G Apr 16 15:09:44 devstack sudo[87775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:09:44 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[1633e1ef-f3ea-4107-be7e-417f3ed32ffa]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:09:44 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-6559d6d8-e51f-454a-abee-5222ae9648f1 tempest-VolumesExtendTest-595654496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5f01913-4ea7-4cdb-8c76-10fda64d06e5_g1uu7lwadevstack@QuobyteHD {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:09:44 devstack sudo[87777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5f01913-4ea7-4cdb-8c76-10fda64d06e5_g1uu7lwadevstack@QuobyteHD Apr 16 15:09:44 devstack sudo[87777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:09:45 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-b093fbc0-c0f7-4dce-ac93-43fef9aec54a tempest-VolumesActionsTest-570492233 None] Acquiring lock "cinder-c1fe4c2f-0039-4d10-b121-1dbbbdb434fa-delete_volume" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:09:45 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-b093fbc0-c0f7-4dce-ac93-43fef9aec54a tempest-VolumesActionsTest-570492233 None] Lock "cinder-c1fe4c2f-0039-4d10-b121-1dbbbdb434fa-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:09:45 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-b093fbc0-c0f7-4dce-ac93-43fef9aec54a tempest-VolumesActionsTest-570492233 None] Acquiring lock "cinder-quobyte-c1fe4c2f-0039-4d10-b121-1dbbbdb434fa" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:09:45 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-b093fbc0-c0f7-4dce-ac93-43fef9aec54a tempest-VolumesActionsTest-570492233 None] Lock "cinder-quobyte-c1fe4c2f-0039-4d10-b121-1dbbbdb434fa" acquired by "delete_volume" :: waited 0.012s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:09:45 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[da32ebe2-fa9f-4b1a-bb94-0ae6bf4e1e00]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:09:45 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-b093fbc0-c0f7-4dce-ac93-43fef9aec54a tempest-VolumesActionsTest-570492233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c1fe4c2f-0039-4d10-b121-1dbbbdb434fa {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:09:45 devstack sudo[87779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c1fe4c2f-0039-4d10-b121-1dbbbdb434fa Apr 16 15:09:45 devstack sudo[87779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:09:45 devstack sudo[87775]: pam_unix(sudo:session): session closed for user root Apr 16 15:09:45 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-b0e42434-f589-4e49-bb01-4755c020b6bf tempest-VolumesSnapshotTestJSON-1827115803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-3525e5e2-ed94-4593-9b35-a690401c704f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-3525e5e2-ed94-4593-9b35-a690401c704f.7cfd194d-12f0-4cb1-899c-76f9c9d8f457 1G" returned: 0 in 0.688s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:09:45 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-b0e42434-f589-4e49-bb01-4755c020b6bf tempest-VolumesSnapshotTestJSON-1827115803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3525e5e2-ed94-4593-9b35-a690401c704f -F qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-3525e5e2-ed94-4593-9b35-a690401c704f.7cfd194d-12f0-4cb1-899c-76f9c9d8f457 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:09:45 devstack sudo[87777]: pam_unix(sudo:session): session closed for user root Apr 16 15:09:45 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-6559d6d8-e51f-454a-abee-5222ae9648f1 tempest-VolumesExtendTest-595654496 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5f01913-4ea7-4cdb-8c76-10fda64d06e5_g1uu7lwadevstack@QuobyteHD" returned: 0 in 0.654s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:09:45 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-6559d6d8-e51f-454a-abee-5222ae9648f1 tempest-VolumesExtendTest-595654496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:09:45 devstack sudo[87787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3525e5e2-ed94-4593-9b35-a690401c704f -F qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-3525e5e2-ed94-4593-9b35-a690401c704f.7cfd194d-12f0-4cb1-899c-76f9c9d8f457 Apr 16 15:09:45 devstack sudo[87787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:09:45 devstack sudo[87779]: pam_unix(sudo:session): session closed for user root Apr 16 15:09:45 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-b093fbc0-c0f7-4dce-ac93-43fef9aec54a tempest-VolumesActionsTest-570492233 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c1fe4c2f-0039-4d10-b121-1dbbbdb434fa" returned: 0 in 0.685s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:09:45 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-b093fbc0-c0f7-4dce-ac93-43fef9aec54a tempest-VolumesActionsTest-570492233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c1fe4c2f-0039-4d10-b121-1dbbbdb434fa {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:09:45 devstack sudo[87793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c1fe4c2f-0039-4d10-b121-1dbbbdb434fa Apr 16 15:09:45 devstack sudo[87793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:09:46 devstack sudo[87787]: pam_unix(sudo:session): session closed for user root Apr 16 15:09:46 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-b0e42434-f589-4e49-bb01-4755c020b6bf tempest-VolumesSnapshotTestJSON-1827115803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3525e5e2-ed94-4593-9b35-a690401c704f -F qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-3525e5e2-ed94-4593-9b35-a690401c704f.7cfd194d-12f0-4cb1-899c-76f9c9d8f457" returned: 0 in 0.558s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:09:46 devstack cinder-volume[82756]: WARNING cinder.volume.drivers.remotefs [None req-b0e42434-f589-4e49-bb01-4755c020b6bf tempest-VolumesSnapshotTestJSON-1827115803 None] /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-3525e5e2-ed94-4593-9b35-a690401c704f.7cfd194d-12f0-4cb1-899c-76f9c9d8f457 is being set with open permissions: ugo+rw Apr 16 15:09:46 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-b0e42434-f589-4e49-bb01-4755c020b6bf tempest-VolumesSnapshotTestJSON-1827115803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-3525e5e2-ed94-4593-9b35-a690401c704f.7cfd194d-12f0-4cb1-899c-76f9c9d8f457 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:09:46 devstack sudo[87798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-3525e5e2-ed94-4593-9b35-a690401c704f.7cfd194d-12f0-4cb1-899c-76f9c9d8f457 Apr 16 15:09:46 devstack sudo[87798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:09:46 devstack sudo[87793]: pam_unix(sudo:session): session closed for user root Apr 16 15:09:46 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-b093fbc0-c0f7-4dce-ac93-43fef9aec54a tempest-VolumesActionsTest-570492233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c1fe4c2f-0039-4d10-b121-1dbbbdb434fa" returned: 0 in 0.468s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:09:46 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-b093fbc0-c0f7-4dce-ac93-43fef9aec54a tempest-VolumesActionsTest-570492233 None] Lock "cinder-quobyte-c1fe4c2f-0039-4d10-b121-1dbbbdb434fa" released by "delete_volume" :: held 1.181s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:09:46 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-b093fbc0-c0f7-4dce-ac93-43fef9aec54a tempest-VolumesActionsTest-570492233 None] Created reservations ['002a2e6f-5f55-4e59-89cf-a4f99557f039', '462608e0-07f2-446d-b67b-5b8f3d038d79', 'f10d7ef5-03de-4aca-a8ff-24baa11858dd', 'f9a45296-0f81-4acd-8dd8-916f592bc7fd'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:09:46 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-b093fbc0-c0f7-4dce-ac93-43fef9aec54a tempest-VolumesActionsTest-570492233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:09:46 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-b093fbc0-c0f7-4dce-ac93-43fef9aec54a tempest-VolumesActionsTest-570492233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:09:46 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-b093fbc0-c0f7-4dce-ac93-43fef9aec54a tempest-VolumesActionsTest-570492233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:09:46 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-b093fbc0-c0f7-4dce-ac93-43fef9aec54a tempest-VolumesActionsTest-570492233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:09:46 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-b093fbc0-c0f7-4dce-ac93-43fef9aec54a tempest-VolumesActionsTest-570492233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:09:46 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-b093fbc0-c0f7-4dce-ac93-43fef9aec54a tempest-VolumesActionsTest-570492233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:09:46 devstack sudo[87801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:09:46 devstack sudo[87801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:09:46 devstack sudo[87798]: pam_unix(sudo:session): session closed for user root Apr 16 15:09:46 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-b0e42434-f589-4e49-bb01-4755c020b6bf tempest-VolumesSnapshotTestJSON-1827115803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-3525e5e2-ed94-4593-9b35-a690401c704f.7cfd194d-12f0-4cb1-899c-76f9c9d8f457" returned: 0 in 0.507s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:09:46 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-b0e42434-f589-4e49-bb01-4755c020b6bf tempest-VolumesSnapshotTestJSON-1827115803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-3525e5e2-ed94-4593-9b35-a690401c704f.info {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:09:46 devstack sudo[87804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-3525e5e2-ed94-4593-9b35-a690401c704f.info Apr 16 15:09:46 devstack sudo[87804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:09:46 devstack sudo[87801]: pam_unix(sudo:session): session closed for user root Apr 16 15:09:46 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-b093fbc0-c0f7-4dce-ac93-43fef9aec54a tempest-VolumesActionsTest-570492233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.542s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:09:46 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-b093fbc0-c0f7-4dce-ac93-43fef9aec54a tempest-VolumesActionsTest-570492233 None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:09:46 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-b093fbc0-c0f7-4dce-ac93-43fef9aec54a tempest-VolumesActionsTest-570492233 None] Deleted volume successfully. Apr 16 15:09:46 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-b093fbc0-c0f7-4dce-ac93-43fef9aec54a tempest-VolumesActionsTest-570492233 None] Lock "cinder-c1fe4c2f-0039-4d10-b121-1dbbbdb434fa-delete_volume" released by "delete_volume" :: held 1.884s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:09:47 devstack sudo[87804]: pam_unix(sudo:session): session closed for user root Apr 16 15:09:47 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-b0e42434-f589-4e49-bb01-4755c020b6bf tempest-VolumesSnapshotTestJSON-1827115803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-3525e5e2-ed94-4593-9b35-a690401c704f.info" returned: 0 in 0.466s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:09:47 devstack cinder-volume[82756]: WARNING cinder.volume.drivers.remotefs [None req-b0e42434-f589-4e49-bb01-4755c020b6bf tempest-VolumesSnapshotTestJSON-1827115803 None] /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-3525e5e2-ed94-4593-9b35-a690401c704f.info is being set with open permissions: ugo+rw Apr 16 15:09:47 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-b0e42434-f589-4e49-bb01-4755c020b6bf tempest-VolumesSnapshotTestJSON-1827115803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-3525e5e2-ed94-4593-9b35-a690401c704f.info {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:09:47 devstack sudo[87808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-3525e5e2-ed94-4593-9b35-a690401c704f.info Apr 16 15:09:47 devstack sudo[87808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:09:47 devstack sudo[87808]: pam_unix(sudo:session): session closed for user root Apr 16 15:09:47 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-b0e42434-f589-4e49-bb01-4755c020b6bf tempest-VolumesSnapshotTestJSON-1827115803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-3525e5e2-ed94-4593-9b35-a690401c704f.info" returned: 0 in 0.453s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:09:47 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-b0e42434-f589-4e49-bb01-4755c020b6bf tempest-VolumesSnapshotTestJSON-1827115803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.651s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:09:47 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-6559d6d8-e51f-454a-abee-5222ae9648f1 tempest-VolumesExtendTest-595654496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.974s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:09:47 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-6559d6d8-e51f-454a-abee-5222ae9648f1 tempest-VolumesExtendTest-595654496 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:09:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-639938565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcb0f077-b300-43e4-bb78-2c889d3ac83c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='079e7c0fd5814d439f65c42ce9367359',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:09:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:09:43Z,use_quota=True,user_id='f438223713b1407e98774448ae7410f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)}" {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 15:09:47 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-6559d6d8-e51f-454a-abee-5222ae9648f1 tempest-VolumesExtendTest-595654496 None] Creating volume fcb0f077-b300-43e4-bb78-2c889d3ac83c {{(pid=82756) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 15:09:47 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-6559d6d8-e51f-454a-abee-5222ae9648f1 tempest-VolumesExtendTest-595654496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:09:47 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-6559d6d8-e51f-454a-abee-5222ae9648f1 tempest-VolumesExtendTest-595654496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:09:47 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-6559d6d8-e51f-454a-abee-5222ae9648f1 tempest-VolumesExtendTest-595654496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:09:47 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-6559d6d8-e51f-454a-abee-5222ae9648f1 tempest-VolumesExtendTest-595654496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:09:47 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-6559d6d8-e51f-454a-abee-5222ae9648f1 tempest-VolumesExtendTest-595654496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:09:47 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-6559d6d8-e51f-454a-abee-5222ae9648f1 tempest-VolumesExtendTest-595654496 None] Selected osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 as target Quobyte volume. {{(pid=82756) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 15:09:47 devstack cinder-volume[82756]: INFO cinder.volume.drivers.remotefs [None req-6559d6d8-e51f-454a-abee-5222ae9648f1 tempest-VolumesExtendTest-595654496 None] casted to osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 Apr 16 15:09:47 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-6559d6d8-e51f-454a-abee-5222ae9648f1 tempest-VolumesExtendTest-595654496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-fcb0f077-b300-43e4-bb78-2c889d3ac83c 1073741824 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:09:47 devstack sudo[87811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-fcb0f077-b300-43e4-bb78-2c889d3ac83c 1073741824 Apr 16 15:09:47 devstack sudo[87811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:09:47 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-b0e42434-f589-4e49-bb01-4755c020b6bf tempest-VolumesSnapshotTestJSON-1827115803 None] Create snapshot completed successfully Apr 16 15:09:48 devstack sudo[87811]: pam_unix(sudo:session): session closed for user root Apr 16 15:09:48 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-6559d6d8-e51f-454a-abee-5222ae9648f1 tempest-VolumesExtendTest-595654496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-fcb0f077-b300-43e4-bb78-2c889d3ac83c 1073741824" returned: 0 in 0.639s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:09:48 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-6559d6d8-e51f-454a-abee-5222ae9648f1 tempest-VolumesExtendTest-595654496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-fcb0f077-b300-43e4-bb78-2c889d3ac83c {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:09:48 devstack sudo[87816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-fcb0f077-b300-43e4-bb78-2c889d3ac83c Apr 16 15:09:48 devstack sudo[87816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:09:48 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [None req-6657bd38-8e63-4c52-b2f7-3d58a270ca9a tempest-VolumesSnapshotTestJSON-1827115803 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82756) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 15:09:48 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-6657bd38-8e63-4c52-b2f7-3d58a270ca9a tempest-VolumesSnapshotTestJSON-1827115803 None] Flow 'volume_create_manager' (f5aac9ff-0b4b-466a-b46e-a8f65f9d0090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:09:48 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-6657bd38-8e63-4c52-b2f7-3d58a270ca9a tempest-VolumesSnapshotTestJSON-1827115803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (129899b6-572b-461f-af14-b82eb5e0a3eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:09:48 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-6657bd38-8e63-4c52-b2f7-3d58a270ca9a tempest-VolumesSnapshotTestJSON-1827115803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (129899b6-572b-461f-af14-b82eb5e0a3eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:09:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-512727739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=321541e4-41e8-4e1c-8e01-9d8503d8663e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e188a76e5efd467e8c860aa308f861b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:09:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7cfd194d-12f0-4cb1-899c-76f9c9d8f457,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:09:49Z,use_quota=True,user_id='0c5eb9cbc4334877925458d81eec542d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:09:48 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-6657bd38-8e63-4c52-b2f7-3d58a270ca9a tempest-VolumesSnapshotTestJSON-1827115803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8a7918e-5300-4439-a287-d511b6004bb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:09:48 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-6657bd38-8e63-4c52-b2f7-3d58a270ca9a tempest-VolumesSnapshotTestJSON-1827115803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8a7918e-5300-4439-a287-d511b6004bb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:09:48 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-6657bd38-8e63-4c52-b2f7-3d58a270ca9a tempest-VolumesSnapshotTestJSON-1827115803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78899bf5-bc9b-415b-ab92-b316e11afb16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:09:48 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-6657bd38-8e63-4c52-b2f7-3d58a270ca9a tempest-VolumesSnapshotTestJSON-1827115803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78899bf5-bc9b-415b-ab92-b316e11afb16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '321541e4-41e8-4e1c-8e01-9d8503d8663e', 'volume_name': 'volume-321541e4-41e8-4e1c-8e01-9d8503d8663e', 'volume_size': 1, 'snapshot_id': '7cfd194d-12f0-4cb1-899c-76f9c9d8f457'}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:09:48 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-6657bd38-8e63-4c52-b2f7-3d58a270ca9a tempest-VolumesSnapshotTestJSON-1827115803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05479589-97ef-4e5d-b942-cab5bf70c32f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:09:48 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-6657bd38-8e63-4c52-b2f7-3d58a270ca9a tempest-VolumesSnapshotTestJSON-1827115803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05479589-97ef-4e5d-b942-cab5bf70c32f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:09:48 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-6657bd38-8e63-4c52-b2f7-3d58a270ca9a tempest-VolumesSnapshotTestJSON-1827115803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd0a3ad2-4ae8-4b50-bf18-0596729516aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:09:48 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-6657bd38-8e63-4c52-b2f7-3d58a270ca9a tempest-VolumesSnapshotTestJSON-1827115803 None] Volume 321541e4-41e8-4e1c-8e01-9d8503d8663e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-321541e4-41e8-4e1c-8e01-9d8503d8663e', 'volume_size': 1, 'snapshot_id': '7cfd194d-12f0-4cb1-899c-76f9c9d8f457'} Apr 16 15:09:48 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-6657bd38-8e63-4c52-b2f7-3d58a270ca9a tempest-VolumesSnapshotTestJSON-1827115803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:09:48 devstack sudo[87816]: pam_unix(sudo:session): session closed for user root Apr 16 15:09:48 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-6559d6d8-e51f-454a-abee-5222ae9648f1 tempest-VolumesExtendTest-595654496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-fcb0f077-b300-43e4-bb78-2c889d3ac83c" returned: 0 in 0.576s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:09:48 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-6559d6d8-e51f-454a-abee-5222ae9648f1 tempest-VolumesExtendTest-595654496 None] <== create_volume: return (1243ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'} {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 15:09:48 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-6559d6d8-e51f-454a-abee-5222ae9648f1 tempest-VolumesExtendTest-595654496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.246s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:09:48 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-6657bd38-8e63-4c52-b2f7-3d58a270ca9a tempest-VolumesSnapshotTestJSON-1827115803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.056s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:09:48 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-6657bd38-8e63-4c52-b2f7-3d58a270ca9a tempest-VolumesSnapshotTestJSON-1827115803 None] Acquiring lock "cinder-quobyte-7cfd194d-12f0-4cb1-899c-76f9c9d8f457-321541e4-41e8-4e1c-8e01-9d8503d8663e" by "_create_volume_from_snapshot" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:09:48 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-6657bd38-8e63-4c52-b2f7-3d58a270ca9a tempest-VolumesSnapshotTestJSON-1827115803 None] Lock "cinder-quobyte-7cfd194d-12f0-4cb1-899c-76f9c9d8f457-321541e4-41e8-4e1c-8e01-9d8503d8663e" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:09:48 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-6657bd38-8e63-4c52-b2f7-3d58a270ca9a tempest-VolumesSnapshotTestJSON-1827115803 None] Creating volume 321541e4-41e8-4e1c-8e01-9d8503d8663e from snapshot 7cfd194d-12f0-4cb1-899c-76f9c9d8f457 {{(pid=82756) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 16 15:09:48 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-6657bd38-8e63-4c52-b2f7-3d58a270ca9a tempest-VolumesSnapshotTestJSON-1827115803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:09:48 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-6657bd38-8e63-4c52-b2f7-3d58a270ca9a tempest-VolumesSnapshotTestJSON-1827115803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:09:48 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-6657bd38-8e63-4c52-b2f7-3d58a270ca9a tempest-VolumesSnapshotTestJSON-1827115803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:09:48 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-6657bd38-8e63-4c52-b2f7-3d58a270ca9a tempest-VolumesSnapshotTestJSON-1827115803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:09:48 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-6657bd38-8e63-4c52-b2f7-3d58a270ca9a tempest-VolumesSnapshotTestJSON-1827115803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:09:48 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-6657bd38-8e63-4c52-b2f7-3d58a270ca9a tempest-VolumesSnapshotTestJSON-1827115803 None] Selected osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 as target Quobyte volume. {{(pid=82756) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 15:09:48 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-6657bd38-8e63-4c52-b2f7-3d58a270ca9a tempest-VolumesSnapshotTestJSON-1827115803 None] Acquiring lock "cinder-quobyte-321541e4-41e8-4e1c-8e01-9d8503d8663e" by "_copy_volume_from_snapshot" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:09:48 devstack cinder-volume[82756]: DEBUG cinder.volume.volume_utils [None req-6559d6d8-e51f-454a-abee-5222ae9648f1 tempest-VolumesExtendTest-595654496 None] Attempting download of b5f01913-4ea7-4cdb-8c76-10fda64d06e5 ((None, [{'url': 'file:///opt/stack/data/glance/images/b5f01913-4ea7-4cdb-8c76-10fda64d06e5', 'metadata': {}}])) to volume fcb0f077-b300-43e4-bb78-2c889d3ac83c. {{(pid=82756) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 16 15:09:48 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-6657bd38-8e63-4c52-b2f7-3d58a270ca9a tempest-VolumesSnapshotTestJSON-1827115803 None] Lock "cinder-quobyte-321541e4-41e8-4e1c-8e01-9d8503d8663e" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:09:48 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-6657bd38-8e63-4c52-b2f7-3d58a270ca9a tempest-VolumesSnapshotTestJSON-1827115803 None] snapshot: 7cfd194d-12f0-4cb1-899c-76f9c9d8f457, volume: 321541e4-41e8-4e1c-8e01-9d8503d8663e, {{(pid=82756) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 16 15:09:48 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-6657bd38-8e63-4c52-b2f7-3d58a270ca9a tempest-VolumesSnapshotTestJSON-1827115803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:09:48 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-6657bd38-8e63-4c52-b2f7-3d58a270ca9a tempest-VolumesSnapshotTestJSON-1827115803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:09:48 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-6657bd38-8e63-4c52-b2f7-3d58a270ca9a tempest-VolumesSnapshotTestJSON-1827115803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:09:48 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-6657bd38-8e63-4c52-b2f7-3d58a270ca9a tempest-VolumesSnapshotTestJSON-1827115803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:09:48 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-6657bd38-8e63-4c52-b2f7-3d58a270ca9a tempest-VolumesSnapshotTestJSON-1827115803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:09:48 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0cb98ca-0a12-40db-9290-b9f0e4e1c1de]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:09:48 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-6657bd38-8e63-4c52-b2f7-3d58a270ca9a tempest-VolumesSnapshotTestJSON-1827115803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-3525e5e2-ed94-4593-9b35-a690401c704f.7cfd194d-12f0-4cb1-899c-76f9c9d8f457 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:09:48 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa3e6ad7-47e2-48a2-a68f-938e8fa7ea5d]: (4, 'raw') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:09:48 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-6559d6d8-e51f-454a-abee-5222ae9648f1 tempest-VolumesExtendTest-595654496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b5f01913-4ea7-4cdb-8c76-10fda64d06e5_f2zn285r {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:09:49 devstack sudo[87821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b5f01913-4ea7-4cdb-8c76-10fda64d06e5_f2zn285r Apr 16 15:09:49 devstack sudo[87821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:09:49 devstack sudo[87820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-3525e5e2-ed94-4593-9b35-a690401c704f.7cfd194d-12f0-4cb1-899c-76f9c9d8f457 Apr 16 15:09:49 devstack sudo[87820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:09:49 devstack sudo[87821]: pam_unix(sudo:session): session closed for user root Apr 16 15:09:49 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-6559d6d8-e51f-454a-abee-5222ae9648f1 tempest-VolumesExtendTest-595654496 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b5f01913-4ea7-4cdb-8c76-10fda64d06e5_f2zn285r" returned: 0 in 0.619s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:09:49 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-6559d6d8-e51f-454a-abee-5222ae9648f1 tempest-VolumesExtendTest-595654496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5f01913-4ea7-4cdb-8c76-10fda64d06e5_f2zn285r {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:09:49 devstack sudo[87820]: pam_unix(sudo:session): session closed for user root Apr 16 15:09:49 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-6657bd38-8e63-4c52-b2f7-3d58a270ca9a tempest-VolumesSnapshotTestJSON-1827115803 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-3525e5e2-ed94-4593-9b35-a690401c704f.7cfd194d-12f0-4cb1-899c-76f9c9d8f457" returned: 0 in 0.667s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:09:49 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-6657bd38-8e63-4c52-b2f7-3d58a270ca9a tempest-VolumesSnapshotTestJSON-1827115803 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3525e5e2-ed94-4593-9b35-a690401c704f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82756) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 15:09:49 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-6657bd38-8e63-4c52-b2f7-3d58a270ca9a tempest-VolumesSnapshotTestJSON-1827115803 None] will copy from snapshot at /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-3525e5e2-ed94-4593-9b35-a690401c704f {{(pid=82756) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 16 15:09:49 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-6657bd38-8e63-4c52-b2f7-3d58a270ca9a tempest-VolumesSnapshotTestJSON-1827115803 None] Creating direct copy from snapshot {{(pid=82756) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 16 15:09:49 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[111eb2e3-bca4-42ff-a8f7-c75b3f35e600]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:09:49 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-6657bd38-8e63-4c52-b2f7-3d58a270ca9a tempest-VolumesSnapshotTestJSON-1827115803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-3525e5e2-ed94-4593-9b35-a690401c704f {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:09:49 devstack sudo[87829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5f01913-4ea7-4cdb-8c76-10fda64d06e5_f2zn285r Apr 16 15:09:49 devstack sudo[87829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:09:49 devstack sudo[87830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-3525e5e2-ed94-4593-9b35-a690401c704f Apr 16 15:09:49 devstack sudo[87830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:09:50 devstack sudo[87829]: pam_unix(sudo:session): session closed for user root Apr 16 15:09:50 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-6559d6d8-e51f-454a-abee-5222ae9648f1 tempest-VolumesExtendTest-595654496 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5f01913-4ea7-4cdb-8c76-10fda64d06e5_f2zn285r" returned: 1 in 0.882s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:09:50 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-6559d6d8-e51f-454a-abee-5222ae9648f1 tempest-VolumesExtendTest-595654496 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5f01913-4ea7-4cdb-8c76-10fda64d06e5_f2zn285r' failed. Not Retrying. {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 16 15:09:50 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f608ab1-f6a5-4096-8a72-a8eb6834864e]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:09:50 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-6559d6d8-e51f-454a-abee-5222ae9648f1 tempest-VolumesExtendTest-595654496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5f01913-4ea7-4cdb-8c76-10fda64d06e5_g1uu7lwadevstack@QuobyteHD {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:09:50 devstack sudo[87835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5f01913-4ea7-4cdb-8c76-10fda64d06e5_g1uu7lwadevstack@QuobyteHD Apr 16 15:09:50 devstack sudo[87835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:09:50 devstack sudo[87830]: pam_unix(sudo:session): session closed for user root Apr 16 15:09:50 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-6657bd38-8e63-4c52-b2f7-3d58a270ca9a tempest-VolumesSnapshotTestJSON-1827115803 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-3525e5e2-ed94-4593-9b35-a690401c704f" returned: 0 in 1.141s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:09:50 devstack cinder-volume[82756]: DEBUG cinder.utils [None req-6657bd38-8e63-4c52-b2f7-3d58a270ca9a tempest-VolumesSnapshotTestJSON-1827115803 None] Path /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-321541e4-41e8-4e1c-8e01-9d8503d8663e not found in is_blk_device check {{(pid=82756) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 16 15:09:50 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-6657bd38-8e63-4c52-b2f7-3d58a270ca9a tempest-VolumesSnapshotTestJSON-1827115803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-3525e5e2-ed94-4593-9b35-a690401c704f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-321541e4-41e8-4e1c-8e01-9d8503d8663e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:09:50 devstack sudo[87841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-3525e5e2-ed94-4593-9b35-a690401c704f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-321541e4-41e8-4e1c-8e01-9d8503d8663e Apr 16 15:09:50 devstack sudo[87841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:09:51 devstack sudo[87835]: pam_unix(sudo:session): session closed for user root Apr 16 15:09:51 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-6559d6d8-e51f-454a-abee-5222ae9648f1 tempest-VolumesExtendTest-595654496 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5f01913-4ea7-4cdb-8c76-10fda64d06e5_g1uu7lwadevstack@QuobyteHD" returned: 0 in 1.115s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:09:51 devstack cinder-volume[82756]: DEBUG cinder.image.image_utils [None req-6559d6d8-e51f-454a-abee-5222ae9648f1 tempest-VolumesExtendTest-595654496 None] b5f01913-4ea7-4cdb-8c76-10fda64d06e5 was qcow2, converting to raw {{(pid=82756) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 16 15:09:51 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-6559d6d8-e51f-454a-abee-5222ae9648f1 tempest-VolumesExtendTest-595654496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b5f01913-4ea7-4cdb-8c76-10fda64d06e5_g1uu7lwadevstack@QuobyteHD /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-fcb0f077-b300-43e4-bb78-2c889d3ac83c {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:09:51 devstack sudo[87849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b5f01913-4ea7-4cdb-8c76-10fda64d06e5_g1uu7lwadevstack@QuobyteHD /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-fcb0f077-b300-43e4-bb78-2c889d3ac83c Apr 16 15:09:51 devstack sudo[87849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:09:51 devstack cinder-volume[82756]: DEBUG oslo_service.periodic_task [None req-9570f02d-5ef9-412b-993f-520a9e5bfa81 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82756) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 16 15:09:51 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-9570f02d-5ef9-412b-993f-520a9e5bfa81 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:09:51 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-9570f02d-5ef9-412b-993f-520a9e5bfa81 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:09:51 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-9570f02d-5ef9-412b-993f-520a9e5bfa81 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:09:51 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-9570f02d-5ef9-412b-993f-520a9e5bfa81 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:09:51 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-9570f02d-5ef9-412b-993f-520a9e5bfa81 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:09:51 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-9570f02d-5ef9-412b-993f-520a9e5bfa81 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:09:51 devstack sudo[87858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:09:51 devstack sudo[87858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:09:54 devstack sudo[87858]: pam_unix(sudo:session): session closed for user root Apr 16 15:09:54 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-9570f02d-5ef9-412b-993f-520a9e5bfa81 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 2.638s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:09:54 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-9570f02d-5ef9-412b-993f-520a9e5bfa81 None None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:09:54 devstack sudo[87841]: pam_unix(sudo:session): session closed for user root Apr 16 15:09:54 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-6657bd38-8e63-4c52-b2f7-3d58a270ca9a tempest-VolumesSnapshotTestJSON-1827115803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-3525e5e2-ed94-4593-9b35-a690401c704f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-321541e4-41e8-4e1c-8e01-9d8503d8663e" returned: 0 in 3.702s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:09:54 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[b79e8e0a-8f32-4626-842a-89bb2726265f]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:09:54 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-6657bd38-8e63-4c52-b2f7-3d58a270ca9a tempest-VolumesSnapshotTestJSON-1827115803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-3525e5e2-ed94-4593-9b35-a690401c704f {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:09:54 devstack sudo[87887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-3525e5e2-ed94-4593-9b35-a690401c704f Apr 16 15:09:54 devstack sudo[87887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:09:54 devstack sudo[87849]: pam_unix(sudo:session): session closed for user root Apr 16 15:09:54 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-6559d6d8-e51f-454a-abee-5222ae9648f1 tempest-VolumesExtendTest-595654496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b5f01913-4ea7-4cdb-8c76-10fda64d06e5_g1uu7lwadevstack@QuobyteHD /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-fcb0f077-b300-43e4-bb78-2c889d3ac83c" returned: 0 in 3.324s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:09:54 devstack cinder-volume[82756]: DEBUG cinder.image.image_utils [None req-6559d6d8-e51f-454a-abee-5222ae9648f1 tempest-VolumesExtendTest-595654496 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b5f01913-4ea7-4cdb-8c76-10fda64d06e5_g1uu7lwadevstack@QuobyteHD, size 112.00 MB, duration 3.33 sec, destination /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-fcb0f077-b300-43e4-bb78-2c889d3ac83c {{(pid=82756) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 15:09:54 devstack cinder-volume[82756]: INFO cinder.image.image_utils [None req-6559d6d8-e51f-454a-abee-5222ae9648f1 tempest-VolumesExtendTest-595654496 None] Converted 112.00 MB image at 33.67 MB/s Apr 16 15:09:54 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-6559d6d8-e51f-454a-abee-5222ae9648f1 tempest-VolumesExtendTest-595654496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-fcb0f077-b300-43e4-bb78-2c889d3ac83c 1G {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:09:54 devstack sudo[87889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-fcb0f077-b300-43e4-bb78-2c889d3ac83c 1G Apr 16 15:09:54 devstack sudo[87889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:09:55 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e2a02a2-f848-4e9f-b000-bbb8ed8a49dc tempest-VolumesCloneTest-887639088 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82756) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 15:09:55 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-1e2a02a2-f848-4e9f-b000-bbb8ed8a49dc tempest-VolumesCloneTest-887639088 None] Flow 'volume_create_manager' (a62b61d1-9c29-4587-a0f5-2c580c8096d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:09:55 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-1e2a02a2-f848-4e9f-b000-bbb8ed8a49dc tempest-VolumesCloneTest-887639088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65b12163-4ad0-420c-803f-831bc7f387d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:09:55 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-1e2a02a2-f848-4e9f-b000-bbb8ed8a49dc tempest-VolumesCloneTest-887639088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65b12163-4ad0-420c-803f-831bc7f387d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:09:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1856041392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b51850cd-06d0-4227-b958-3335cb6be717,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6abf7ce2ba6c427b919cdd4affbbc38f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:09:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:09:55Z,use_quota=True,user_id='3dbc4176ce2c499f87465c41afe42c53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:09:55 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-1e2a02a2-f848-4e9f-b000-bbb8ed8a49dc tempest-VolumesCloneTest-887639088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ba75908-2cf4-44a5-8c03-e9f3abc96de5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:09:55 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-1e2a02a2-f848-4e9f-b000-bbb8ed8a49dc tempest-VolumesCloneTest-887639088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ba75908-2cf4-44a5-8c03-e9f3abc96de5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:09:55 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-1e2a02a2-f848-4e9f-b000-bbb8ed8a49dc tempest-VolumesCloneTest-887639088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fca37b7-9094-47cd-bf90-41784badc30b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:09:55 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-1e2a02a2-f848-4e9f-b000-bbb8ed8a49dc tempest-VolumesCloneTest-887639088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fca37b7-9094-47cd-bf90-41784badc30b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b51850cd-06d0-4227-b958-3335cb6be717', 'volume_name': 'volume-b51850cd-06d0-4227-b958-3335cb6be717', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:09:55 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-1e2a02a2-f848-4e9f-b000-bbb8ed8a49dc tempest-VolumesCloneTest-887639088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d9db785-7854-4813-8b45-18f9e04edeab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:09:55 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-1e2a02a2-f848-4e9f-b000-bbb8ed8a49dc tempest-VolumesCloneTest-887639088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d9db785-7854-4813-8b45-18f9e04edeab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:09:55 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-1e2a02a2-f848-4e9f-b000-bbb8ed8a49dc tempest-VolumesCloneTest-887639088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a534f51-6e57-465b-acbb-ca3189091bd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:09:55 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-1e2a02a2-f848-4e9f-b000-bbb8ed8a49dc tempest-VolumesCloneTest-887639088 None] Volume b51850cd-06d0-4227-b958-3335cb6be717: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b51850cd-06d0-4227-b958-3335cb6be717', 'volume_size': 1} Apr 16 15:09:55 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-1e2a02a2-f848-4e9f-b000-bbb8ed8a49dc tempest-VolumesCloneTest-887639088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:09:55 devstack sudo[87889]: pam_unix(sudo:session): session closed for user root Apr 16 15:09:55 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-6559d6d8-e51f-454a-abee-5222ae9648f1 tempest-VolumesExtendTest-595654496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-fcb0f077-b300-43e4-bb78-2c889d3ac83c 1G" returned: 0 in 0.447s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:09:55 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6fb171d-2f62-4eb7-8d38-f58814700135]: (4, 'raw') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:09:55 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-6559d6d8-e51f-454a-abee-5222ae9648f1 tempest-VolumesExtendTest-595654496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-fcb0f077-b300-43e4-bb78-2c889d3ac83c {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:09:55 devstack sudo[87887]: pam_unix(sudo:session): session closed for user root Apr 16 15:09:55 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-6657bd38-8e63-4c52-b2f7-3d58a270ca9a tempest-VolumesSnapshotTestJSON-1827115803 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-3525e5e2-ed94-4593-9b35-a690401c704f" returned: 0 in 0.927s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:09:55 devstack cinder-volume[82756]: DEBUG cinder.image.image_utils [None req-6657bd38-8e63-4c52-b2f7-3d58a270ca9a tempest-VolumesSnapshotTestJSON-1827115803 None] Image conversion details: src /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-3525e5e2-ed94-4593-9b35-a690401c704f, size 1024.00 MB, duration 3.70 sec, destination /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-321541e4-41e8-4e1c-8e01-9d8503d8663e {{(pid=82756) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 15:09:55 devstack cinder-volume[82756]: INFO cinder.image.image_utils [None req-6657bd38-8e63-4c52-b2f7-3d58a270ca9a tempest-VolumesSnapshotTestJSON-1827115803 None] Converted 1024.00 MB image at 276.48 MB/s Apr 16 15:09:55 devstack cinder-volume[82756]: WARNING cinder.volume.drivers.remotefs [None req-6657bd38-8e63-4c52-b2f7-3d58a270ca9a tempest-VolumesSnapshotTestJSON-1827115803 None] /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-321541e4-41e8-4e1c-8e01-9d8503d8663e is being set with open permissions: ugo+rw Apr 16 15:09:55 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-6657bd38-8e63-4c52-b2f7-3d58a270ca9a tempest-VolumesSnapshotTestJSON-1827115803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-321541e4-41e8-4e1c-8e01-9d8503d8663e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:09:55 devstack sudo[87897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-fcb0f077-b300-43e4-bb78-2c889d3ac83c Apr 16 15:09:55 devstack sudo[87897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:09:55 devstack sudo[87898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-321541e4-41e8-4e1c-8e01-9d8503d8663e Apr 16 15:09:55 devstack sudo[87898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:09:55 devstack sudo[87898]: pam_unix(sudo:session): session closed for user root Apr 16 15:09:55 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-6657bd38-8e63-4c52-b2f7-3d58a270ca9a tempest-VolumesSnapshotTestJSON-1827115803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-321541e4-41e8-4e1c-8e01-9d8503d8663e" returned: 0 in 0.470s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:09:55 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-6657bd38-8e63-4c52-b2f7-3d58a270ca9a tempest-VolumesSnapshotTestJSON-1827115803 None] Lock "cinder-quobyte-321541e4-41e8-4e1c-8e01-9d8503d8663e" released by "_copy_volume_from_snapshot" :: held 7.038s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:09:55 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-6657bd38-8e63-4c52-b2f7-3d58a270ca9a tempest-VolumesSnapshotTestJSON-1827115803 None] Lock "cinder-quobyte-7cfd194d-12f0-4cb1-899c-76f9c9d8f457-321541e4-41e8-4e1c-8e01-9d8503d8663e" released by "_create_volume_from_snapshot" :: held 7.061s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:09:55 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-6657bd38-8e63-4c52-b2f7-3d58a270ca9a tempest-VolumesSnapshotTestJSON-1827115803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.083s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:09:55 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-1e2a02a2-f848-4e9f-b000-bbb8ed8a49dc tempest-VolumesCloneTest-887639088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.712s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:09:55 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-1e2a02a2-f848-4e9f-b000-bbb8ed8a49dc tempest-VolumesCloneTest-887639088 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:09:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1856041392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b51850cd-06d0-4227-b958-3335cb6be717,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6abf7ce2ba6c427b919cdd4affbbc38f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:09:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:09:55Z,use_quota=True,user_id='3dbc4176ce2c499f87465c41afe42c53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)}" {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 15:09:55 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-1e2a02a2-f848-4e9f-b000-bbb8ed8a49dc tempest-VolumesCloneTest-887639088 None] Creating volume b51850cd-06d0-4227-b958-3335cb6be717 {{(pid=82756) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 15:09:55 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-1e2a02a2-f848-4e9f-b000-bbb8ed8a49dc tempest-VolumesCloneTest-887639088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:09:55 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-1e2a02a2-f848-4e9f-b000-bbb8ed8a49dc tempest-VolumesCloneTest-887639088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:09:55 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-1e2a02a2-f848-4e9f-b000-bbb8ed8a49dc tempest-VolumesCloneTest-887639088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:09:55 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-1e2a02a2-f848-4e9f-b000-bbb8ed8a49dc tempest-VolumesCloneTest-887639088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:09:55 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-1e2a02a2-f848-4e9f-b000-bbb8ed8a49dc tempest-VolumesCloneTest-887639088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:09:55 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-1e2a02a2-f848-4e9f-b000-bbb8ed8a49dc tempest-VolumesCloneTest-887639088 None] Selected osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 as target Quobyte volume. {{(pid=82756) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 15:09:55 devstack cinder-volume[82756]: INFO cinder.volume.drivers.remotefs [None req-1e2a02a2-f848-4e9f-b000-bbb8ed8a49dc tempest-VolumesCloneTest-887639088 None] casted to osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 Apr 16 15:09:55 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-1e2a02a2-f848-4e9f-b000-bbb8ed8a49dc tempest-VolumesCloneTest-887639088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b51850cd-06d0-4227-b958-3335cb6be717 1073741824 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:09:55 devstack sudo[87897]: pam_unix(sudo:session): session closed for user root Apr 16 15:09:55 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-6559d6d8-e51f-454a-abee-5222ae9648f1 tempest-VolumesExtendTest-595654496 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-fcb0f077-b300-43e4-bb78-2c889d3ac83c" returned: 0 in 0.580s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:09:55 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-6559d6d8-e51f-454a-abee-5222ae9648f1 tempest-VolumesExtendTest-595654496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-fcb0f077-b300-43e4-bb78-2c889d3ac83c {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:09:55 devstack sudo[87904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b51850cd-06d0-4227-b958-3335cb6be717 1073741824 Apr 16 15:09:55 devstack sudo[87904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:09:55 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-6657bd38-8e63-4c52-b2f7-3d58a270ca9a tempest-VolumesSnapshotTestJSON-1827115803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd0a3ad2-4ae8-4b50-bf18-0596729516aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-321541e4-41e8-4e1c-8e01-9d8503d8663e', 'volume_size': 1, 'snapshot_id': '7cfd194d-12f0-4cb1-899c-76f9c9d8f457'}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:09:55 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-6657bd38-8e63-4c52-b2f7-3d58a270ca9a tempest-VolumesSnapshotTestJSON-1827115803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6293950-b8f2-4f0f-b92b-4af221e18e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:09:55 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-6657bd38-8e63-4c52-b2f7-3d58a270ca9a tempest-VolumesSnapshotTestJSON-1827115803 None] Volume volume-321541e4-41e8-4e1c-8e01-9d8503d8663e (321541e4-41e8-4e1c-8e01-9d8503d8663e): created successfully Apr 16 15:09:55 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-6657bd38-8e63-4c52-b2f7-3d58a270ca9a tempest-VolumesSnapshotTestJSON-1827115803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6293950-b8f2-4f0f-b92b-4af221e18e77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:09:56 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-6657bd38-8e63-4c52-b2f7-3d58a270ca9a tempest-VolumesSnapshotTestJSON-1827115803 None] Flow 'volume_create_manager' (f5aac9ff-0b4b-466a-b46e-a8f65f9d0090) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:09:56 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-6657bd38-8e63-4c52-b2f7-3d58a270ca9a tempest-VolumesSnapshotTestJSON-1827115803 None] Created volume successfully. Apr 16 15:09:56 devstack sudo[87905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-fcb0f077-b300-43e4-bb78-2c889d3ac83c Apr 16 15:09:56 devstack sudo[87905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:09:56 devstack sudo[87905]: pam_unix(sudo:session): session closed for user root Apr 16 15:09:56 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-6559d6d8-e51f-454a-abee-5222ae9648f1 tempest-VolumesExtendTest-595654496 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-fcb0f077-b300-43e4-bb78-2c889d3ac83c" returned: 1 in 0.687s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:09:56 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-6559d6d8-e51f-454a-abee-5222ae9648f1 tempest-VolumesExtendTest-595654496 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-fcb0f077-b300-43e4-bb78-2c889d3ac83c' failed. Not Retrying. {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 16 15:09:56 devstack cinder-volume[82756]: DEBUG cinder.volume.volume_utils [None req-6559d6d8-e51f-454a-abee-5222ae9648f1 tempest-VolumesExtendTest-595654496 None] Downloaded image b5f01913-4ea7-4cdb-8c76-10fda64d06e5 ((None, [{'url': 'file:///opt/stack/data/glance/images/b5f01913-4ea7-4cdb-8c76-10fda64d06e5', 'metadata': {}}])) to volume fcb0f077-b300-43e4-bb78-2c889d3ac83c successfully. {{(pid=82756) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 16 15:09:56 devstack cinder-volume[82756]: DEBUG cinder.image.image_utils [None req-6559d6d8-e51f-454a-abee-5222ae9648f1 tempest-VolumesExtendTest-595654496 None] Temporary image b5f01913-4ea7-4cdb-8c76-10fda64d06e5 for user f438223713b1407e98774448ae7410f4 is deleted. {{(pid=82756) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 16 15:09:56 devstack cinder-volume[82756]: DEBUG cinder.volume.volume_utils [None req-6559d6d8-e51f-454a-abee-5222ae9648f1 tempest-VolumesExtendTest-595654496 None] Marking volume fcb0f077-b300-43e4-bb78-2c889d3ac83c as bootable. {{(pid=82756) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 16 15:09:56 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [None req-6559d6d8-e51f-454a-abee-5222ae9648f1 tempest-VolumesExtendTest-595654496 None] Copying metadata from image b5f01913-4ea7-4cdb-8c76-10fda64d06e5 to fcb0f077-b300-43e4-bb78-2c889d3ac83c. {{(pid=82756) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 16 15:09:56 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [None req-6559d6d8-e51f-454a-abee-5222ae9648f1 tempest-VolumesExtendTest-595654496 None] Creating volume glance metadata for volume fcb0f077-b300-43e4-bb78-2c889d3ac83c backed by image b5f01913-4ea7-4cdb-8c76-10fda64d06e5 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b5f01913-4ea7-4cdb-8c76-10fda64d06e5', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82756) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 16 15:09:56 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-26d614b2-1521-4be9-81f1-9691ad620213 tempest-VolumesSnapshotTestJSON-1827115803 None] Acquiring lock "cinder-321541e4-41e8-4e1c-8e01-9d8503d8663e-delete_volume" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:09:56 devstack sudo[87904]: pam_unix(sudo:session): session closed for user root Apr 16 15:09:56 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-1e2a02a2-f848-4e9f-b000-bbb8ed8a49dc tempest-VolumesCloneTest-887639088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b51850cd-06d0-4227-b958-3335cb6be717 1073741824" returned: 0 in 0.831s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:09:56 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-26d614b2-1521-4be9-81f1-9691ad620213 tempest-VolumesSnapshotTestJSON-1827115803 None] Lock "cinder-321541e4-41e8-4e1c-8e01-9d8503d8663e-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:09:56 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-26d614b2-1521-4be9-81f1-9691ad620213 tempest-VolumesSnapshotTestJSON-1827115803 None] Acquiring lock "cinder-quobyte-321541e4-41e8-4e1c-8e01-9d8503d8663e" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:09:56 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-26d614b2-1521-4be9-81f1-9691ad620213 tempest-VolumesSnapshotTestJSON-1827115803 None] Lock "cinder-quobyte-321541e4-41e8-4e1c-8e01-9d8503d8663e" acquired by "delete_volume" :: waited 0.020s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:09:56 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-6559d6d8-e51f-454a-abee-5222ae9648f1 tempest-VolumesExtendTest-595654496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4428ddf4-e90e-4cfd-825a-7f8cd9896d66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fcb0f077-b300-43e4-bb78-2c889d3ac83c', 'volume_size': 1, 'image_id': 'b5f01913-4ea7-4cdb-8c76-10fda64d06e5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b5f01913-4ea7-4cdb-8c76-10fda64d06e5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '42394d2631114f428489519b24c78a03', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b5f01913-4ea7-4cdb-8c76-10fda64d06e5', 'created_at': datetime.datetime(2026, 4, 16, 13, 0, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 16, 13, 0, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b5f01913-4ea7-4cdb-8c76-10fda64d06e5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:09:56 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-6559d6d8-e51f-454a-abee-5222ae9648f1 tempest-VolumesExtendTest-595654496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a4ec404-f174-41d8-aa67-65e3ccb4a297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:09:56 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[57c069c5-dc7e-4036-9b78-5ef9c46c9129]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:09:56 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-26d614b2-1521-4be9-81f1-9691ad620213 tempest-VolumesSnapshotTestJSON-1827115803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-321541e4-41e8-4e1c-8e01-9d8503d8663e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:09:56 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-6559d6d8-e51f-454a-abee-5222ae9648f1 tempest-VolumesExtendTest-595654496 None] Volume volume-fcb0f077-b300-43e4-bb78-2c889d3ac83c (fcb0f077-b300-43e4-bb78-2c889d3ac83c): created successfully Apr 16 15:09:56 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-6559d6d8-e51f-454a-abee-5222ae9648f1 tempest-VolumesExtendTest-595654496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a4ec404-f174-41d8-aa67-65e3ccb4a297) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:09:56 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-6559d6d8-e51f-454a-abee-5222ae9648f1 tempest-VolumesExtendTest-595654496 None] Flow 'volume_create_manager' (300e55da-91cf-488a-a70f-5b47fa923984) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:09:56 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-6559d6d8-e51f-454a-abee-5222ae9648f1 tempest-VolumesExtendTest-595654496 None] Created volume successfully. Apr 16 15:09:56 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-1e2a02a2-f848-4e9f-b000-bbb8ed8a49dc tempest-VolumesCloneTest-887639088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b51850cd-06d0-4227-b958-3335cb6be717 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:09:56 devstack sudo[87916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b51850cd-06d0-4227-b958-3335cb6be717 Apr 16 15:09:56 devstack sudo[87916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:09:56 devstack sudo[87915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-321541e4-41e8-4e1c-8e01-9d8503d8663e Apr 16 15:09:56 devstack sudo[87915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:09:57 devstack sudo[87916]: pam_unix(sudo:session): session closed for user root Apr 16 15:09:57 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-1e2a02a2-f848-4e9f-b000-bbb8ed8a49dc tempest-VolumesCloneTest-887639088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b51850cd-06d0-4227-b958-3335cb6be717" returned: 0 in 0.558s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:09:57 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-1e2a02a2-f848-4e9f-b000-bbb8ed8a49dc tempest-VolumesCloneTest-887639088 None] <== create_volume: return (1524ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'} {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 15:09:57 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-1e2a02a2-f848-4e9f-b000-bbb8ed8a49dc tempest-VolumesCloneTest-887639088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.527s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:09:57 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-1e2a02a2-f848-4e9f-b000-bbb8ed8a49dc tempest-VolumesCloneTest-887639088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a534f51-6e57-465b-acbb-ca3189091bd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b51850cd-06d0-4227-b958-3335cb6be717', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:09:57 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-1e2a02a2-f848-4e9f-b000-bbb8ed8a49dc tempest-VolumesCloneTest-887639088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da0a7a8b-3aa7-42a8-b94a-4f9b256d4ade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:09:57 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-1e2a02a2-f848-4e9f-b000-bbb8ed8a49dc tempest-VolumesCloneTest-887639088 None] Volume volume-b51850cd-06d0-4227-b958-3335cb6be717 (b51850cd-06d0-4227-b958-3335cb6be717): created successfully Apr 16 15:09:57 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-1e2a02a2-f848-4e9f-b000-bbb8ed8a49dc tempest-VolumesCloneTest-887639088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da0a7a8b-3aa7-42a8-b94a-4f9b256d4ade) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:09:57 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-1e2a02a2-f848-4e9f-b000-bbb8ed8a49dc tempest-VolumesCloneTest-887639088 None] Flow 'volume_create_manager' (a62b61d1-9c29-4587-a0f5-2c580c8096d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:09:57 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-1e2a02a2-f848-4e9f-b000-bbb8ed8a49dc tempest-VolumesCloneTest-887639088 None] Created volume successfully. Apr 16 15:09:57 devstack sudo[87915]: pam_unix(sudo:session): session closed for user root Apr 16 15:09:57 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-26d614b2-1521-4be9-81f1-9691ad620213 tempest-VolumesSnapshotTestJSON-1827115803 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-321541e4-41e8-4e1c-8e01-9d8503d8663e" returned: 0 in 0.676s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:09:57 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-26d614b2-1521-4be9-81f1-9691ad620213 tempest-VolumesSnapshotTestJSON-1827115803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-321541e4-41e8-4e1c-8e01-9d8503d8663e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:09:57 devstack sudo[87926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-321541e4-41e8-4e1c-8e01-9d8503d8663e Apr 16 15:09:57 devstack sudo[87926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:09:57 devstack sudo[87926]: pam_unix(sudo:session): session closed for user root Apr 16 15:09:58 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-26d614b2-1521-4be9-81f1-9691ad620213 tempest-VolumesSnapshotTestJSON-1827115803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-321541e4-41e8-4e1c-8e01-9d8503d8663e" returned: 0 in 0.514s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:09:58 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-26d614b2-1521-4be9-81f1-9691ad620213 tempest-VolumesSnapshotTestJSON-1827115803 None] Lock "cinder-quobyte-321541e4-41e8-4e1c-8e01-9d8503d8663e" released by "delete_volume" :: held 1.234s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:09:58 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-26d614b2-1521-4be9-81f1-9691ad620213 tempest-VolumesSnapshotTestJSON-1827115803 None] Created reservations ['54d9b226-7315-4a43-ad53-0fb9f0c8161e', 'c4313b88-a2da-4464-83ee-ae92325a3ec4', 'dd8d72a3-a4a8-4bbe-8912-6b7b2bc785de', 'ba67d1dd-ca7f-4571-91ec-f6856ef997a0'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:09:58 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-d6174946-e7d7-45fd-a86f-a298d831cbe6 tempest-VolumesExtendTest-595654496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:09:58 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-d6174946-e7d7-45fd-a86f-a298d831cbe6 tempest-VolumesExtendTest-595654496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:09:58 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[63299be0-34dc-4edf-8b84-1568e6a65c7c]: (4, 'raw') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:09:58 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-d6174946-e7d7-45fd-a86f-a298d831cbe6 tempest-VolumesExtendTest-595654496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-fcb0f077-b300-43e4-bb78-2c889d3ac83c {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:09:58 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-26d614b2-1521-4be9-81f1-9691ad620213 tempest-VolumesSnapshotTestJSON-1827115803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:09:58 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-26d614b2-1521-4be9-81f1-9691ad620213 tempest-VolumesSnapshotTestJSON-1827115803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:09:58 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-26d614b2-1521-4be9-81f1-9691ad620213 tempest-VolumesSnapshotTestJSON-1827115803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:09:58 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-26d614b2-1521-4be9-81f1-9691ad620213 tempest-VolumesSnapshotTestJSON-1827115803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:09:58 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-26d614b2-1521-4be9-81f1-9691ad620213 tempest-VolumesSnapshotTestJSON-1827115803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:09:58 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-26d614b2-1521-4be9-81f1-9691ad620213 tempest-VolumesSnapshotTestJSON-1827115803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:09:58 devstack sudo[87930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:09:58 devstack sudo[87930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:09:58 devstack sudo[87929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-fcb0f077-b300-43e4-bb78-2c889d3ac83c Apr 16 15:09:58 devstack sudo[87929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:09:58 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [None req-b19be0ee-0a54-45d2-b763-0b0d5c700d57 tempest-VolumesCloneTest-887639088 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82756) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 15:09:58 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-b19be0ee-0a54-45d2-b763-0b0d5c700d57 tempest-VolumesCloneTest-887639088 None] Flow 'volume_create_manager' (c4ad6d36-a159-4b92-a695-efa33d6a5694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:09:58 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-b19be0ee-0a54-45d2-b763-0b0d5c700d57 tempest-VolumesCloneTest-887639088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9c48835-2bf0-4bbf-9f73-b83a307bfd50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:09:58 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-b19be0ee-0a54-45d2-b763-0b0d5c700d57 tempest-VolumesCloneTest-887639088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9c48835-2bf0-4bbf-9f73-b83a307bfd50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:09:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-114463690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fa599a3-c7a7-4c24-a671-c856bd87dcd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6abf7ce2ba6c427b919cdd4affbbc38f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:09:59Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=b51850cd-06d0-4227-b958-3335cb6be717,status='creating',terminated_at=None,updated_at=2026-04-16T13:09:59Z,use_quota=True,user_id='3dbc4176ce2c499f87465c41afe42c53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:09:58 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-b19be0ee-0a54-45d2-b763-0b0d5c700d57 tempest-VolumesCloneTest-887639088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (985c2365-dc33-4b4c-b4ba-aaa44a165ad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:09:58 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-b19be0ee-0a54-45d2-b763-0b0d5c700d57 tempest-VolumesCloneTest-887639088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (985c2365-dc33-4b4c-b4ba-aaa44a165ad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:09:58 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-b19be0ee-0a54-45d2-b763-0b0d5c700d57 tempest-VolumesCloneTest-887639088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ae462ca-91fa-47f7-b74f-c23d3fbd5036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:09:58 devstack sudo[87930]: pam_unix(sudo:session): session closed for user root Apr 16 15:09:58 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-b19be0ee-0a54-45d2-b763-0b0d5c700d57 tempest-VolumesCloneTest-887639088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ae462ca-91fa-47f7-b74f-c23d3fbd5036) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '2fa599a3-c7a7-4c24-a671-c856bd87dcd2', 'volume_name': 'volume-2fa599a3-c7a7-4c24-a671-c856bd87dcd2', 'volume_size': 2, 'source_volid': 'b51850cd-06d0-4227-b958-3335cb6be717', 'source_volstatus': 'available'}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:09:58 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-b19be0ee-0a54-45d2-b763-0b0d5c700d57 tempest-VolumesCloneTest-887639088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10877de4-53f0-46b8-b46f-9a0db6aab8ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:09:58 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-b19be0ee-0a54-45d2-b763-0b0d5c700d57 tempest-VolumesCloneTest-887639088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10877de4-53f0-46b8-b46f-9a0db6aab8ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:09:58 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-b19be0ee-0a54-45d2-b763-0b0d5c700d57 tempest-VolumesCloneTest-887639088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c210dc5e-0abd-4db4-91d3-e563483cf9f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:09:58 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-b19be0ee-0a54-45d2-b763-0b0d5c700d57 tempest-VolumesCloneTest-887639088 None] Volume 2fa599a3-c7a7-4c24-a671-c856bd87dcd2: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-2fa599a3-c7a7-4c24-a671-c856bd87dcd2', 'volume_size': 2, 'source_volid': 'b51850cd-06d0-4227-b958-3335cb6be717', 'source_volstatus': 'available'} Apr 16 15:09:58 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-26d614b2-1521-4be9-81f1-9691ad620213 tempest-VolumesSnapshotTestJSON-1827115803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.805s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:09:58 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-26d614b2-1521-4be9-81f1-9691ad620213 tempest-VolumesSnapshotTestJSON-1827115803 None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:09:58 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-b19be0ee-0a54-45d2-b763-0b0d5c700d57 tempest-VolumesCloneTest-887639088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:09:58 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-26d614b2-1521-4be9-81f1-9691ad620213 tempest-VolumesSnapshotTestJSON-1827115803 None] Deleted volume successfully. Apr 16 15:09:59 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-26d614b2-1521-4be9-81f1-9691ad620213 tempest-VolumesSnapshotTestJSON-1827115803 None] Lock "cinder-321541e4-41e8-4e1c-8e01-9d8503d8663e-delete_volume" released by "delete_volume" :: held 2.298s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:09:59 devstack sudo[87929]: pam_unix(sudo:session): session closed for user root Apr 16 15:09:59 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-d6174946-e7d7-45fd-a86f-a298d831cbe6 tempest-VolumesExtendTest-595654496 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-fcb0f077-b300-43e4-bb78-2c889d3ac83c" returned: 0 in 1.117s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:09:59 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-d6174946-e7d7-45fd-a86f-a298d831cbe6 tempest-VolumesExtendTest-595654496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-fcb0f077-b300-43e4-bb78-2c889d3ac83c {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:09:59 devstack sudo[87963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-fcb0f077-b300-43e4-bb78-2c889d3ac83c Apr 16 15:09:59 devstack sudo[87963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:09:59 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-a943322b-ef77-4163-9345-31823cb41514 tempest-VolumesSnapshotTestJSON-1827115803 None] Acquiring lock "cinder-7cfd194d-12f0-4cb1-899c-76f9c9d8f457-delete_snapshot" by "delete_snapshot" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:09:59 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-a943322b-ef77-4163-9345-31823cb41514 tempest-VolumesSnapshotTestJSON-1827115803 None] Lock "cinder-7cfd194d-12f0-4cb1-899c-76f9c9d8f457-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:09:59 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-a943322b-ef77-4163-9345-31823cb41514 tempest-VolumesSnapshotTestJSON-1827115803 None] Acquiring lock "cinder-quobyte-3525e5e2-ed94-4593-9b35-a690401c704f" by "delete_snapshot" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:09:59 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-a943322b-ef77-4163-9345-31823cb41514 tempest-VolumesSnapshotTestJSON-1827115803 None] Lock "cinder-quobyte-3525e5e2-ed94-4593-9b35-a690401c704f" acquired by "delete_snapshot" :: waited 0.025s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:09:59 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-a943322b-ef77-4163-9345-31823cb41514 tempest-VolumesSnapshotTestJSON-1827115803 None] Acquiring lock "cinder-quobyte-7cfd194d-12f0-4cb1-899c-76f9c9d8f457" by "_delete_snapshot" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:09:59 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-a943322b-ef77-4163-9345-31823cb41514 tempest-VolumesSnapshotTestJSON-1827115803 None] Lock "cinder-quobyte-7cfd194d-12f0-4cb1-899c-76f9c9d8f457" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:09:59 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-a943322b-ef77-4163-9345-31823cb41514 tempest-VolumesSnapshotTestJSON-1827115803 None] Deleting offline snapshot 7cfd194d-12f0-4cb1-899c-76f9c9d8f457 of volume 3525e5e2-ed94-4593-9b35-a690401c704f {{(pid=82756) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 15:09:59 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-a943322b-ef77-4163-9345-31823cb41514 tempest-VolumesSnapshotTestJSON-1827115803 None] snapshot_file for this snap is: volume-3525e5e2-ed94-4593-9b35-a690401c704f.7cfd194d-12f0-4cb1-899c-76f9c9d8f457 {{(pid=82756) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 15:09:59 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[0164055c-a3d7-4de5-ab50-b736d86cea4f]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:09:59 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-a943322b-ef77-4163-9345-31823cb41514 tempest-VolumesSnapshotTestJSON-1827115803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-3525e5e2-ed94-4593-9b35-a690401c704f.7cfd194d-12f0-4cb1-899c-76f9c9d8f457 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:09:59 devstack sudo[87969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-3525e5e2-ed94-4593-9b35-a690401c704f.7cfd194d-12f0-4cb1-899c-76f9c9d8f457 Apr 16 15:09:59 devstack sudo[87969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:00 devstack sudo[87963]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:00 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-d6174946-e7d7-45fd-a86f-a298d831cbe6 tempest-VolumesExtendTest-595654496 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-fcb0f077-b300-43e4-bb78-2c889d3ac83c" returned: 1 in 1.007s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:00 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-d6174946-e7d7-45fd-a86f-a298d831cbe6 tempest-VolumesExtendTest-595654496 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-fcb0f077-b300-43e4-bb78-2c889d3ac83c' failed. Not Retrying. {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 16 15:10:00 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-d6174946-e7d7-45fd-a86f-a298d831cbe6 tempest-VolumesExtendTest-595654496 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-fcb0f077-b300-43e4-bb78-2c889d3ac83c 2G {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:00 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-d6174946-e7d7-45fd-a86f-a298d831cbe6 tempest-VolumesExtendTest-595654496 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-fcb0f077-b300-43e4-bb78-2c889d3ac83c 2G" returned: 0 in 0.119s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:00 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-d6174946-e7d7-45fd-a86f-a298d831cbe6 tempest-VolumesExtendTest-595654496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 2.287s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:10:00 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-b19be0ee-0a54-45d2-b763-0b0d5c700d57 tempest-VolumesCloneTest-887639088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 1.396s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:10:00 devstack cinder-volume[82756]: INFO cinder.volume.drivers.remotefs [None req-b19be0ee-0a54-45d2-b763-0b0d5c700d57 tempest-VolumesCloneTest-887639088 None] Cloning volume b51850cd-06d0-4227-b958-3335cb6be717 to volume 2fa599a3-c7a7-4c24-a671-c856bd87dcd2 Apr 16 15:10:00 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-b19be0ee-0a54-45d2-b763-0b0d5c700d57 tempest-VolumesCloneTest-887639088 None] Creating offline snapshot b8d65b28-de62-4c17-aae8-74a7afab2816 of volume b51850cd-06d0-4227-b958-3335cb6be717 {{(pid=82756) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 16 15:10:00 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-d6174946-e7d7-45fd-a86f-a298d831cbe6 tempest-VolumesExtendTest-595654496 None] Extend volume completed successfully. Apr 16 15:10:00 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[87c9a435-3843-48fa-ac23-31df5ff71752]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:10:00 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-b19be0ee-0a54-45d2-b763-0b0d5c700d57 tempest-VolumesCloneTest-887639088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b51850cd-06d0-4227-b958-3335cb6be717 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:00 devstack sudo[87969]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:00 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-a943322b-ef77-4163-9345-31823cb41514 tempest-VolumesSnapshotTestJSON-1827115803 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-3525e5e2-ed94-4593-9b35-a690401c704f.7cfd194d-12f0-4cb1-899c-76f9c9d8f457" returned: 0 in 0.692s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:00 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-a943322b-ef77-4163-9345-31823cb41514 tempest-VolumesSnapshotTestJSON-1827115803 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3525e5e2-ed94-4593-9b35-a690401c704f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82756) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 15:10:00 devstack sudo[87980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b51850cd-06d0-4227-b958-3335cb6be717 Apr 16 15:10:00 devstack sudo[87980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:00 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d836f49-f1b8-48d8-a5e9-b0bae1d256c1]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:10:00 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-a943322b-ef77-4163-9345-31823cb41514 tempest-VolumesSnapshotTestJSON-1827115803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-3525e5e2-ed94-4593-9b35-a690401c704f {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:00 devstack sudo[87982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-3525e5e2-ed94-4593-9b35-a690401c704f Apr 16 15:10:00 devstack sudo[87982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:01 devstack sudo[87982]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:01 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-a943322b-ef77-4163-9345-31823cb41514 tempest-VolumesSnapshotTestJSON-1827115803 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-3525e5e2-ed94-4593-9b35-a690401c704f" returned: 0 in 0.650s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:01 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-a943322b-ef77-4163-9345-31823cb41514 tempest-VolumesSnapshotTestJSON-1827115803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-3525e5e2-ed94-4593-9b35-a690401c704f.7cfd194d-12f0-4cb1-899c-76f9c9d8f457 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:01 devstack sudo[88024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-3525e5e2-ed94-4593-9b35-a690401c704f.7cfd194d-12f0-4cb1-899c-76f9c9d8f457 Apr 16 15:10:01 devstack sudo[87980]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:01 devstack sudo[88024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:01 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-b19be0ee-0a54-45d2-b763-0b0d5c700d57 tempest-VolumesCloneTest-887639088 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b51850cd-06d0-4227-b958-3335cb6be717" returned: 0 in 0.814s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:01 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-b19be0ee-0a54-45d2-b763-0b0d5c700d57 tempest-VolumesCloneTest-887639088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b51850cd-06d0-4227-b958-3335cb6be717,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b51850cd-06d0-4227-b958-3335cb6be717.b8d65b28-de62-4c17-aae8-74a7afab2816 1G {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:01 devstack sudo[88026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b51850cd-06d0-4227-b958-3335cb6be717,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b51850cd-06d0-4227-b958-3335cb6be717.b8d65b28-de62-4c17-aae8-74a7afab2816 1G Apr 16 15:10:01 devstack sudo[88026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:01 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-b452f5bc-d013-4af7-8e62-65eff42deacc tempest-VolumesExtendTest-595654496 None] Acquiring lock "cinder-fcb0f077-b300-43e4-bb78-2c889d3ac83c-delete_volume" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:10:01 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-b452f5bc-d013-4af7-8e62-65eff42deacc tempest-VolumesExtendTest-595654496 None] Lock "cinder-fcb0f077-b300-43e4-bb78-2c889d3ac83c-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:10:01 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-b452f5bc-d013-4af7-8e62-65eff42deacc tempest-VolumesExtendTest-595654496 None] Acquiring lock "cinder-quobyte-fcb0f077-b300-43e4-bb78-2c889d3ac83c" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:10:01 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-b452f5bc-d013-4af7-8e62-65eff42deacc tempest-VolumesExtendTest-595654496 None] Lock "cinder-quobyte-fcb0f077-b300-43e4-bb78-2c889d3ac83c" acquired by "delete_volume" :: waited 0.014s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:10:01 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a2ef481-f3cc-45ac-ba95-9d851f71a461]: (4, 'raw') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:10:01 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-b452f5bc-d013-4af7-8e62-65eff42deacc tempest-VolumesExtendTest-595654496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-fcb0f077-b300-43e4-bb78-2c889d3ac83c {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:02 devstack sudo[88037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-fcb0f077-b300-43e4-bb78-2c889d3ac83c Apr 16 15:10:02 devstack sudo[88037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:02 devstack sudo[88024]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:02 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-a943322b-ef77-4163-9345-31823cb41514 tempest-VolumesSnapshotTestJSON-1827115803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-3525e5e2-ed94-4593-9b35-a690401c704f.7cfd194d-12f0-4cb1-899c-76f9c9d8f457" returned: 0 in 0.852s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:02 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-a943322b-ef77-4163-9345-31823cb41514 tempest-VolumesSnapshotTestJSON-1827115803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-3525e5e2-ed94-4593-9b35-a690401c704f.7cfd194d-12f0-4cb1-899c-76f9c9d8f457 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:02 devstack sudo[88042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-3525e5e2-ed94-4593-9b35-a690401c704f.7cfd194d-12f0-4cb1-899c-76f9c9d8f457 Apr 16 15:10:02 devstack sudo[88042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:02 devstack sudo[88026]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:02 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-b19be0ee-0a54-45d2-b763-0b0d5c700d57 tempest-VolumesCloneTest-887639088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b51850cd-06d0-4227-b958-3335cb6be717,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b51850cd-06d0-4227-b958-3335cb6be717.b8d65b28-de62-4c17-aae8-74a7afab2816 1G" returned: 0 in 1.190s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:02 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-b19be0ee-0a54-45d2-b763-0b0d5c700d57 tempest-VolumesCloneTest-887639088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b51850cd-06d0-4227-b958-3335cb6be717 -F qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b51850cd-06d0-4227-b958-3335cb6be717.b8d65b28-de62-4c17-aae8-74a7afab2816 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:02 devstack sudo[88046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b51850cd-06d0-4227-b958-3335cb6be717 -F qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b51850cd-06d0-4227-b958-3335cb6be717.b8d65b28-de62-4c17-aae8-74a7afab2816 Apr 16 15:10:02 devstack sudo[88046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:02 devstack sudo[88037]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:02 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-b452f5bc-d013-4af7-8e62-65eff42deacc tempest-VolumesExtendTest-595654496 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-fcb0f077-b300-43e4-bb78-2c889d3ac83c" returned: 0 in 0.788s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:02 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-b452f5bc-d013-4af7-8e62-65eff42deacc tempest-VolumesExtendTest-595654496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-fcb0f077-b300-43e4-bb78-2c889d3ac83c {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:02 devstack sudo[88042]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:02 devstack sudo[88051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-fcb0f077-b300-43e4-bb78-2c889d3ac83c Apr 16 15:10:02 devstack sudo[88051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:02 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-a943322b-ef77-4163-9345-31823cb41514 tempest-VolumesSnapshotTestJSON-1827115803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-3525e5e2-ed94-4593-9b35-a690401c704f.7cfd194d-12f0-4cb1-899c-76f9c9d8f457" returned: 0 in 0.702s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:02 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-a943322b-ef77-4163-9345-31823cb41514 tempest-VolumesSnapshotTestJSON-1827115803 None] Lock "cinder-quobyte-7cfd194d-12f0-4cb1-899c-76f9c9d8f457" released by "_delete_snapshot" :: held 3.073s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:10:02 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-a943322b-ef77-4163-9345-31823cb41514 tempest-VolumesSnapshotTestJSON-1827115803 None] Lock "cinder-quobyte-3525e5e2-ed94-4593-9b35-a690401c704f" released by "delete_snapshot" :: held 3.104s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:10:02 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-a943322b-ef77-4163-9345-31823cb41514 tempest-VolumesSnapshotTestJSON-1827115803 None] Created reservations ['756bca00-72f2-4695-9d9a-151ec15cfdda', '4026ae70-e101-471e-bd46-d3925377f59b', '2c989d38-7ad0-42b3-b485-658dc37cf06f', '3700ccb6-0f12-4e24-ae74-7d646819e506'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:10:03 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-a943322b-ef77-4163-9345-31823cb41514 tempest-VolumesSnapshotTestJSON-1827115803 None] Delete snapshot completed successfully. Apr 16 15:10:03 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-a943322b-ef77-4163-9345-31823cb41514 tempest-VolumesSnapshotTestJSON-1827115803 None] Lock "cinder-7cfd194d-12f0-4cb1-899c-76f9c9d8f457-delete_snapshot" released by "delete_snapshot" :: held 3.323s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:10:03 devstack sudo[88046]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:03 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-b19be0ee-0a54-45d2-b763-0b0d5c700d57 tempest-VolumesCloneTest-887639088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b51850cd-06d0-4227-b958-3335cb6be717 -F qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b51850cd-06d0-4227-b958-3335cb6be717.b8d65b28-de62-4c17-aae8-74a7afab2816" returned: 0 in 0.776s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:03 devstack cinder-volume[82756]: WARNING cinder.volume.drivers.remotefs [None req-b19be0ee-0a54-45d2-b763-0b0d5c700d57 tempest-VolumesCloneTest-887639088 None] /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b51850cd-06d0-4227-b958-3335cb6be717.b8d65b28-de62-4c17-aae8-74a7afab2816 is being set with open permissions: ugo+rw Apr 16 15:10:03 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-b19be0ee-0a54-45d2-b763-0b0d5c700d57 tempest-VolumesCloneTest-887639088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b51850cd-06d0-4227-b958-3335cb6be717.b8d65b28-de62-4c17-aae8-74a7afab2816 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:03 devstack sudo[88063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b51850cd-06d0-4227-b958-3335cb6be717.b8d65b28-de62-4c17-aae8-74a7afab2816 Apr 16 15:10:03 devstack sudo[88063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:03 devstack sudo[88051]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:03 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-b452f5bc-d013-4af7-8e62-65eff42deacc tempest-VolumesExtendTest-595654496 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-fcb0f077-b300-43e4-bb78-2c889d3ac83c" returned: 1 in 0.779s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:03 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-b452f5bc-d013-4af7-8e62-65eff42deacc tempest-VolumesExtendTest-595654496 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-fcb0f077-b300-43e4-bb78-2c889d3ac83c' failed. Not Retrying. {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 16 15:10:03 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-b452f5bc-d013-4af7-8e62-65eff42deacc tempest-VolumesExtendTest-595654496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-fcb0f077-b300-43e4-bb78-2c889d3ac83c {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:03 devstack sudo[88089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-fcb0f077-b300-43e4-bb78-2c889d3ac83c Apr 16 15:10:03 devstack sudo[88089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:03 devstack sudo[88063]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:03 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-b19be0ee-0a54-45d2-b763-0b0d5c700d57 tempest-VolumesCloneTest-887639088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b51850cd-06d0-4227-b958-3335cb6be717.b8d65b28-de62-4c17-aae8-74a7afab2816" returned: 0 in 0.686s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:03 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-b19be0ee-0a54-45d2-b763-0b0d5c700d57 tempest-VolumesCloneTest-887639088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b51850cd-06d0-4227-b958-3335cb6be717.info {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:03 devstack sudo[88097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b51850cd-06d0-4227-b958-3335cb6be717.info Apr 16 15:10:03 devstack sudo[88097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:04 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-d4c4e7f0-a210-4a87-a5c3-826500cc2ea2 tempest-VolumesSnapshotTestJSON-1827115803 None] Acquiring lock "cinder-3525e5e2-ed94-4593-9b35-a690401c704f-delete_volume" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:10:04 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-d4c4e7f0-a210-4a87-a5c3-826500cc2ea2 tempest-VolumesSnapshotTestJSON-1827115803 None] Lock "cinder-3525e5e2-ed94-4593-9b35-a690401c704f-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:10:04 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-d4c4e7f0-a210-4a87-a5c3-826500cc2ea2 tempest-VolumesSnapshotTestJSON-1827115803 None] Acquiring lock "cinder-quobyte-3525e5e2-ed94-4593-9b35-a690401c704f" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:10:04 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-d4c4e7f0-a210-4a87-a5c3-826500cc2ea2 tempest-VolumesSnapshotTestJSON-1827115803 None] Lock "cinder-quobyte-3525e5e2-ed94-4593-9b35-a690401c704f" acquired by "delete_volume" :: waited 0.012s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:10:04 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1c178fa-b0c6-4307-8cef-4498b0175f85]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:10:04 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-d4c4e7f0-a210-4a87-a5c3-826500cc2ea2 tempest-VolumesSnapshotTestJSON-1827115803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-3525e5e2-ed94-4593-9b35-a690401c704f {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:04 devstack sudo[88089]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:04 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-b452f5bc-d013-4af7-8e62-65eff42deacc tempest-VolumesExtendTest-595654496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-fcb0f077-b300-43e4-bb78-2c889d3ac83c" returned: 0 in 0.733s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:04 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-b452f5bc-d013-4af7-8e62-65eff42deacc tempest-VolumesExtendTest-595654496 None] Lock "cinder-quobyte-fcb0f077-b300-43e4-bb78-2c889d3ac83c" released by "delete_volume" :: held 2.386s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:10:04 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-b452f5bc-d013-4af7-8e62-65eff42deacc tempest-VolumesExtendTest-595654496 None] Created reservations ['af1d4802-d26b-4ea9-9045-ed274810c00f', 'd8230736-5920-42c3-a32d-847121d3c85a', '6157d6aa-fd35-4374-a1a1-5f5cf43af668', '22555923-6f4f-459a-b048-739871034d2c'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:10:04 devstack sudo[88100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-3525e5e2-ed94-4593-9b35-a690401c704f Apr 16 15:10:04 devstack sudo[88100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:04 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-b452f5bc-d013-4af7-8e62-65eff42deacc tempest-VolumesExtendTest-595654496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:10:04 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-b452f5bc-d013-4af7-8e62-65eff42deacc tempest-VolumesExtendTest-595654496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:10:04 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-b452f5bc-d013-4af7-8e62-65eff42deacc tempest-VolumesExtendTest-595654496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:10:04 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-b452f5bc-d013-4af7-8e62-65eff42deacc tempest-VolumesExtendTest-595654496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:10:04 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-b452f5bc-d013-4af7-8e62-65eff42deacc tempest-VolumesExtendTest-595654496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:10:04 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-b452f5bc-d013-4af7-8e62-65eff42deacc tempest-VolumesExtendTest-595654496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:04 devstack sudo[88130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:10:04 devstack sudo[88130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:04 devstack sudo[88097]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:04 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-b19be0ee-0a54-45d2-b763-0b0d5c700d57 tempest-VolumesCloneTest-887639088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b51850cd-06d0-4227-b958-3335cb6be717.info" returned: 0 in 0.616s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:04 devstack cinder-volume[82756]: WARNING cinder.volume.drivers.remotefs [None req-b19be0ee-0a54-45d2-b763-0b0d5c700d57 tempest-VolumesCloneTest-887639088 None] /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b51850cd-06d0-4227-b958-3335cb6be717.info is being set with open permissions: ugo+rw Apr 16 15:10:04 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-b19be0ee-0a54-45d2-b763-0b0d5c700d57 tempest-VolumesCloneTest-887639088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b51850cd-06d0-4227-b958-3335cb6be717.info {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:04 devstack sudo[88134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b51850cd-06d0-4227-b958-3335cb6be717.info Apr 16 15:10:04 devstack sudo[88134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:04 devstack sudo[88130]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:04 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-b452f5bc-d013-4af7-8e62-65eff42deacc tempest-VolumesExtendTest-595654496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.557s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:04 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-b452f5bc-d013-4af7-8e62-65eff42deacc tempest-VolumesExtendTest-595654496 None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:10:04 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-b452f5bc-d013-4af7-8e62-65eff42deacc tempest-VolumesExtendTest-595654496 None] Deleted volume successfully. Apr 16 15:10:04 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-b452f5bc-d013-4af7-8e62-65eff42deacc tempest-VolumesExtendTest-595654496 None] Lock "cinder-fcb0f077-b300-43e4-bb78-2c889d3ac83c-delete_volume" released by "delete_volume" :: held 3.125s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:10:05 devstack sudo[88100]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:05 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-d4c4e7f0-a210-4a87-a5c3-826500cc2ea2 tempest-VolumesSnapshotTestJSON-1827115803 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-3525e5e2-ed94-4593-9b35-a690401c704f" returned: 0 in 0.902s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:05 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-d4c4e7f0-a210-4a87-a5c3-826500cc2ea2 tempest-VolumesSnapshotTestJSON-1827115803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-3525e5e2-ed94-4593-9b35-a690401c704f {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:05 devstack sudo[88140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-3525e5e2-ed94-4593-9b35-a690401c704f Apr 16 15:10:05 devstack sudo[88140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:05 devstack sudo[88134]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:05 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-b19be0ee-0a54-45d2-b763-0b0d5c700d57 tempest-VolumesCloneTest-887639088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b51850cd-06d0-4227-b958-3335cb6be717.info" returned: 0 in 0.848s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:05 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-b19be0ee-0a54-45d2-b763-0b0d5c700d57 tempest-VolumesCloneTest-887639088 None] Acquiring lock "cinder-quobyte-2fa599a3-c7a7-4c24-a671-c856bd87dcd2" by "_copy_volume_from_snapshot" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:10:05 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-b19be0ee-0a54-45d2-b763-0b0d5c700d57 tempest-VolumesCloneTest-887639088 None] Lock "cinder-quobyte-2fa599a3-c7a7-4c24-a671-c856bd87dcd2" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:10:05 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-b19be0ee-0a54-45d2-b763-0b0d5c700d57 tempest-VolumesCloneTest-887639088 None] snapshot: b8d65b28-de62-4c17-aae8-74a7afab2816, volume: 2fa599a3-c7a7-4c24-a671-c856bd87dcd2, {{(pid=82756) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 16 15:10:05 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-b19be0ee-0a54-45d2-b763-0b0d5c700d57 tempest-VolumesCloneTest-887639088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:10:05 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-b19be0ee-0a54-45d2-b763-0b0d5c700d57 tempest-VolumesCloneTest-887639088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:10:05 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-b19be0ee-0a54-45d2-b763-0b0d5c700d57 tempest-VolumesCloneTest-887639088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:10:05 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-b19be0ee-0a54-45d2-b763-0b0d5c700d57 tempest-VolumesCloneTest-887639088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:10:05 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-b19be0ee-0a54-45d2-b763-0b0d5c700d57 tempest-VolumesCloneTest-887639088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:10:05 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[95df584e-1f97-4838-bdbb-540a8ccc398c]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:10:05 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-b19be0ee-0a54-45d2-b763-0b0d5c700d57 tempest-VolumesCloneTest-887639088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b51850cd-06d0-4227-b958-3335cb6be717.b8d65b28-de62-4c17-aae8-74a7afab2816 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:05 devstack sudo[88144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b51850cd-06d0-4227-b958-3335cb6be717.b8d65b28-de62-4c17-aae8-74a7afab2816 Apr 16 15:10:05 devstack sudo[88144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:05 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [None req-12e77cb7-496b-4372-8693-44e43d6a45a2 tempest-VolumesExtendTest-595654496 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82756) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 15:10:05 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-12e77cb7-496b-4372-8693-44e43d6a45a2 tempest-VolumesExtendTest-595654496 None] Flow 'volume_create_manager' (212697be-f0b1-44e0-99ee-29e2bc8c6be8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:10:05 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-12e77cb7-496b-4372-8693-44e43d6a45a2 tempest-VolumesExtendTest-595654496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ab8e479-276c-43ae-bfb4-010c5fbbc60f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:10:05 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-12e77cb7-496b-4372-8693-44e43d6a45a2 tempest-VolumesExtendTest-595654496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ab8e479-276c-43ae-bfb4-010c5fbbc60f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:10:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-262351101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ae365ca-89f7-41d1-8332-85e232f2b22e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='079e7c0fd5814d439f65c42ce9367359',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:10:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:10:06Z,use_quota=True,user_id='f438223713b1407e98774448ae7410f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:10:05 devstack sudo[88140]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:05 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-12e77cb7-496b-4372-8693-44e43d6a45a2 tempest-VolumesExtendTest-595654496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf3a6043-de75-4549-8d58-81da0a55f684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:10:05 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-12e77cb7-496b-4372-8693-44e43d6a45a2 tempest-VolumesExtendTest-595654496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf3a6043-de75-4549-8d58-81da0a55f684) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:10:05 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-12e77cb7-496b-4372-8693-44e43d6a45a2 tempest-VolumesExtendTest-595654496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03db65b2-4853-4a7c-ad4b-71bea9c653d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:10:05 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-12e77cb7-496b-4372-8693-44e43d6a45a2 tempest-VolumesExtendTest-595654496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03db65b2-4853-4a7c-ad4b-71bea9c653d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ae365ca-89f7-41d1-8332-85e232f2b22e', 'volume_name': 'volume-2ae365ca-89f7-41d1-8332-85e232f2b22e', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:10:05 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-12e77cb7-496b-4372-8693-44e43d6a45a2 tempest-VolumesExtendTest-595654496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c82dbbe-ce68-4696-aebd-3935a2ed3d21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:10:05 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-12e77cb7-496b-4372-8693-44e43d6a45a2 tempest-VolumesExtendTest-595654496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c82dbbe-ce68-4696-aebd-3935a2ed3d21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:10:05 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-12e77cb7-496b-4372-8693-44e43d6a45a2 tempest-VolumesExtendTest-595654496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49831382-99c5-4bf2-8b3b-7749ec9c5e7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:10:05 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-12e77cb7-496b-4372-8693-44e43d6a45a2 tempest-VolumesExtendTest-595654496 None] Volume 2ae365ca-89f7-41d1-8332-85e232f2b22e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ae365ca-89f7-41d1-8332-85e232f2b22e', 'volume_size': 1} Apr 16 15:10:05 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-12e77cb7-496b-4372-8693-44e43d6a45a2 tempest-VolumesExtendTest-595654496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:10:05 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-d4c4e7f0-a210-4a87-a5c3-826500cc2ea2 tempest-VolumesSnapshotTestJSON-1827115803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-3525e5e2-ed94-4593-9b35-a690401c704f" returned: 0 in 0.631s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:05 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-d4c4e7f0-a210-4a87-a5c3-826500cc2ea2 tempest-VolumesSnapshotTestJSON-1827115803 None] Lock "cinder-quobyte-3525e5e2-ed94-4593-9b35-a690401c704f" released by "delete_volume" :: held 1.576s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:10:05 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-d4c4e7f0-a210-4a87-a5c3-826500cc2ea2 tempest-VolumesSnapshotTestJSON-1827115803 None] Created reservations ['2b7911c1-43b3-4a0c-b0a9-c00818cbe500', '5b3f6dcb-411f-4e40-b49b-54de2f2c53b1', '01a4a7fe-9e0b-406c-b470-1c6c27b22d44', 'f8e17e5d-d8c5-46bc-9f0a-a54842085613'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:10:05 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-d4c4e7f0-a210-4a87-a5c3-826500cc2ea2 tempest-VolumesSnapshotTestJSON-1827115803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:10:05 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-d4c4e7f0-a210-4a87-a5c3-826500cc2ea2 tempest-VolumesSnapshotTestJSON-1827115803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:10:05 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-d4c4e7f0-a210-4a87-a5c3-826500cc2ea2 tempest-VolumesSnapshotTestJSON-1827115803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:10:05 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-d4c4e7f0-a210-4a87-a5c3-826500cc2ea2 tempest-VolumesSnapshotTestJSON-1827115803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:10:05 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-d4c4e7f0-a210-4a87-a5c3-826500cc2ea2 tempest-VolumesSnapshotTestJSON-1827115803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:10:05 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-d4c4e7f0-a210-4a87-a5c3-826500cc2ea2 tempest-VolumesSnapshotTestJSON-1827115803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:05 devstack sudo[88147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:10:05 devstack sudo[88147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:06 devstack sudo[88144]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:06 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-b19be0ee-0a54-45d2-b763-0b0d5c700d57 tempest-VolumesCloneTest-887639088 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b51850cd-06d0-4227-b958-3335cb6be717.b8d65b28-de62-4c17-aae8-74a7afab2816" returned: 0 in 0.636s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:06 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-b19be0ee-0a54-45d2-b763-0b0d5c700d57 tempest-VolumesCloneTest-887639088 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b51850cd-06d0-4227-b958-3335cb6be717(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82756) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 15:10:06 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-b19be0ee-0a54-45d2-b763-0b0d5c700d57 tempest-VolumesCloneTest-887639088 None] will copy from snapshot at /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b51850cd-06d0-4227-b958-3335cb6be717 {{(pid=82756) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 16 15:10:06 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-b19be0ee-0a54-45d2-b763-0b0d5c700d57 tempest-VolumesCloneTest-887639088 None] Creating direct copy from snapshot {{(pid=82756) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 16 15:10:06 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[28e2b72b-1326-4415-b239-6e2cdf158de6]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:10:06 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-b19be0ee-0a54-45d2-b763-0b0d5c700d57 tempest-VolumesCloneTest-887639088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b51850cd-06d0-4227-b958-3335cb6be717 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:06 devstack sudo[88152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b51850cd-06d0-4227-b958-3335cb6be717 Apr 16 15:10:06 devstack sudo[88152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:06 devstack sudo[88147]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:06 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-d4c4e7f0-a210-4a87-a5c3-826500cc2ea2 tempest-VolumesSnapshotTestJSON-1827115803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.491s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:06 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-d4c4e7f0-a210-4a87-a5c3-826500cc2ea2 tempest-VolumesSnapshotTestJSON-1827115803 None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:10:06 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-d4c4e7f0-a210-4a87-a5c3-826500cc2ea2 tempest-VolumesSnapshotTestJSON-1827115803 None] Deleted volume successfully. Apr 16 15:10:06 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-d4c4e7f0-a210-4a87-a5c3-826500cc2ea2 tempest-VolumesSnapshotTestJSON-1827115803 None] Lock "cinder-3525e5e2-ed94-4593-9b35-a690401c704f-delete_volume" released by "delete_volume" :: held 2.319s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:10:06 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-5f38961b-620d-4f03-a68f-4a28fbda4475 tempest-VolumesSnapshotTestJSON-1827115803 None] Acquiring lock "cinder-70b5beb8-b235-468e-a328-da05baf30faf-delete_volume" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:10:06 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-5f38961b-620d-4f03-a68f-4a28fbda4475 tempest-VolumesSnapshotTestJSON-1827115803 None] Lock "cinder-70b5beb8-b235-468e-a328-da05baf30faf-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:10:06 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-5f38961b-620d-4f03-a68f-4a28fbda4475 tempest-VolumesSnapshotTestJSON-1827115803 None] Acquiring lock "cinder-quobyte-70b5beb8-b235-468e-a328-da05baf30faf" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:10:06 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-5f38961b-620d-4f03-a68f-4a28fbda4475 tempest-VolumesSnapshotTestJSON-1827115803 None] Lock "cinder-quobyte-70b5beb8-b235-468e-a328-da05baf30faf" acquired by "delete_volume" :: waited 0.008s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:10:06 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[e04d8600-b23d-4dc8-af6f-f81a92b9a19d]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:10:06 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-5f38961b-620d-4f03-a68f-4a28fbda4475 tempest-VolumesSnapshotTestJSON-1827115803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-70b5beb8-b235-468e-a328-da05baf30faf {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:06 devstack sudo[88155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-70b5beb8-b235-468e-a328-da05baf30faf Apr 16 15:10:06 devstack sudo[88155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:06 devstack sudo[88152]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:06 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-b19be0ee-0a54-45d2-b763-0b0d5c700d57 tempest-VolumesCloneTest-887639088 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b51850cd-06d0-4227-b958-3335cb6be717" returned: 0 in 0.700s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:06 devstack cinder-volume[82756]: DEBUG cinder.utils [None req-b19be0ee-0a54-45d2-b763-0b0d5c700d57 tempest-VolumesCloneTest-887639088 None] Path /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2fa599a3-c7a7-4c24-a671-c856bd87dcd2 not found in is_blk_device check {{(pid=82756) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 16 15:10:06 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-b19be0ee-0a54-45d2-b763-0b0d5c700d57 tempest-VolumesCloneTest-887639088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b51850cd-06d0-4227-b958-3335cb6be717 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2fa599a3-c7a7-4c24-a671-c856bd87dcd2 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:06 devstack sudo[88160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b51850cd-06d0-4227-b958-3335cb6be717 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2fa599a3-c7a7-4c24-a671-c856bd87dcd2 Apr 16 15:10:06 devstack sudo[88160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:07 devstack sudo[88155]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:07 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-5f38961b-620d-4f03-a68f-4a28fbda4475 tempest-VolumesSnapshotTestJSON-1827115803 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-70b5beb8-b235-468e-a328-da05baf30faf" returned: 0 in 0.562s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:07 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-5f38961b-620d-4f03-a68f-4a28fbda4475 tempest-VolumesSnapshotTestJSON-1827115803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-70b5beb8-b235-468e-a328-da05baf30faf {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:07 devstack sudo[88165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-70b5beb8-b235-468e-a328-da05baf30faf Apr 16 15:10:07 devstack sudo[88165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:07 devstack sudo[88165]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:07 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-5f38961b-620d-4f03-a68f-4a28fbda4475 tempest-VolumesSnapshotTestJSON-1827115803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-70b5beb8-b235-468e-a328-da05baf30faf" returned: 0 in 0.779s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:07 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-5f38961b-620d-4f03-a68f-4a28fbda4475 tempest-VolumesSnapshotTestJSON-1827115803 None] Lock "cinder-quobyte-70b5beb8-b235-468e-a328-da05baf30faf" released by "delete_volume" :: held 1.399s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:10:08 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-5f38961b-620d-4f03-a68f-4a28fbda4475 tempest-VolumesSnapshotTestJSON-1827115803 None] Created reservations ['f3177c72-c7a9-430b-b125-91172fff9ebc', '17c07129-ebc0-4317-abdf-6cda0e86d7a1', '129d8f51-d81c-4183-8e19-c91febe15449', '004cf395-4b54-429a-8cad-b63c4ebdf83e'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:10:08 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-5f38961b-620d-4f03-a68f-4a28fbda4475 tempest-VolumesSnapshotTestJSON-1827115803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:10:08 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-5f38961b-620d-4f03-a68f-4a28fbda4475 tempest-VolumesSnapshotTestJSON-1827115803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:10:08 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-5f38961b-620d-4f03-a68f-4a28fbda4475 tempest-VolumesSnapshotTestJSON-1827115803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:10:08 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-5f38961b-620d-4f03-a68f-4a28fbda4475 tempest-VolumesSnapshotTestJSON-1827115803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:10:08 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-5f38961b-620d-4f03-a68f-4a28fbda4475 tempest-VolumesSnapshotTestJSON-1827115803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:10:08 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-5f38961b-620d-4f03-a68f-4a28fbda4475 tempest-VolumesSnapshotTestJSON-1827115803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:08 devstack sudo[88179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:10:08 devstack sudo[88179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:09 devstack sudo[88179]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:09 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-5f38961b-620d-4f03-a68f-4a28fbda4475 tempest-VolumesSnapshotTestJSON-1827115803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 1.413s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:09 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-5f38961b-620d-4f03-a68f-4a28fbda4475 tempest-VolumesSnapshotTestJSON-1827115803 None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:10:09 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-5f38961b-620d-4f03-a68f-4a28fbda4475 tempest-VolumesSnapshotTestJSON-1827115803 None] Deleted volume successfully. Apr 16 15:10:09 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-5f38961b-620d-4f03-a68f-4a28fbda4475 tempest-VolumesSnapshotTestJSON-1827115803 None] Lock "cinder-70b5beb8-b235-468e-a328-da05baf30faf-delete_volume" released by "delete_volume" :: held 3.129s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:10:09 devstack sudo[88160]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:09 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-b19be0ee-0a54-45d2-b763-0b0d5c700d57 tempest-VolumesCloneTest-887639088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b51850cd-06d0-4227-b958-3335cb6be717 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2fa599a3-c7a7-4c24-a671-c856bd87dcd2" returned: 0 in 3.053s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:09 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[551c725f-3685-4915-9292-1f8c4332473b]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:10:09 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-b19be0ee-0a54-45d2-b763-0b0d5c700d57 tempest-VolumesCloneTest-887639088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b51850cd-06d0-4227-b958-3335cb6be717 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:10 devstack sudo[88182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b51850cd-06d0-4227-b958-3335cb6be717 Apr 16 15:10:10 devstack sudo[88182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:10 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [None req-90f47981-b434-404a-8c13-bd95510554bf tempest-ServersNegativeTestJSON-1502184342 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82756) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 15:10:10 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-90f47981-b434-404a-8c13-bd95510554bf tempest-ServersNegativeTestJSON-1502184342 None] Flow 'volume_create_manager' (e53dea03-256a-40fe-87c5-435832d06456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:10:10 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-90f47981-b434-404a-8c13-bd95510554bf tempest-ServersNegativeTestJSON-1502184342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fdf8e71-8afc-49d9-9da9-a9056488fa03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:10:10 devstack cinder-volume[82756]: DEBUG dbcounter [-] [82756] Writing DB stats cinder:SELECT=91,cinder:DELETE=8,cinder:UPDATE=126,cinder:INSERT=30 {{(pid=82756) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 15:10:10 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-90f47981-b434-404a-8c13-bd95510554bf tempest-ServersNegativeTestJSON-1502184342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fdf8e71-8afc-49d9-9da9-a9056488fa03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:10:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-403935558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77f03b1a-7ebf-4c10-a4c5-4729123e5620,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13eb5e84ce0a4c759c021aeb630f108a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:10:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:10:11Z,use_quota=True,user_id='46a56cc8b141418a9c7fed6285eccc90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:10:10 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-90f47981-b434-404a-8c13-bd95510554bf tempest-ServersNegativeTestJSON-1502184342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d93345de-3216-4b1e-a9c8-138fab43ec9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:10:10 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-90f47981-b434-404a-8c13-bd95510554bf tempest-ServersNegativeTestJSON-1502184342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d93345de-3216-4b1e-a9c8-138fab43ec9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:10:10 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-90f47981-b434-404a-8c13-bd95510554bf tempest-ServersNegativeTestJSON-1502184342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23ea8903-583d-4914-b3fd-e24720cc8a08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:10:10 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-90f47981-b434-404a-8c13-bd95510554bf tempest-ServersNegativeTestJSON-1502184342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23ea8903-583d-4914-b3fd-e24720cc8a08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77f03b1a-7ebf-4c10-a4c5-4729123e5620', 'volume_name': 'volume-77f03b1a-7ebf-4c10-a4c5-4729123e5620', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:10:10 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-90f47981-b434-404a-8c13-bd95510554bf tempest-ServersNegativeTestJSON-1502184342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (699ca88c-d8da-427b-ae0a-5dff4029c3d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:10:10 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-90f47981-b434-404a-8c13-bd95510554bf tempest-ServersNegativeTestJSON-1502184342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (699ca88c-d8da-427b-ae0a-5dff4029c3d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:10:10 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-90f47981-b434-404a-8c13-bd95510554bf tempest-ServersNegativeTestJSON-1502184342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4881d9be-9117-4526-b1e6-2f2b1553392f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:10:10 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-90f47981-b434-404a-8c13-bd95510554bf tempest-ServersNegativeTestJSON-1502184342 None] Volume 77f03b1a-7ebf-4c10-a4c5-4729123e5620: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77f03b1a-7ebf-4c10-a4c5-4729123e5620', 'volume_size': 1} Apr 16 15:10:10 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-90f47981-b434-404a-8c13-bd95510554bf tempest-ServersNegativeTestJSON-1502184342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:10:10 devstack sudo[88182]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:10 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-b19be0ee-0a54-45d2-b763-0b0d5c700d57 tempest-VolumesCloneTest-887639088 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b51850cd-06d0-4227-b958-3335cb6be717" returned: 0 in 0.768s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:10 devstack cinder-volume[82756]: DEBUG cinder.image.image_utils [None req-b19be0ee-0a54-45d2-b763-0b0d5c700d57 tempest-VolumesCloneTest-887639088 None] Image conversion details: src /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b51850cd-06d0-4227-b958-3335cb6be717, size 1024.00 MB, duration 3.05 sec, destination /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2fa599a3-c7a7-4c24-a671-c856bd87dcd2 {{(pid=82756) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 15:10:10 devstack cinder-volume[82756]: INFO cinder.image.image_utils [None req-b19be0ee-0a54-45d2-b763-0b0d5c700d57 tempest-VolumesCloneTest-887639088 None] Converted 1024.00 MB image at 335.35 MB/s Apr 16 15:10:10 devstack cinder-volume[82756]: WARNING cinder.volume.drivers.remotefs [None req-b19be0ee-0a54-45d2-b763-0b0d5c700d57 tempest-VolumesCloneTest-887639088 None] /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2fa599a3-c7a7-4c24-a671-c856bd87dcd2 is being set with open permissions: ugo+rw Apr 16 15:10:10 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-b19be0ee-0a54-45d2-b763-0b0d5c700d57 tempest-VolumesCloneTest-887639088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2fa599a3-c7a7-4c24-a671-c856bd87dcd2 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:10 devstack sudo[88187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2fa599a3-c7a7-4c24-a671-c856bd87dcd2 Apr 16 15:10:10 devstack sudo[88187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:11 devstack sudo[88187]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:11 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-b19be0ee-0a54-45d2-b763-0b0d5c700d57 tempest-VolumesCloneTest-887639088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2fa599a3-c7a7-4c24-a671-c856bd87dcd2" returned: 0 in 0.461s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:11 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-b19be0ee-0a54-45d2-b763-0b0d5c700d57 tempest-VolumesCloneTest-887639088 None] Lock "cinder-quobyte-2fa599a3-c7a7-4c24-a671-c856bd87dcd2" released by "_copy_volume_from_snapshot" :: held 5.701s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:10:11 devstack cinder-volume[82756]: DEBUG dbcounter [-] [82756] Writing DB stats cinder:SELECT=98,cinder:UPDATE=97,cinder:INSERT=36,cinder:DELETE=10 {{(pid=82756) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 15:10:11 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-b19be0ee-0a54-45d2-b763-0b0d5c700d57 tempest-VolumesCloneTest-887639088 None] Acquiring lock "cinder-quobyte-b8d65b28-de62-4c17-aae8-74a7afab2816" by "_delete_snapshot" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:10:11 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-b19be0ee-0a54-45d2-b763-0b0d5c700d57 tempest-VolumesCloneTest-887639088 None] Lock "cinder-quobyte-b8d65b28-de62-4c17-aae8-74a7afab2816" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:10:11 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-b19be0ee-0a54-45d2-b763-0b0d5c700d57 tempest-VolumesCloneTest-887639088 None] Deleting offline snapshot b8d65b28-de62-4c17-aae8-74a7afab2816 of volume b51850cd-06d0-4227-b958-3335cb6be717 {{(pid=82756) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 15:10:11 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-b19be0ee-0a54-45d2-b763-0b0d5c700d57 tempest-VolumesCloneTest-887639088 None] snapshot_file for this snap is: volume-b51850cd-06d0-4227-b958-3335cb6be717.b8d65b28-de62-4c17-aae8-74a7afab2816 {{(pid=82756) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 15:10:11 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6a51020-6f19-43ae-ab39-c0caa8dfb6d0]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:10:11 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-b19be0ee-0a54-45d2-b763-0b0d5c700d57 tempest-VolumesCloneTest-887639088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b51850cd-06d0-4227-b958-3335cb6be717.b8d65b28-de62-4c17-aae8-74a7afab2816 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:11 devstack sudo[88191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b51850cd-06d0-4227-b958-3335cb6be717.b8d65b28-de62-4c17-aae8-74a7afab2816 Apr 16 15:10:11 devstack sudo[88191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:11 devstack sudo[88191]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:11 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-b19be0ee-0a54-45d2-b763-0b0d5c700d57 tempest-VolumesCloneTest-887639088 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b51850cd-06d0-4227-b958-3335cb6be717.b8d65b28-de62-4c17-aae8-74a7afab2816" returned: 0 in 0.605s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:11 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-b19be0ee-0a54-45d2-b763-0b0d5c700d57 tempest-VolumesCloneTest-887639088 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b51850cd-06d0-4227-b958-3335cb6be717(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82756) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 15:10:11 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[32699e0e-368f-446a-9854-686311f9f2ef]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:10:11 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-b19be0ee-0a54-45d2-b763-0b0d5c700d57 tempest-VolumesCloneTest-887639088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b51850cd-06d0-4227-b958-3335cb6be717 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:11 devstack sudo[88196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b51850cd-06d0-4227-b958-3335cb6be717 Apr 16 15:10:11 devstack sudo[88196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:12 devstack sudo[88196]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:12 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-b19be0ee-0a54-45d2-b763-0b0d5c700d57 tempest-VolumesCloneTest-887639088 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b51850cd-06d0-4227-b958-3335cb6be717" returned: 0 in 0.600s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:12 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-b19be0ee-0a54-45d2-b763-0b0d5c700d57 tempest-VolumesCloneTest-887639088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b51850cd-06d0-4227-b958-3335cb6be717.b8d65b28-de62-4c17-aae8-74a7afab2816 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:12 devstack sudo[88201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b51850cd-06d0-4227-b958-3335cb6be717.b8d65b28-de62-4c17-aae8-74a7afab2816 Apr 16 15:10:12 devstack sudo[88201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:13 devstack sudo[88201]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:13 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-b19be0ee-0a54-45d2-b763-0b0d5c700d57 tempest-VolumesCloneTest-887639088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b51850cd-06d0-4227-b958-3335cb6be717.b8d65b28-de62-4c17-aae8-74a7afab2816" returned: 0 in 0.620s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:13 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-b19be0ee-0a54-45d2-b763-0b0d5c700d57 tempest-VolumesCloneTest-887639088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b51850cd-06d0-4227-b958-3335cb6be717.b8d65b28-de62-4c17-aae8-74a7afab2816 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:13 devstack sudo[88207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b51850cd-06d0-4227-b958-3335cb6be717.b8d65b28-de62-4c17-aae8-74a7afab2816 Apr 16 15:10:13 devstack sudo[88207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:13 devstack sudo[88207]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:13 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-b19be0ee-0a54-45d2-b763-0b0d5c700d57 tempest-VolumesCloneTest-887639088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b51850cd-06d0-4227-b958-3335cb6be717.b8d65b28-de62-4c17-aae8-74a7afab2816" returned: 0 in 0.595s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:13 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-b19be0ee-0a54-45d2-b763-0b0d5c700d57 tempest-VolumesCloneTest-887639088 None] Lock "cinder-quobyte-b8d65b28-de62-4c17-aae8-74a7afab2816" released by "_delete_snapshot" :: held 2.503s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:10:13 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-b19be0ee-0a54-45d2-b763-0b0d5c700d57 tempest-VolumesCloneTest-887639088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.332s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:10:13 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-12e77cb7-496b-4372-8693-44e43d6a45a2 tempest-VolumesExtendTest-595654496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.018s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:10:13 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-12e77cb7-496b-4372-8693-44e43d6a45a2 tempest-VolumesExtendTest-595654496 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:10:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-262351101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ae365ca-89f7-41d1-8332-85e232f2b22e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='079e7c0fd5814d439f65c42ce9367359',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:10:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:10:06Z,use_quota=True,user_id='f438223713b1407e98774448ae7410f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)}" {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 15:10:13 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-12e77cb7-496b-4372-8693-44e43d6a45a2 tempest-VolumesExtendTest-595654496 None] Creating volume 2ae365ca-89f7-41d1-8332-85e232f2b22e {{(pid=82756) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 15:10:13 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-12e77cb7-496b-4372-8693-44e43d6a45a2 tempest-VolumesExtendTest-595654496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:10:13 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-12e77cb7-496b-4372-8693-44e43d6a45a2 tempest-VolumesExtendTest-595654496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:10:13 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-12e77cb7-496b-4372-8693-44e43d6a45a2 tempest-VolumesExtendTest-595654496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:10:13 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-12e77cb7-496b-4372-8693-44e43d6a45a2 tempest-VolumesExtendTest-595654496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:10:13 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-12e77cb7-496b-4372-8693-44e43d6a45a2 tempest-VolumesExtendTest-595654496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:10:13 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-12e77cb7-496b-4372-8693-44e43d6a45a2 tempest-VolumesExtendTest-595654496 None] Selected osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 as target Quobyte volume. {{(pid=82756) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 15:10:13 devstack cinder-volume[82756]: INFO cinder.volume.drivers.remotefs [None req-12e77cb7-496b-4372-8693-44e43d6a45a2 tempest-VolumesExtendTest-595654496 None] casted to osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 Apr 16 15:10:13 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-12e77cb7-496b-4372-8693-44e43d6a45a2 tempest-VolumesExtendTest-595654496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2ae365ca-89f7-41d1-8332-85e232f2b22e 1073741824 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:13 devstack sudo[88211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2ae365ca-89f7-41d1-8332-85e232f2b22e 1073741824 Apr 16 15:10:13 devstack sudo[88211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:13 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-b19be0ee-0a54-45d2-b763-0b0d5c700d57 tempest-VolumesCloneTest-887639088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c210dc5e-0abd-4db4-91d3-e563483cf9f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fa599a3-c7a7-4c24-a671-c856bd87dcd2', 'volume_size': 2, 'source_volid': 'b51850cd-06d0-4227-b958-3335cb6be717', 'source_volstatus': 'available'}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:10:13 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-b19be0ee-0a54-45d2-b763-0b0d5c700d57 tempest-VolumesCloneTest-887639088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (451e24cd-d40d-474e-9d04-47a9cc517166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:10:13 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-b19be0ee-0a54-45d2-b763-0b0d5c700d57 tempest-VolumesCloneTest-887639088 None] Volume volume-2fa599a3-c7a7-4c24-a671-c856bd87dcd2 (2fa599a3-c7a7-4c24-a671-c856bd87dcd2): created successfully Apr 16 15:10:13 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-b19be0ee-0a54-45d2-b763-0b0d5c700d57 tempest-VolumesCloneTest-887639088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (451e24cd-d40d-474e-9d04-47a9cc517166) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:10:13 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-b19be0ee-0a54-45d2-b763-0b0d5c700d57 tempest-VolumesCloneTest-887639088 None] Flow 'volume_create_manager' (c4ad6d36-a159-4b92-a695-efa33d6a5694) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:10:13 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-b19be0ee-0a54-45d2-b763-0b0d5c700d57 tempest-VolumesCloneTest-887639088 None] Created volume successfully. Apr 16 15:10:14 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-42ee4b15-15ac-430e-b0d4-84d4b3c48a91 tempest-VolumesCloneTest-887639088 None] Acquiring lock "cinder-2fa599a3-c7a7-4c24-a671-c856bd87dcd2-delete_volume" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:10:14 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-42ee4b15-15ac-430e-b0d4-84d4b3c48a91 tempest-VolumesCloneTest-887639088 None] Lock "cinder-2fa599a3-c7a7-4c24-a671-c856bd87dcd2-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:10:14 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-42ee4b15-15ac-430e-b0d4-84d4b3c48a91 tempest-VolumesCloneTest-887639088 None] Acquiring lock "cinder-quobyte-2fa599a3-c7a7-4c24-a671-c856bd87dcd2" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:10:14 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-42ee4b15-15ac-430e-b0d4-84d4b3c48a91 tempest-VolumesCloneTest-887639088 None] Lock "cinder-quobyte-2fa599a3-c7a7-4c24-a671-c856bd87dcd2" acquired by "delete_volume" :: waited 0.009s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:10:14 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7b5b2b3-78b0-4a9f-9a85-1b661ade5dd5]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:10:14 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-42ee4b15-15ac-430e-b0d4-84d4b3c48a91 tempest-VolumesCloneTest-887639088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2fa599a3-c7a7-4c24-a671-c856bd87dcd2 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:14 devstack sudo[88211]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:14 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-12e77cb7-496b-4372-8693-44e43d6a45a2 tempest-VolumesExtendTest-595654496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2ae365ca-89f7-41d1-8332-85e232f2b22e 1073741824" returned: 0 in 0.601s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:14 devstack sudo[88216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2fa599a3-c7a7-4c24-a671-c856bd87dcd2 Apr 16 15:10:14 devstack sudo[88216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:14 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-12e77cb7-496b-4372-8693-44e43d6a45a2 tempest-VolumesExtendTest-595654496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2ae365ca-89f7-41d1-8332-85e232f2b22e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:14 devstack sudo[88218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2ae365ca-89f7-41d1-8332-85e232f2b22e Apr 16 15:10:14 devstack sudo[88218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:14 devstack sudo[88218]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:14 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-12e77cb7-496b-4372-8693-44e43d6a45a2 tempest-VolumesExtendTest-595654496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2ae365ca-89f7-41d1-8332-85e232f2b22e" returned: 0 in 0.438s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:14 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-12e77cb7-496b-4372-8693-44e43d6a45a2 tempest-VolumesExtendTest-595654496 None] <== create_volume: return (1084ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'} {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 15:10:14 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-12e77cb7-496b-4372-8693-44e43d6a45a2 tempest-VolumesExtendTest-595654496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.088s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:10:14 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-90f47981-b434-404a-8c13-bd95510554bf tempest-ServersNegativeTestJSON-1502184342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.145s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:10:14 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-90f47981-b434-404a-8c13-bd95510554bf tempest-ServersNegativeTestJSON-1502184342 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:10:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-403935558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77f03b1a-7ebf-4c10-a4c5-4729123e5620,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13eb5e84ce0a4c759c021aeb630f108a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:10:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:10:11Z,use_quota=True,user_id='46a56cc8b141418a9c7fed6285eccc90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)}" {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 15:10:14 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-90f47981-b434-404a-8c13-bd95510554bf tempest-ServersNegativeTestJSON-1502184342 None] Creating volume 77f03b1a-7ebf-4c10-a4c5-4729123e5620 {{(pid=82756) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 15:10:14 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-90f47981-b434-404a-8c13-bd95510554bf tempest-ServersNegativeTestJSON-1502184342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:10:14 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-90f47981-b434-404a-8c13-bd95510554bf tempest-ServersNegativeTestJSON-1502184342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:10:14 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-90f47981-b434-404a-8c13-bd95510554bf tempest-ServersNegativeTestJSON-1502184342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:10:14 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-90f47981-b434-404a-8c13-bd95510554bf tempest-ServersNegativeTestJSON-1502184342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:10:14 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-90f47981-b434-404a-8c13-bd95510554bf tempest-ServersNegativeTestJSON-1502184342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:10:14 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-90f47981-b434-404a-8c13-bd95510554bf tempest-ServersNegativeTestJSON-1502184342 None] Selected osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 as target Quobyte volume. {{(pid=82756) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 15:10:14 devstack cinder-volume[82756]: INFO cinder.volume.drivers.remotefs [None req-90f47981-b434-404a-8c13-bd95510554bf tempest-ServersNegativeTestJSON-1502184342 None] casted to osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 Apr 16 15:10:14 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-90f47981-b434-404a-8c13-bd95510554bf tempest-ServersNegativeTestJSON-1502184342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-77f03b1a-7ebf-4c10-a4c5-4729123e5620 1073741824 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:14 devstack sudo[88216]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:14 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-12e77cb7-496b-4372-8693-44e43d6a45a2 tempest-VolumesExtendTest-595654496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49831382-99c5-4bf2-8b3b-7749ec9c5e7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ae365ca-89f7-41d1-8332-85e232f2b22e', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:10:14 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-12e77cb7-496b-4372-8693-44e43d6a45a2 tempest-VolumesExtendTest-595654496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c60f00c2-bafc-4edc-9f70-ce92f37cbfa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:10:14 devstack sudo[88226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-77f03b1a-7ebf-4c10-a4c5-4729123e5620 1073741824 Apr 16 15:10:14 devstack sudo[88226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:14 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-42ee4b15-15ac-430e-b0d4-84d4b3c48a91 tempest-VolumesCloneTest-887639088 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2fa599a3-c7a7-4c24-a671-c856bd87dcd2" returned: 0 in 0.597s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:14 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-42ee4b15-15ac-430e-b0d4-84d4b3c48a91 tempest-VolumesCloneTest-887639088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2fa599a3-c7a7-4c24-a671-c856bd87dcd2 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:14 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-12e77cb7-496b-4372-8693-44e43d6a45a2 tempest-VolumesExtendTest-595654496 None] Volume volume-2ae365ca-89f7-41d1-8332-85e232f2b22e (2ae365ca-89f7-41d1-8332-85e232f2b22e): created successfully Apr 16 15:10:14 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-12e77cb7-496b-4372-8693-44e43d6a45a2 tempest-VolumesExtendTest-595654496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c60f00c2-bafc-4edc-9f70-ce92f37cbfa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:10:14 devstack sudo[88228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2fa599a3-c7a7-4c24-a671-c856bd87dcd2 Apr 16 15:10:14 devstack sudo[88228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:14 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-12e77cb7-496b-4372-8693-44e43d6a45a2 tempest-VolumesExtendTest-595654496 None] Flow 'volume_create_manager' (212697be-f0b1-44e0-99ee-29e2bc8c6be8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:10:14 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-12e77cb7-496b-4372-8693-44e43d6a45a2 tempest-VolumesExtendTest-595654496 None] Created volume successfully. Apr 16 15:10:15 devstack sudo[88228]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:15 devstack sudo[88226]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:15 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-42ee4b15-15ac-430e-b0d4-84d4b3c48a91 tempest-VolumesCloneTest-887639088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2fa599a3-c7a7-4c24-a671-c856bd87dcd2" returned: 0 in 0.475s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:15 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-90f47981-b434-404a-8c13-bd95510554bf tempest-ServersNegativeTestJSON-1502184342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-77f03b1a-7ebf-4c10-a4c5-4729123e5620 1073741824" returned: 0 in 0.521s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:15 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-42ee4b15-15ac-430e-b0d4-84d4b3c48a91 tempest-VolumesCloneTest-887639088 None] Lock "cinder-quobyte-2fa599a3-c7a7-4c24-a671-c856bd87dcd2" released by "delete_volume" :: held 1.117s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:10:15 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-90f47981-b434-404a-8c13-bd95510554bf tempest-ServersNegativeTestJSON-1502184342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-77f03b1a-7ebf-4c10-a4c5-4729123e5620 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:15 devstack sudo[88234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-77f03b1a-7ebf-4c10-a4c5-4729123e5620 Apr 16 15:10:15 devstack sudo[88234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:15 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-42ee4b15-15ac-430e-b0d4-84d4b3c48a91 tempest-VolumesCloneTest-887639088 None] Created reservations ['343f17b2-6634-497a-8943-5f07fc64969b', '05c486e7-28ef-4563-8984-df12cd76d95f', '835f45bd-a248-42a7-9eac-beecad2e1ca0', '5d6dd60d-bc05-4bd6-9f1a-b3c764079e79'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:10:15 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-42ee4b15-15ac-430e-b0d4-84d4b3c48a91 tempest-VolumesCloneTest-887639088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:10:15 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-42ee4b15-15ac-430e-b0d4-84d4b3c48a91 tempest-VolumesCloneTest-887639088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:10:15 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-42ee4b15-15ac-430e-b0d4-84d4b3c48a91 tempest-VolumesCloneTest-887639088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:10:15 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-42ee4b15-15ac-430e-b0d4-84d4b3c48a91 tempest-VolumesCloneTest-887639088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:10:15 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-42ee4b15-15ac-430e-b0d4-84d4b3c48a91 tempest-VolumesCloneTest-887639088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:10:15 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-42ee4b15-15ac-430e-b0d4-84d4b3c48a91 tempest-VolumesCloneTest-887639088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:15 devstack sudo[88236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:10:15 devstack sudo[88236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:15 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-8600e272-41d5-4748-aeba-95b093614b26 tempest-VolumesExtendTest-595654496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:10:15 devstack sudo[88234]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:15 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-90f47981-b434-404a-8c13-bd95510554bf tempest-ServersNegativeTestJSON-1502184342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-77f03b1a-7ebf-4c10-a4c5-4729123e5620" returned: 0 in 0.457s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:15 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-90f47981-b434-404a-8c13-bd95510554bf tempest-ServersNegativeTestJSON-1502184342 None] <== create_volume: return (1015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'} {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 15:10:15 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-90f47981-b434-404a-8c13-bd95510554bf tempest-ServersNegativeTestJSON-1502184342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.018s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:10:15 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-8600e272-41d5-4748-aeba-95b093614b26 tempest-VolumesExtendTest-595654496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.235s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:10:15 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-8600e272-41d5-4748-aeba-95b093614b26 tempest-VolumesExtendTest-595654496 None] Creating offline snapshot 23e38045-3dd6-46b3-aa01-ace53fb5417a of volume 2ae365ca-89f7-41d1-8332-85e232f2b22e {{(pid=82756) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 16 15:10:15 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-90f47981-b434-404a-8c13-bd95510554bf tempest-ServersNegativeTestJSON-1502184342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4881d9be-9117-4526-b1e6-2f2b1553392f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77f03b1a-7ebf-4c10-a4c5-4729123e5620', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:10:15 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-90f47981-b434-404a-8c13-bd95510554bf tempest-ServersNegativeTestJSON-1502184342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (095ad236-acee-4493-8b8e-beb67f6e9152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:10:15 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d2c858a-900f-4de1-b6b1-09ca8859aae0]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:10:15 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-8600e272-41d5-4748-aeba-95b093614b26 tempest-VolumesExtendTest-595654496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2ae365ca-89f7-41d1-8332-85e232f2b22e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:15 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-90f47981-b434-404a-8c13-bd95510554bf tempest-ServersNegativeTestJSON-1502184342 None] Volume volume-77f03b1a-7ebf-4c10-a4c5-4729123e5620 (77f03b1a-7ebf-4c10-a4c5-4729123e5620): created successfully Apr 16 15:10:15 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-90f47981-b434-404a-8c13-bd95510554bf tempest-ServersNegativeTestJSON-1502184342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (095ad236-acee-4493-8b8e-beb67f6e9152) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:10:15 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-90f47981-b434-404a-8c13-bd95510554bf tempest-ServersNegativeTestJSON-1502184342 None] Flow 'volume_create_manager' (e53dea03-256a-40fe-87c5-435832d06456) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:10:15 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-90f47981-b434-404a-8c13-bd95510554bf tempest-ServersNegativeTestJSON-1502184342 None] Created volume successfully. Apr 16 15:10:15 devstack sudo[88240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2ae365ca-89f7-41d1-8332-85e232f2b22e Apr 16 15:10:15 devstack sudo[88240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:15 devstack sudo[88236]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:15 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-42ee4b15-15ac-430e-b0d4-84d4b3c48a91 tempest-VolumesCloneTest-887639088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.505s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:15 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-42ee4b15-15ac-430e-b0d4-84d4b3c48a91 tempest-VolumesCloneTest-887639088 None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:10:15 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-42ee4b15-15ac-430e-b0d4-84d4b3c48a91 tempest-VolumesCloneTest-887639088 None] Deleted volume successfully. Apr 16 15:10:16 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-42ee4b15-15ac-430e-b0d4-84d4b3c48a91 tempest-VolumesCloneTest-887639088 None] Lock "cinder-2fa599a3-c7a7-4c24-a671-c856bd87dcd2-delete_volume" released by "delete_volume" :: held 1.799s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:10:16 devstack sudo[88240]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:16 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-8600e272-41d5-4748-aeba-95b093614b26 tempest-VolumesExtendTest-595654496 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2ae365ca-89f7-41d1-8332-85e232f2b22e" returned: 0 in 0.481s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:16 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-8600e272-41d5-4748-aeba-95b093614b26 tempest-VolumesExtendTest-595654496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2ae365ca-89f7-41d1-8332-85e232f2b22e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2ae365ca-89f7-41d1-8332-85e232f2b22e.23e38045-3dd6-46b3-aa01-ace53fb5417a 1G {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:16 devstack sudo[88245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2ae365ca-89f7-41d1-8332-85e232f2b22e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2ae365ca-89f7-41d1-8332-85e232f2b22e.23e38045-3dd6-46b3-aa01-ace53fb5417a 1G Apr 16 15:10:16 devstack sudo[88245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:16 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-d9f50d2a-8a59-46ad-932a-024b54e3e1af tempest-VolumesCloneTest-887639088 None] Acquiring lock "cinder-b51850cd-06d0-4227-b958-3335cb6be717-delete_volume" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:10:16 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-d9f50d2a-8a59-46ad-932a-024b54e3e1af tempest-VolumesCloneTest-887639088 None] Lock "cinder-b51850cd-06d0-4227-b958-3335cb6be717-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:10:16 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-d9f50d2a-8a59-46ad-932a-024b54e3e1af tempest-VolumesCloneTest-887639088 None] Acquiring lock "cinder-quobyte-b51850cd-06d0-4227-b958-3335cb6be717" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:10:16 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-d9f50d2a-8a59-46ad-932a-024b54e3e1af tempest-VolumesCloneTest-887639088 None] Lock "cinder-quobyte-b51850cd-06d0-4227-b958-3335cb6be717" acquired by "delete_volume" :: waited 0.008s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:10:16 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[854a4934-3bec-4a67-b353-5abbd47ec531]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:10:16 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-d9f50d2a-8a59-46ad-932a-024b54e3e1af tempest-VolumesCloneTest-887639088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b51850cd-06d0-4227-b958-3335cb6be717 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:16 devstack sudo[88247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b51850cd-06d0-4227-b958-3335cb6be717 Apr 16 15:10:16 devstack sudo[88247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:16 devstack sudo[88245]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:16 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-8600e272-41d5-4748-aeba-95b093614b26 tempest-VolumesExtendTest-595654496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2ae365ca-89f7-41d1-8332-85e232f2b22e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2ae365ca-89f7-41d1-8332-85e232f2b22e.23e38045-3dd6-46b3-aa01-ace53fb5417a 1G" returned: 0 in 0.496s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:16 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-8600e272-41d5-4748-aeba-95b093614b26 tempest-VolumesExtendTest-595654496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ae365ca-89f7-41d1-8332-85e232f2b22e -F qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2ae365ca-89f7-41d1-8332-85e232f2b22e.23e38045-3dd6-46b3-aa01-ace53fb5417a {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:16 devstack sudo[88252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ae365ca-89f7-41d1-8332-85e232f2b22e -F qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2ae365ca-89f7-41d1-8332-85e232f2b22e.23e38045-3dd6-46b3-aa01-ace53fb5417a Apr 16 15:10:16 devstack sudo[88252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:17 devstack sudo[88247]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:17 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-d9f50d2a-8a59-46ad-932a-024b54e3e1af tempest-VolumesCloneTest-887639088 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b51850cd-06d0-4227-b958-3335cb6be717" returned: 0 in 0.554s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:17 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-d9f50d2a-8a59-46ad-932a-024b54e3e1af tempest-VolumesCloneTest-887639088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b51850cd-06d0-4227-b958-3335cb6be717 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:17 devstack sudo[88257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b51850cd-06d0-4227-b958-3335cb6be717 Apr 16 15:10:17 devstack sudo[88257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:17 devstack sudo[88252]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:17 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-8600e272-41d5-4748-aeba-95b093614b26 tempest-VolumesExtendTest-595654496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ae365ca-89f7-41d1-8332-85e232f2b22e -F qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2ae365ca-89f7-41d1-8332-85e232f2b22e.23e38045-3dd6-46b3-aa01-ace53fb5417a" returned: 0 in 0.505s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:17 devstack cinder-volume[82756]: WARNING cinder.volume.drivers.remotefs [None req-8600e272-41d5-4748-aeba-95b093614b26 tempest-VolumesExtendTest-595654496 None] /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2ae365ca-89f7-41d1-8332-85e232f2b22e.23e38045-3dd6-46b3-aa01-ace53fb5417a is being set with open permissions: ugo+rw Apr 16 15:10:17 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-8600e272-41d5-4748-aeba-95b093614b26 tempest-VolumesExtendTest-595654496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2ae365ca-89f7-41d1-8332-85e232f2b22e.23e38045-3dd6-46b3-aa01-ace53fb5417a {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:17 devstack sudo[88262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2ae365ca-89f7-41d1-8332-85e232f2b22e.23e38045-3dd6-46b3-aa01-ace53fb5417a Apr 16 15:10:17 devstack sudo[88262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:17 devstack sudo[88257]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:17 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-d9f50d2a-8a59-46ad-932a-024b54e3e1af tempest-VolumesCloneTest-887639088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b51850cd-06d0-4227-b958-3335cb6be717" returned: 0 in 0.449s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:17 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-d9f50d2a-8a59-46ad-932a-024b54e3e1af tempest-VolumesCloneTest-887639088 None] Lock "cinder-quobyte-b51850cd-06d0-4227-b958-3335cb6be717" released by "delete_volume" :: held 1.044s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:10:17 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-d9f50d2a-8a59-46ad-932a-024b54e3e1af tempest-VolumesCloneTest-887639088 None] Created reservations ['bc6c2b8c-2433-4399-bec9-f49756751234', 'b07a681b-99e5-45ea-ac0c-b9b205f3204d', '975ed51f-07b1-4bc5-90da-47056204f7f7', '28e53870-8e6d-42f5-a4b1-207ad034e884'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:10:17 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-d9f50d2a-8a59-46ad-932a-024b54e3e1af tempest-VolumesCloneTest-887639088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:10:17 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-d9f50d2a-8a59-46ad-932a-024b54e3e1af tempest-VolumesCloneTest-887639088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:10:17 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-d9f50d2a-8a59-46ad-932a-024b54e3e1af tempest-VolumesCloneTest-887639088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:10:17 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-d9f50d2a-8a59-46ad-932a-024b54e3e1af tempest-VolumesCloneTest-887639088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:10:17 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-d9f50d2a-8a59-46ad-932a-024b54e3e1af tempest-VolumesCloneTest-887639088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:10:17 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-d9f50d2a-8a59-46ad-932a-024b54e3e1af tempest-VolumesCloneTest-887639088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:17 devstack sudo[88265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:10:17 devstack sudo[88265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:17 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [None req-05f4502b-a9b0-4f44-9f5c-bedaf18faed9 tempest-ServersNegativeTestJSON-1502184342 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82756) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 15:10:17 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-05f4502b-a9b0-4f44-9f5c-bedaf18faed9 tempest-ServersNegativeTestJSON-1502184342 None] Flow 'volume_create_manager' (aafee3f0-1bb4-485c-8a81-261b795a93bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:10:17 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-05f4502b-a9b0-4f44-9f5c-bedaf18faed9 tempest-ServersNegativeTestJSON-1502184342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c530c98e-0b30-4127-98f5-456bf725a460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:10:17 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-05f4502b-a9b0-4f44-9f5c-bedaf18faed9 tempest-ServersNegativeTestJSON-1502184342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c530c98e-0b30-4127-98f5-456bf725a460) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:10:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1066458335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c324622-50fb-4d7e-a57d-761e0580cc44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13eb5e84ce0a4c759c021aeb630f108a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:10:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:10:18Z,use_quota=True,user_id='46a56cc8b141418a9c7fed6285eccc90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:10:17 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-05f4502b-a9b0-4f44-9f5c-bedaf18faed9 tempest-ServersNegativeTestJSON-1502184342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af2b84b1-178b-4fb9-ae3d-ce0d02dc5454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:10:17 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-05f4502b-a9b0-4f44-9f5c-bedaf18faed9 tempest-ServersNegativeTestJSON-1502184342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af2b84b1-178b-4fb9-ae3d-ce0d02dc5454) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:10:17 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-05f4502b-a9b0-4f44-9f5c-bedaf18faed9 tempest-ServersNegativeTestJSON-1502184342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf91fc87-f88d-4c9f-bfcd-1c7951258149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:10:17 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-05f4502b-a9b0-4f44-9f5c-bedaf18faed9 tempest-ServersNegativeTestJSON-1502184342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf91fc87-f88d-4c9f-bfcd-1c7951258149) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c324622-50fb-4d7e-a57d-761e0580cc44', 'volume_name': 'volume-4c324622-50fb-4d7e-a57d-761e0580cc44', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:10:17 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-05f4502b-a9b0-4f44-9f5c-bedaf18faed9 tempest-ServersNegativeTestJSON-1502184342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efc6b0fe-e4b6-4436-95f2-338801c664d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:10:17 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-05f4502b-a9b0-4f44-9f5c-bedaf18faed9 tempest-ServersNegativeTestJSON-1502184342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efc6b0fe-e4b6-4436-95f2-338801c664d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:10:17 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-05f4502b-a9b0-4f44-9f5c-bedaf18faed9 tempest-ServersNegativeTestJSON-1502184342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01188584-6f19-449f-9a39-d5957430fbed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:10:17 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-05f4502b-a9b0-4f44-9f5c-bedaf18faed9 tempest-ServersNegativeTestJSON-1502184342 None] Volume 4c324622-50fb-4d7e-a57d-761e0580cc44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c324622-50fb-4d7e-a57d-761e0580cc44', 'volume_size': 1} Apr 16 15:10:17 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-05f4502b-a9b0-4f44-9f5c-bedaf18faed9 tempest-ServersNegativeTestJSON-1502184342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:10:17 devstack sudo[88262]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:17 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-8600e272-41d5-4748-aeba-95b093614b26 tempest-VolumesExtendTest-595654496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2ae365ca-89f7-41d1-8332-85e232f2b22e.23e38045-3dd6-46b3-aa01-ace53fb5417a" returned: 0 in 0.552s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:17 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-8600e272-41d5-4748-aeba-95b093614b26 tempest-VolumesExtendTest-595654496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2ae365ca-89f7-41d1-8332-85e232f2b22e.info {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:17 devstack sudo[88268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2ae365ca-89f7-41d1-8332-85e232f2b22e.info Apr 16 15:10:17 devstack sudo[88268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:18 devstack sudo[88265]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:18 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-d9f50d2a-8a59-46ad-932a-024b54e3e1af tempest-VolumesCloneTest-887639088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.459s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:18 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-d9f50d2a-8a59-46ad-932a-024b54e3e1af tempest-VolumesCloneTest-887639088 None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:10:18 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-d9f50d2a-8a59-46ad-932a-024b54e3e1af tempest-VolumesCloneTest-887639088 None] Deleted volume successfully. Apr 16 15:10:18 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-d9f50d2a-8a59-46ad-932a-024b54e3e1af tempest-VolumesCloneTest-887639088 None] Lock "cinder-b51850cd-06d0-4227-b958-3335cb6be717-delete_volume" released by "delete_volume" :: held 1.638s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:10:18 devstack sudo[88268]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:18 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-8600e272-41d5-4748-aeba-95b093614b26 tempest-VolumesExtendTest-595654496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2ae365ca-89f7-41d1-8332-85e232f2b22e.info" returned: 0 in 0.447s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:18 devstack cinder-volume[82756]: WARNING cinder.volume.drivers.remotefs [None req-8600e272-41d5-4748-aeba-95b093614b26 tempest-VolumesExtendTest-595654496 None] /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2ae365ca-89f7-41d1-8332-85e232f2b22e.info is being set with open permissions: ugo+rw Apr 16 15:10:18 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-8600e272-41d5-4748-aeba-95b093614b26 tempest-VolumesExtendTest-595654496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2ae365ca-89f7-41d1-8332-85e232f2b22e.info {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:18 devstack sudo[88272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2ae365ca-89f7-41d1-8332-85e232f2b22e.info Apr 16 15:10:18 devstack sudo[88272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:18 devstack sudo[88272]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:18 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-8600e272-41d5-4748-aeba-95b093614b26 tempest-VolumesExtendTest-595654496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2ae365ca-89f7-41d1-8332-85e232f2b22e.info" returned: 0 in 0.426s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:18 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-8600e272-41d5-4748-aeba-95b093614b26 tempest-VolumesExtendTest-595654496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.970s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:10:18 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-05f4502b-a9b0-4f44-9f5c-bedaf18faed9 tempest-ServersNegativeTestJSON-1502184342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.976s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:10:18 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-05f4502b-a9b0-4f44-9f5c-bedaf18faed9 tempest-ServersNegativeTestJSON-1502184342 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:10:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1066458335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c324622-50fb-4d7e-a57d-761e0580cc44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13eb5e84ce0a4c759c021aeb630f108a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:10:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:10:18Z,use_quota=True,user_id='46a56cc8b141418a9c7fed6285eccc90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)}" {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 15:10:18 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-05f4502b-a9b0-4f44-9f5c-bedaf18faed9 tempest-ServersNegativeTestJSON-1502184342 None] Creating volume 4c324622-50fb-4d7e-a57d-761e0580cc44 {{(pid=82756) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 15:10:18 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-05f4502b-a9b0-4f44-9f5c-bedaf18faed9 tempest-ServersNegativeTestJSON-1502184342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:10:18 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-05f4502b-a9b0-4f44-9f5c-bedaf18faed9 tempest-ServersNegativeTestJSON-1502184342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:10:18 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-05f4502b-a9b0-4f44-9f5c-bedaf18faed9 tempest-ServersNegativeTestJSON-1502184342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:10:18 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-05f4502b-a9b0-4f44-9f5c-bedaf18faed9 tempest-ServersNegativeTestJSON-1502184342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:10:18 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-05f4502b-a9b0-4f44-9f5c-bedaf18faed9 tempest-ServersNegativeTestJSON-1502184342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:10:18 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-05f4502b-a9b0-4f44-9f5c-bedaf18faed9 tempest-ServersNegativeTestJSON-1502184342 None] Selected osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 as target Quobyte volume. {{(pid=82756) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 15:10:18 devstack cinder-volume[82756]: INFO cinder.volume.drivers.remotefs [None req-05f4502b-a9b0-4f44-9f5c-bedaf18faed9 tempest-ServersNegativeTestJSON-1502184342 None] casted to osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 Apr 16 15:10:18 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-05f4502b-a9b0-4f44-9f5c-bedaf18faed9 tempest-ServersNegativeTestJSON-1502184342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-4c324622-50fb-4d7e-a57d-761e0580cc44 1073741824 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:18 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-8600e272-41d5-4748-aeba-95b093614b26 tempest-VolumesExtendTest-595654496 None] Create snapshot completed successfully Apr 16 15:10:18 devstack sudo[88275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-4c324622-50fb-4d7e-a57d-761e0580cc44 1073741824 Apr 16 15:10:18 devstack sudo[88275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:19 devstack sudo[88275]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:19 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-05f4502b-a9b0-4f44-9f5c-bedaf18faed9 tempest-ServersNegativeTestJSON-1502184342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-4c324622-50fb-4d7e-a57d-761e0580cc44 1073741824" returned: 0 in 0.479s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:19 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-05f4502b-a9b0-4f44-9f5c-bedaf18faed9 tempest-ServersNegativeTestJSON-1502184342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-4c324622-50fb-4d7e-a57d-761e0580cc44 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:19 devstack sudo[88280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-4c324622-50fb-4d7e-a57d-761e0580cc44 Apr 16 15:10:19 devstack sudo[88280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:19 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-043a25ef-3020-4650-ae52-33eb00abe071 tempest-VolumesExtendTest-595654496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:10:19 devstack sudo[88280]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:19 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-05f4502b-a9b0-4f44-9f5c-bedaf18faed9 tempest-ServersNegativeTestJSON-1502184342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-4c324622-50fb-4d7e-a57d-761e0580cc44" returned: 0 in 0.526s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:19 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-05f4502b-a9b0-4f44-9f5c-bedaf18faed9 tempest-ServersNegativeTestJSON-1502184342 None] <== create_volume: return (1034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'} {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 15:10:19 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-05f4502b-a9b0-4f44-9f5c-bedaf18faed9 tempest-ServersNegativeTestJSON-1502184342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:10:19 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-043a25ef-3020-4650-ae52-33eb00abe071 tempest-VolumesExtendTest-595654496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.052s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:10:19 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-05f4502b-a9b0-4f44-9f5c-bedaf18faed9 tempest-ServersNegativeTestJSON-1502184342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01188584-6f19-449f-9a39-d5957430fbed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c324622-50fb-4d7e-a57d-761e0580cc44', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:10:19 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-05f4502b-a9b0-4f44-9f5c-bedaf18faed9 tempest-ServersNegativeTestJSON-1502184342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f54174c-ae65-403c-a8eb-ada0d4aebea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:10:19 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[36acbc10-9709-448c-9309-09ceef55f87c]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:10:19 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-043a25ef-3020-4650-ae52-33eb00abe071 tempest-VolumesExtendTest-595654496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2ae365ca-89f7-41d1-8332-85e232f2b22e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:19 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-05f4502b-a9b0-4f44-9f5c-bedaf18faed9 tempest-ServersNegativeTestJSON-1502184342 None] Volume volume-4c324622-50fb-4d7e-a57d-761e0580cc44 (4c324622-50fb-4d7e-a57d-761e0580cc44): created successfully Apr 16 15:10:19 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-05f4502b-a9b0-4f44-9f5c-bedaf18faed9 tempest-ServersNegativeTestJSON-1502184342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f54174c-ae65-403c-a8eb-ada0d4aebea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:10:19 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-05f4502b-a9b0-4f44-9f5c-bedaf18faed9 tempest-ServersNegativeTestJSON-1502184342 None] Flow 'volume_create_manager' (aafee3f0-1bb4-485c-8a81-261b795a93bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:10:19 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-05f4502b-a9b0-4f44-9f5c-bedaf18faed9 tempest-ServersNegativeTestJSON-1502184342 None] Created volume successfully. Apr 16 15:10:19 devstack sudo[88283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2ae365ca-89f7-41d1-8332-85e232f2b22e Apr 16 15:10:19 devstack sudo[88283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:20 devstack sudo[88283]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:20 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-043a25ef-3020-4650-ae52-33eb00abe071 tempest-VolumesExtendTest-595654496 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2ae365ca-89f7-41d1-8332-85e232f2b22e" returned: 0 in 0.576s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:20 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-043a25ef-3020-4650-ae52-33eb00abe071 tempest-VolumesExtendTest-595654496 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2ae365ca-89f7-41d1-8332-85e232f2b22e.23e38045-3dd6-46b3-aa01-ace53fb5417a 2G {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:20 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [None req-35f4e54a-06b5-4c4e-a9a9-ef983d9fbb1c tempest-VolumesListTestJSON-1862703095 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82756) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 15:10:20 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-35f4e54a-06b5-4c4e-a9a9-ef983d9fbb1c tempest-VolumesListTestJSON-1862703095 None] Flow 'volume_create_manager' (8ff3679e-cb46-4486-8360-2d737afd06de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:10:20 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-35f4e54a-06b5-4c4e-a9a9-ef983d9fbb1c tempest-VolumesListTestJSON-1862703095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2205c36-e56b-4379-bc7a-095fc0982b8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:10:20 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-35f4e54a-06b5-4c4e-a9a9-ef983d9fbb1c tempest-VolumesListTestJSON-1862703095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2205c36-e56b-4379-bc7a-095fc0982b8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:10:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-798012000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32b64ae1-d4f6-4ed5-b5b5-5fa4263484a5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2caeafdec6444d1db2f44f9ba8b4ceb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:10:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:10:20Z,use_quota=True,user_id='1ce8e489ec1f436dbdc1703d75a14fdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:10:20 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-35f4e54a-06b5-4c4e-a9a9-ef983d9fbb1c tempest-VolumesListTestJSON-1862703095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01749132-2c86-4fa7-a718-105104b21277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:10:20 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-35f4e54a-06b5-4c4e-a9a9-ef983d9fbb1c tempest-VolumesListTestJSON-1862703095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01749132-2c86-4fa7-a718-105104b21277) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:10:20 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-35f4e54a-06b5-4c4e-a9a9-ef983d9fbb1c tempest-VolumesListTestJSON-1862703095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b6fc589-ef89-48a4-9fcb-c6de7f71851c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:10:20 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-35f4e54a-06b5-4c4e-a9a9-ef983d9fbb1c tempest-VolumesListTestJSON-1862703095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b6fc589-ef89-48a4-9fcb-c6de7f71851c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32b64ae1-d4f6-4ed5-b5b5-5fa4263484a5', 'volume_name': 'volume-32b64ae1-d4f6-4ed5-b5b5-5fa4263484a5', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:10:20 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-35f4e54a-06b5-4c4e-a9a9-ef983d9fbb1c tempest-VolumesListTestJSON-1862703095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1bfa5e0-70bc-41a2-944b-bc7a2a72803d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:10:20 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-35f4e54a-06b5-4c4e-a9a9-ef983d9fbb1c tempest-VolumesListTestJSON-1862703095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1bfa5e0-70bc-41a2-944b-bc7a2a72803d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:10:20 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-35f4e54a-06b5-4c4e-a9a9-ef983d9fbb1c tempest-VolumesListTestJSON-1862703095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c991c36-c2ed-44f4-8c6b-ba3d4314355c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:10:20 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-35f4e54a-06b5-4c4e-a9a9-ef983d9fbb1c tempest-VolumesListTestJSON-1862703095 None] Volume 32b64ae1-d4f6-4ed5-b5b5-5fa4263484a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32b64ae1-d4f6-4ed5-b5b5-5fa4263484a5', 'volume_size': 1} Apr 16 15:10:20 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-35f4e54a-06b5-4c4e-a9a9-ef983d9fbb1c tempest-VolumesListTestJSON-1862703095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:10:20 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-043a25ef-3020-4650-ae52-33eb00abe071 tempest-VolumesExtendTest-595654496 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2ae365ca-89f7-41d1-8332-85e232f2b22e.23e38045-3dd6-46b3-aa01-ace53fb5417a 2G" returned: 0 in 0.098s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:20 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-043a25ef-3020-4650-ae52-33eb00abe071 tempest-VolumesExtendTest-595654496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.706s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:10:20 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-35f4e54a-06b5-4c4e-a9a9-ef983d9fbb1c tempest-VolumesListTestJSON-1862703095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:10:20 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-35f4e54a-06b5-4c4e-a9a9-ef983d9fbb1c tempest-VolumesListTestJSON-1862703095 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:10:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-798012000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32b64ae1-d4f6-4ed5-b5b5-5fa4263484a5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2caeafdec6444d1db2f44f9ba8b4ceb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:10:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:10:20Z,use_quota=True,user_id='1ce8e489ec1f436dbdc1703d75a14fdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)}" {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 15:10:20 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-35f4e54a-06b5-4c4e-a9a9-ef983d9fbb1c tempest-VolumesListTestJSON-1862703095 None] Creating volume 32b64ae1-d4f6-4ed5-b5b5-5fa4263484a5 {{(pid=82756) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 15:10:20 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-35f4e54a-06b5-4c4e-a9a9-ef983d9fbb1c tempest-VolumesListTestJSON-1862703095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:10:20 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-35f4e54a-06b5-4c4e-a9a9-ef983d9fbb1c tempest-VolumesListTestJSON-1862703095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:10:20 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-35f4e54a-06b5-4c4e-a9a9-ef983d9fbb1c tempest-VolumesListTestJSON-1862703095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:10:20 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-35f4e54a-06b5-4c4e-a9a9-ef983d9fbb1c tempest-VolumesListTestJSON-1862703095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:10:20 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-35f4e54a-06b5-4c4e-a9a9-ef983d9fbb1c tempest-VolumesListTestJSON-1862703095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:10:20 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-35f4e54a-06b5-4c4e-a9a9-ef983d9fbb1c tempest-VolumesListTestJSON-1862703095 None] Selected osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 as target Quobyte volume. {{(pid=82756) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 15:10:20 devstack cinder-volume[82756]: INFO cinder.volume.drivers.remotefs [None req-35f4e54a-06b5-4c4e-a9a9-ef983d9fbb1c tempest-VolumesListTestJSON-1862703095 None] casted to osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 Apr 16 15:10:20 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-35f4e54a-06b5-4c4e-a9a9-ef983d9fbb1c tempest-VolumesListTestJSON-1862703095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-32b64ae1-d4f6-4ed5-b5b5-5fa4263484a5 1073741824 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:20 devstack sudo[88291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-32b64ae1-d4f6-4ed5-b5b5-5fa4263484a5 1073741824 Apr 16 15:10:20 devstack sudo[88291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:20 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-043a25ef-3020-4650-ae52-33eb00abe071 tempest-VolumesExtendTest-595654496 None] Extend volume completed successfully. Apr 16 15:10:21 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-a4435cd8-c1d7-4af9-b4ed-0caefeb65f59 tempest-VolumesExtendTest-595654496 None] Acquiring lock "cinder-23e38045-3dd6-46b3-aa01-ace53fb5417a-delete_snapshot" by "delete_snapshot" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:10:21 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-a4435cd8-c1d7-4af9-b4ed-0caefeb65f59 tempest-VolumesExtendTest-595654496 None] Lock "cinder-23e38045-3dd6-46b3-aa01-ace53fb5417a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:10:21 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-a4435cd8-c1d7-4af9-b4ed-0caefeb65f59 tempest-VolumesExtendTest-595654496 None] Acquiring lock "cinder-quobyte-2ae365ca-89f7-41d1-8332-85e232f2b22e" by "delete_snapshot" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:10:21 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-a4435cd8-c1d7-4af9-b4ed-0caefeb65f59 tempest-VolumesExtendTest-595654496 None] Lock "cinder-quobyte-2ae365ca-89f7-41d1-8332-85e232f2b22e" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:10:21 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-a4435cd8-c1d7-4af9-b4ed-0caefeb65f59 tempest-VolumesExtendTest-595654496 None] Acquiring lock "cinder-quobyte-23e38045-3dd6-46b3-aa01-ace53fb5417a" by "_delete_snapshot" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:10:21 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-a4435cd8-c1d7-4af9-b4ed-0caefeb65f59 tempest-VolumesExtendTest-595654496 None] Lock "cinder-quobyte-23e38045-3dd6-46b3-aa01-ace53fb5417a" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:10:21 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-a4435cd8-c1d7-4af9-b4ed-0caefeb65f59 tempest-VolumesExtendTest-595654496 None] Deleting offline snapshot 23e38045-3dd6-46b3-aa01-ace53fb5417a of volume 2ae365ca-89f7-41d1-8332-85e232f2b22e {{(pid=82756) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 15:10:21 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-a4435cd8-c1d7-4af9-b4ed-0caefeb65f59 tempest-VolumesExtendTest-595654496 None] snapshot_file for this snap is: volume-2ae365ca-89f7-41d1-8332-85e232f2b22e.23e38045-3dd6-46b3-aa01-ace53fb5417a {{(pid=82756) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 15:10:21 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b730a56-7ef6-4f91-af95-7a820c57de9f]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:10:21 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-a4435cd8-c1d7-4af9-b4ed-0caefeb65f59 tempest-VolumesExtendTest-595654496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2ae365ca-89f7-41d1-8332-85e232f2b22e.23e38045-3dd6-46b3-aa01-ace53fb5417a {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:21 devstack sudo[88296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2ae365ca-89f7-41d1-8332-85e232f2b22e.23e38045-3dd6-46b3-aa01-ace53fb5417a Apr 16 15:10:21 devstack sudo[88296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:21 devstack sudo[88291]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:21 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-35f4e54a-06b5-4c4e-a9a9-ef983d9fbb1c tempest-VolumesListTestJSON-1862703095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-32b64ae1-d4f6-4ed5-b5b5-5fa4263484a5 1073741824" returned: 0 in 0.642s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:21 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-35f4e54a-06b5-4c4e-a9a9-ef983d9fbb1c tempest-VolumesListTestJSON-1862703095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-32b64ae1-d4f6-4ed5-b5b5-5fa4263484a5 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:21 devstack sudo[88298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-32b64ae1-d4f6-4ed5-b5b5-5fa4263484a5 Apr 16 15:10:21 devstack sudo[88298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:21 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-0c6d67e3-6359-4f46-b8d9-4664bb5e536e tempest-ServersNegativeTestJSON-1502184342 None] Acquiring lock "cinder-4c324622-50fb-4d7e-a57d-761e0580cc44-delete_volume" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:10:21 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-0c6d67e3-6359-4f46-b8d9-4664bb5e536e tempest-ServersNegativeTestJSON-1502184342 None] Lock "cinder-4c324622-50fb-4d7e-a57d-761e0580cc44-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:10:21 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-0c6d67e3-6359-4f46-b8d9-4664bb5e536e tempest-ServersNegativeTestJSON-1502184342 None] Acquiring lock "cinder-quobyte-4c324622-50fb-4d7e-a57d-761e0580cc44" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:10:21 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-0c6d67e3-6359-4f46-b8d9-4664bb5e536e tempest-ServersNegativeTestJSON-1502184342 None] Lock "cinder-quobyte-4c324622-50fb-4d7e-a57d-761e0580cc44" acquired by "delete_volume" :: waited 0.008s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:10:21 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfb764a9-d49e-4de7-9efa-d244278ec4e9]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:10:21 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-0c6d67e3-6359-4f46-b8d9-4664bb5e536e tempest-ServersNegativeTestJSON-1502184342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-4c324622-50fb-4d7e-a57d-761e0580cc44 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:21 devstack sudo[88300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-4c324622-50fb-4d7e-a57d-761e0580cc44 Apr 16 15:10:21 devstack sudo[88300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:21 devstack sudo[88296]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:21 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-a4435cd8-c1d7-4af9-b4ed-0caefeb65f59 tempest-VolumesExtendTest-595654496 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2ae365ca-89f7-41d1-8332-85e232f2b22e.23e38045-3dd6-46b3-aa01-ace53fb5417a" returned: 0 in 0.543s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:21 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-a4435cd8-c1d7-4af9-b4ed-0caefeb65f59 tempest-VolumesExtendTest-595654496 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2ae365ca-89f7-41d1-8332-85e232f2b22e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82756) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 15:10:21 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[73dac08f-96db-4eca-9b03-16c64fde349f]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:10:21 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-a4435cd8-c1d7-4af9-b4ed-0caefeb65f59 tempest-VolumesExtendTest-595654496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2ae365ca-89f7-41d1-8332-85e232f2b22e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:21 devstack sudo[88298]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:21 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-35f4e54a-06b5-4c4e-a9a9-ef983d9fbb1c tempest-VolumesListTestJSON-1862703095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-32b64ae1-d4f6-4ed5-b5b5-5fa4263484a5" returned: 0 in 0.452s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:21 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-35f4e54a-06b5-4c4e-a9a9-ef983d9fbb1c tempest-VolumesListTestJSON-1862703095 None] <== create_volume: return (1135ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'} {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 15:10:21 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-35f4e54a-06b5-4c4e-a9a9-ef983d9fbb1c tempest-VolumesListTestJSON-1862703095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.139s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:10:21 devstack sudo[88306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2ae365ca-89f7-41d1-8332-85e232f2b22e Apr 16 15:10:21 devstack sudo[88306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:21 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-35f4e54a-06b5-4c4e-a9a9-ef983d9fbb1c tempest-VolumesListTestJSON-1862703095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c991c36-c2ed-44f4-8c6b-ba3d4314355c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32b64ae1-d4f6-4ed5-b5b5-5fa4263484a5', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:10:21 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-35f4e54a-06b5-4c4e-a9a9-ef983d9fbb1c tempest-VolumesListTestJSON-1862703095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd58594a-2391-400b-b50d-c020f38471cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:10:21 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-35f4e54a-06b5-4c4e-a9a9-ef983d9fbb1c tempest-VolumesListTestJSON-1862703095 None] Volume volume-32b64ae1-d4f6-4ed5-b5b5-5fa4263484a5 (32b64ae1-d4f6-4ed5-b5b5-5fa4263484a5): created successfully Apr 16 15:10:21 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-35f4e54a-06b5-4c4e-a9a9-ef983d9fbb1c tempest-VolumesListTestJSON-1862703095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd58594a-2391-400b-b50d-c020f38471cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:10:21 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-35f4e54a-06b5-4c4e-a9a9-ef983d9fbb1c tempest-VolumesListTestJSON-1862703095 None] Flow 'volume_create_manager' (8ff3679e-cb46-4486-8360-2d737afd06de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:10:21 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-35f4e54a-06b5-4c4e-a9a9-ef983d9fbb1c tempest-VolumesListTestJSON-1862703095 None] Created volume successfully. Apr 16 15:10:21 devstack sudo[88300]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:21 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-0c6d67e3-6359-4f46-b8d9-4664bb5e536e tempest-ServersNegativeTestJSON-1502184342 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-4c324622-50fb-4d7e-a57d-761e0580cc44" returned: 0 in 0.574s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:21 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-0c6d67e3-6359-4f46-b8d9-4664bb5e536e tempest-ServersNegativeTestJSON-1502184342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-4c324622-50fb-4d7e-a57d-761e0580cc44 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:21 devstack sudo[88311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-4c324622-50fb-4d7e-a57d-761e0580cc44 Apr 16 15:10:21 devstack sudo[88311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:22 devstack sudo[88306]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:22 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-a4435cd8-c1d7-4af9-b4ed-0caefeb65f59 tempest-VolumesExtendTest-595654496 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2ae365ca-89f7-41d1-8332-85e232f2b22e" returned: 0 in 0.499s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:22 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-a4435cd8-c1d7-4af9-b4ed-0caefeb65f59 tempest-VolumesExtendTest-595654496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2ae365ca-89f7-41d1-8332-85e232f2b22e.23e38045-3dd6-46b3-aa01-ace53fb5417a {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:22 devstack sudo[88316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2ae365ca-89f7-41d1-8332-85e232f2b22e.23e38045-3dd6-46b3-aa01-ace53fb5417a Apr 16 15:10:22 devstack sudo[88316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:22 devstack sudo[88311]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:22 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-0c6d67e3-6359-4f46-b8d9-4664bb5e536e tempest-ServersNegativeTestJSON-1502184342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-4c324622-50fb-4d7e-a57d-761e0580cc44" returned: 0 in 0.447s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:22 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-0c6d67e3-6359-4f46-b8d9-4664bb5e536e tempest-ServersNegativeTestJSON-1502184342 None] Lock "cinder-quobyte-4c324622-50fb-4d7e-a57d-761e0580cc44" released by "delete_volume" :: held 1.054s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:10:22 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-0c6d67e3-6359-4f46-b8d9-4664bb5e536e tempest-ServersNegativeTestJSON-1502184342 None] Created reservations ['16af9a26-2f21-4884-bf34-7e2f186818a7', 'd5a197d7-8134-45c5-864a-7dfad8f7e52d', '0b7b7442-04fa-49e3-8f2f-1577fd83da75', 'a9444a2a-3f81-457c-923e-cff69717952a'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:10:22 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-0c6d67e3-6359-4f46-b8d9-4664bb5e536e tempest-ServersNegativeTestJSON-1502184342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:10:22 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-0c6d67e3-6359-4f46-b8d9-4664bb5e536e tempest-ServersNegativeTestJSON-1502184342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:10:22 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-0c6d67e3-6359-4f46-b8d9-4664bb5e536e tempest-ServersNegativeTestJSON-1502184342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:10:22 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-0c6d67e3-6359-4f46-b8d9-4664bb5e536e tempest-ServersNegativeTestJSON-1502184342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:10:22 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-0c6d67e3-6359-4f46-b8d9-4664bb5e536e tempest-ServersNegativeTestJSON-1502184342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:10:22 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-0c6d67e3-6359-4f46-b8d9-4664bb5e536e tempest-ServersNegativeTestJSON-1502184342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:22 devstack sudo[88319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:10:22 devstack sudo[88319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:22 devstack sudo[88316]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:22 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-a4435cd8-c1d7-4af9-b4ed-0caefeb65f59 tempest-VolumesExtendTest-595654496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2ae365ca-89f7-41d1-8332-85e232f2b22e.23e38045-3dd6-46b3-aa01-ace53fb5417a" returned: 0 in 0.569s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:22 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-a4435cd8-c1d7-4af9-b4ed-0caefeb65f59 tempest-VolumesExtendTest-595654496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2ae365ca-89f7-41d1-8332-85e232f2b22e.23e38045-3dd6-46b3-aa01-ace53fb5417a {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:22 devstack sudo[88324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2ae365ca-89f7-41d1-8332-85e232f2b22e.23e38045-3dd6-46b3-aa01-ace53fb5417a Apr 16 15:10:22 devstack sudo[88324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:22 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3af0c8f-190b-4fa0-97c6-33f140d47465 tempest-VolumesListTestJSON-1862703095 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82756) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 15:10:22 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-a3af0c8f-190b-4fa0-97c6-33f140d47465 tempest-VolumesListTestJSON-1862703095 None] Flow 'volume_create_manager' (551a5ef7-10df-41bd-bb02-2ff698a7d737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:10:22 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-a3af0c8f-190b-4fa0-97c6-33f140d47465 tempest-VolumesListTestJSON-1862703095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8734dccc-09e4-434e-b70c-b4b7860cd86d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:10:23 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-a3af0c8f-190b-4fa0-97c6-33f140d47465 tempest-VolumesListTestJSON-1862703095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8734dccc-09e4-434e-b70c-b4b7860cd86d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:10:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-110974773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d8bf7e0-195b-4b4f-adc4-171c6e3b196e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2caeafdec6444d1db2f44f9ba8b4ceb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:10:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:10:23Z,use_quota=True,user_id='1ce8e489ec1f436dbdc1703d75a14fdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:10:23 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-a3af0c8f-190b-4fa0-97c6-33f140d47465 tempest-VolumesListTestJSON-1862703095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2a9c69a-9eb7-45bd-b790-0dfe644b96a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:10:23 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-a3af0c8f-190b-4fa0-97c6-33f140d47465 tempest-VolumesListTestJSON-1862703095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2a9c69a-9eb7-45bd-b790-0dfe644b96a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:10:23 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-a3af0c8f-190b-4fa0-97c6-33f140d47465 tempest-VolumesListTestJSON-1862703095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9005083-c21f-4071-b586-eb6182b74b2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:10:23 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-a3af0c8f-190b-4fa0-97c6-33f140d47465 tempest-VolumesListTestJSON-1862703095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9005083-c21f-4071-b586-eb6182b74b2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d8bf7e0-195b-4b4f-adc4-171c6e3b196e', 'volume_name': 'volume-7d8bf7e0-195b-4b4f-adc4-171c6e3b196e', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:10:23 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-a3af0c8f-190b-4fa0-97c6-33f140d47465 tempest-VolumesListTestJSON-1862703095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bef9fbc6-1081-4423-9829-1621fe1bff5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:10:23 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-a3af0c8f-190b-4fa0-97c6-33f140d47465 tempest-VolumesListTestJSON-1862703095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bef9fbc6-1081-4423-9829-1621fe1bff5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:10:23 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-a3af0c8f-190b-4fa0-97c6-33f140d47465 tempest-VolumesListTestJSON-1862703095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ee25d6a-9f29-4791-8306-6573c3425820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:10:23 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-a3af0c8f-190b-4fa0-97c6-33f140d47465 tempest-VolumesListTestJSON-1862703095 None] Volume 7d8bf7e0-195b-4b4f-adc4-171c6e3b196e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d8bf7e0-195b-4b4f-adc4-171c6e3b196e', 'volume_size': 1} Apr 16 15:10:23 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-a3af0c8f-190b-4fa0-97c6-33f140d47465 tempest-VolumesListTestJSON-1862703095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:10:23 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-a3af0c8f-190b-4fa0-97c6-33f140d47465 tempest-VolumesListTestJSON-1862703095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:10:23 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-a3af0c8f-190b-4fa0-97c6-33f140d47465 tempest-VolumesListTestJSON-1862703095 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:10:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-110974773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d8bf7e0-195b-4b4f-adc4-171c6e3b196e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2caeafdec6444d1db2f44f9ba8b4ceb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:10:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:10:23Z,use_quota=True,user_id='1ce8e489ec1f436dbdc1703d75a14fdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)}" {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 15:10:23 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-a3af0c8f-190b-4fa0-97c6-33f140d47465 tempest-VolumesListTestJSON-1862703095 None] Creating volume 7d8bf7e0-195b-4b4f-adc4-171c6e3b196e {{(pid=82756) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 15:10:23 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-a3af0c8f-190b-4fa0-97c6-33f140d47465 tempest-VolumesListTestJSON-1862703095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:10:23 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-a3af0c8f-190b-4fa0-97c6-33f140d47465 tempest-VolumesListTestJSON-1862703095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:10:23 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-a3af0c8f-190b-4fa0-97c6-33f140d47465 tempest-VolumesListTestJSON-1862703095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:10:23 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-a3af0c8f-190b-4fa0-97c6-33f140d47465 tempest-VolumesListTestJSON-1862703095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:10:23 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-a3af0c8f-190b-4fa0-97c6-33f140d47465 tempest-VolumesListTestJSON-1862703095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:10:23 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-a3af0c8f-190b-4fa0-97c6-33f140d47465 tempest-VolumesListTestJSON-1862703095 None] Selected osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 as target Quobyte volume. {{(pid=82756) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 15:10:23 devstack cinder-volume[82756]: INFO cinder.volume.drivers.remotefs [None req-a3af0c8f-190b-4fa0-97c6-33f140d47465 tempest-VolumesListTestJSON-1862703095 None] casted to osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 Apr 16 15:10:23 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-a3af0c8f-190b-4fa0-97c6-33f140d47465 tempest-VolumesListTestJSON-1862703095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-7d8bf7e0-195b-4b4f-adc4-171c6e3b196e 1073741824 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:23 devstack sudo[88319]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:23 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-0c6d67e3-6359-4f46-b8d9-4664bb5e536e tempest-ServersNegativeTestJSON-1502184342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.562s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:23 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-0c6d67e3-6359-4f46-b8d9-4664bb5e536e tempest-ServersNegativeTestJSON-1502184342 None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:10:23 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-0c6d67e3-6359-4f46-b8d9-4664bb5e536e tempest-ServersNegativeTestJSON-1502184342 None] Deleted volume successfully. Apr 16 15:10:23 devstack sudo[88327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-7d8bf7e0-195b-4b4f-adc4-171c6e3b196e 1073741824 Apr 16 15:10:23 devstack sudo[88327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:23 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-0c6d67e3-6359-4f46-b8d9-4664bb5e536e tempest-ServersNegativeTestJSON-1502184342 None] Lock "cinder-4c324622-50fb-4d7e-a57d-761e0580cc44-delete_volume" released by "delete_volume" :: held 1.774s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:10:23 devstack sudo[88324]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:23 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-a4435cd8-c1d7-4af9-b4ed-0caefeb65f59 tempest-VolumesExtendTest-595654496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2ae365ca-89f7-41d1-8332-85e232f2b22e.23e38045-3dd6-46b3-aa01-ace53fb5417a" returned: 0 in 0.497s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:23 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-a4435cd8-c1d7-4af9-b4ed-0caefeb65f59 tempest-VolumesExtendTest-595654496 None] Lock "cinder-quobyte-23e38045-3dd6-46b3-aa01-ace53fb5417a" released by "_delete_snapshot" :: held 2.173s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:10:23 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-a4435cd8-c1d7-4af9-b4ed-0caefeb65f59 tempest-VolumesExtendTest-595654496 None] Lock "cinder-quobyte-2ae365ca-89f7-41d1-8332-85e232f2b22e" released by "delete_snapshot" :: held 2.184s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:10:23 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-a4435cd8-c1d7-4af9-b4ed-0caefeb65f59 tempest-VolumesExtendTest-595654496 None] Created reservations ['06d1e782-d42b-4903-8f0e-61d8476248d1', '9215efba-efed-456d-80aa-4c7e576e7914', 'a3035f54-2295-43dc-bbeb-dc4bc5ee9a84', 'c6b935d7-f093-4180-8634-ebf593676d5f'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:10:23 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-a4435cd8-c1d7-4af9-b4ed-0caefeb65f59 tempest-VolumesExtendTest-595654496 None] Delete snapshot completed successfully. Apr 16 15:10:23 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-a4435cd8-c1d7-4af9-b4ed-0caefeb65f59 tempest-VolumesExtendTest-595654496 None] Lock "cinder-23e38045-3dd6-46b3-aa01-ace53fb5417a-delete_snapshot" released by "delete_snapshot" :: held 2.282s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:10:23 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-7e1c574b-eeba-4eb5-9be0-9e408f94a315 tempest-ServersNegativeTestJSON-1502184342 None] Acquiring lock "cinder-77f03b1a-7ebf-4c10-a4c5-4729123e5620-delete_volume" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:10:23 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-7e1c574b-eeba-4eb5-9be0-9e408f94a315 tempest-ServersNegativeTestJSON-1502184342 None] Lock "cinder-77f03b1a-7ebf-4c10-a4c5-4729123e5620-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:10:23 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-7e1c574b-eeba-4eb5-9be0-9e408f94a315 tempest-ServersNegativeTestJSON-1502184342 None] Acquiring lock "cinder-quobyte-77f03b1a-7ebf-4c10-a4c5-4729123e5620" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:10:23 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-7e1c574b-eeba-4eb5-9be0-9e408f94a315 tempest-ServersNegativeTestJSON-1502184342 None] Lock "cinder-quobyte-77f03b1a-7ebf-4c10-a4c5-4729123e5620" acquired by "delete_volume" :: waited 0.009s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:10:23 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[04b04af8-4d6d-4278-a8de-0885af924e61]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:10:23 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-7e1c574b-eeba-4eb5-9be0-9e408f94a315 tempest-ServersNegativeTestJSON-1502184342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-77f03b1a-7ebf-4c10-a4c5-4729123e5620 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:23 devstack sudo[88327]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:23 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-a3af0c8f-190b-4fa0-97c6-33f140d47465 tempest-VolumesListTestJSON-1862703095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-7d8bf7e0-195b-4b4f-adc4-171c6e3b196e 1073741824" returned: 0 in 0.562s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:23 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-a3af0c8f-190b-4fa0-97c6-33f140d47465 tempest-VolumesListTestJSON-1862703095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-7d8bf7e0-195b-4b4f-adc4-171c6e3b196e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:23 devstack sudo[88334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-77f03b1a-7ebf-4c10-a4c5-4729123e5620 Apr 16 15:10:23 devstack sudo[88334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:23 devstack sudo[88335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-7d8bf7e0-195b-4b4f-adc4-171c6e3b196e Apr 16 15:10:23 devstack sudo[88335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:24 devstack sudo[88335]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:24 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-a3af0c8f-190b-4fa0-97c6-33f140d47465 tempest-VolumesListTestJSON-1862703095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-7d8bf7e0-195b-4b4f-adc4-171c6e3b196e" returned: 0 in 0.432s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:24 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-a3af0c8f-190b-4fa0-97c6-33f140d47465 tempest-VolumesListTestJSON-1862703095 None] <== create_volume: return (1023ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'} {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 15:10:24 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-a3af0c8f-190b-4fa0-97c6-33f140d47465 tempest-VolumesListTestJSON-1862703095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.025s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:10:24 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-a3af0c8f-190b-4fa0-97c6-33f140d47465 tempest-VolumesListTestJSON-1862703095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ee25d6a-9f29-4791-8306-6573c3425820) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d8bf7e0-195b-4b4f-adc4-171c6e3b196e', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:10:24 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-a3af0c8f-190b-4fa0-97c6-33f140d47465 tempest-VolumesListTestJSON-1862703095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd915dfa-2b23-4437-9195-d7ba5bc2d664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:10:24 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-a3af0c8f-190b-4fa0-97c6-33f140d47465 tempest-VolumesListTestJSON-1862703095 None] Volume volume-7d8bf7e0-195b-4b4f-adc4-171c6e3b196e (7d8bf7e0-195b-4b4f-adc4-171c6e3b196e): created successfully Apr 16 15:10:24 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-a3af0c8f-190b-4fa0-97c6-33f140d47465 tempest-VolumesListTestJSON-1862703095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd915dfa-2b23-4437-9195-d7ba5bc2d664) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:10:24 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-a3af0c8f-190b-4fa0-97c6-33f140d47465 tempest-VolumesListTestJSON-1862703095 None] Flow 'volume_create_manager' (551a5ef7-10df-41bd-bb02-2ff698a7d737) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:10:24 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-a3af0c8f-190b-4fa0-97c6-33f140d47465 tempest-VolumesListTestJSON-1862703095 None] Created volume successfully. Apr 16 15:10:24 devstack sudo[88334]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:24 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-7e1c574b-eeba-4eb5-9be0-9e408f94a315 tempest-ServersNegativeTestJSON-1502184342 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-77f03b1a-7ebf-4c10-a4c5-4729123e5620" returned: 0 in 0.556s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:24 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-7e1c574b-eeba-4eb5-9be0-9e408f94a315 tempest-ServersNegativeTestJSON-1502184342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-77f03b1a-7ebf-4c10-a4c5-4729123e5620 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:24 devstack sudo[88342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-77f03b1a-7ebf-4c10-a4c5-4729123e5620 Apr 16 15:10:24 devstack sudo[88342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:24 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-269120de-76e2-4e53-a351-976b20018d19 tempest-VolumesExtendTest-595654496 None] Acquiring lock "cinder-2ae365ca-89f7-41d1-8332-85e232f2b22e-delete_volume" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:10:24 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-269120de-76e2-4e53-a351-976b20018d19 tempest-VolumesExtendTest-595654496 None] Lock "cinder-2ae365ca-89f7-41d1-8332-85e232f2b22e-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:10:24 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-269120de-76e2-4e53-a351-976b20018d19 tempest-VolumesExtendTest-595654496 None] Acquiring lock "cinder-quobyte-2ae365ca-89f7-41d1-8332-85e232f2b22e" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:10:24 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-269120de-76e2-4e53-a351-976b20018d19 tempest-VolumesExtendTest-595654496 None] Lock "cinder-quobyte-2ae365ca-89f7-41d1-8332-85e232f2b22e" acquired by "delete_volume" :: waited 0.007s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:10:24 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a56f091-6f55-418b-9fd3-84ababfa1320]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:10:24 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-269120de-76e2-4e53-a351-976b20018d19 tempest-VolumesExtendTest-595654496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2ae365ca-89f7-41d1-8332-85e232f2b22e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:24 devstack sudo[88344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2ae365ca-89f7-41d1-8332-85e232f2b22e Apr 16 15:10:24 devstack sudo[88344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:24 devstack sudo[88342]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:24 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-7e1c574b-eeba-4eb5-9be0-9e408f94a315 tempest-ServersNegativeTestJSON-1502184342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-77f03b1a-7ebf-4c10-a4c5-4729123e5620" returned: 0 in 0.492s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:24 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-7e1c574b-eeba-4eb5-9be0-9e408f94a315 tempest-ServersNegativeTestJSON-1502184342 None] Lock "cinder-quobyte-77f03b1a-7ebf-4c10-a4c5-4729123e5620" released by "delete_volume" :: held 1.071s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:10:24 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-7e1c574b-eeba-4eb5-9be0-9e408f94a315 tempest-ServersNegativeTestJSON-1502184342 None] Created reservations ['c224bc65-1f63-4087-900e-6bea641b2536', '594b8bda-1c22-40cd-8f60-1f30c85cb73b', 'f9f5cf71-3f74-4167-a226-3a959fd2442f', 'b0d133fb-e4e4-44c1-9dc3-404f5a5ba88d'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:10:24 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-7e1c574b-eeba-4eb5-9be0-9e408f94a315 tempest-ServersNegativeTestJSON-1502184342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:10:24 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-7e1c574b-eeba-4eb5-9be0-9e408f94a315 tempest-ServersNegativeTestJSON-1502184342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:10:24 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-7e1c574b-eeba-4eb5-9be0-9e408f94a315 tempest-ServersNegativeTestJSON-1502184342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:10:24 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-7e1c574b-eeba-4eb5-9be0-9e408f94a315 tempest-ServersNegativeTestJSON-1502184342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:10:24 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-7e1c574b-eeba-4eb5-9be0-9e408f94a315 tempest-ServersNegativeTestJSON-1502184342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:10:24 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-7e1c574b-eeba-4eb5-9be0-9e408f94a315 tempest-ServersNegativeTestJSON-1502184342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:24 devstack sudo[88347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:10:24 devstack sudo[88347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:24 devstack sudo[88344]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:24 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-269120de-76e2-4e53-a351-976b20018d19 tempest-VolumesExtendTest-595654496 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2ae365ca-89f7-41d1-8332-85e232f2b22e" returned: 0 in 0.517s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:24 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-269120de-76e2-4e53-a351-976b20018d19 tempest-VolumesExtendTest-595654496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2ae365ca-89f7-41d1-8332-85e232f2b22e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:24 devstack sudo[88352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2ae365ca-89f7-41d1-8332-85e232f2b22e Apr 16 15:10:24 devstack sudo[88352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:25 devstack sudo[88347]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:25 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-7e1c574b-eeba-4eb5-9be0-9e408f94a315 tempest-ServersNegativeTestJSON-1502184342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.480s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:25 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-7e1c574b-eeba-4eb5-9be0-9e408f94a315 tempest-ServersNegativeTestJSON-1502184342 None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:10:25 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-7e1c574b-eeba-4eb5-9be0-9e408f94a315 tempest-ServersNegativeTestJSON-1502184342 None] Deleted volume successfully. Apr 16 15:10:25 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-7e1c574b-eeba-4eb5-9be0-9e408f94a315 tempest-ServersNegativeTestJSON-1502184342 None] Lock "cinder-77f03b1a-7ebf-4c10-a4c5-4729123e5620-delete_volume" released by "delete_volume" :: held 1.677s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:10:25 devstack sudo[88352]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:25 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-269120de-76e2-4e53-a351-976b20018d19 tempest-VolumesExtendTest-595654496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2ae365ca-89f7-41d1-8332-85e232f2b22e" returned: 0 in 0.536s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:25 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [None req-3aaf6aa2-de25-4c3f-828a-c47e2de919f3 tempest-VolumesListTestJSON-1862703095 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82756) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 15:10:25 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-3aaf6aa2-de25-4c3f-828a-c47e2de919f3 tempest-VolumesListTestJSON-1862703095 None] Flow 'volume_create_manager' (1921b4bd-d69d-4eb1-a70e-5ff2b856977c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:10:25 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-3aaf6aa2-de25-4c3f-828a-c47e2de919f3 tempest-VolumesListTestJSON-1862703095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08f06061-d2f2-4b76-a688-024554f7c515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:10:25 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-269120de-76e2-4e53-a351-976b20018d19 tempest-VolumesExtendTest-595654496 None] Lock "cinder-quobyte-2ae365ca-89f7-41d1-8332-85e232f2b22e" released by "delete_volume" :: held 1.108s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:10:25 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-3aaf6aa2-de25-4c3f-828a-c47e2de919f3 tempest-VolumesListTestJSON-1862703095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08f06061-d2f2-4b76-a688-024554f7c515) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:10:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1885661032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c082556e-9e4b-460f-beb6-8162f2f7488b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2caeafdec6444d1db2f44f9ba8b4ceb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:10:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:10:25Z,use_quota=True,user_id='1ce8e489ec1f436dbdc1703d75a14fdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:10:25 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-3aaf6aa2-de25-4c3f-828a-c47e2de919f3 tempest-VolumesListTestJSON-1862703095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19b50dfc-5999-44dc-8d33-756d5c0c53a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:10:25 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-3aaf6aa2-de25-4c3f-828a-c47e2de919f3 tempest-VolumesListTestJSON-1862703095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19b50dfc-5999-44dc-8d33-756d5c0c53a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:10:25 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-3aaf6aa2-de25-4c3f-828a-c47e2de919f3 tempest-VolumesListTestJSON-1862703095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3785565b-db74-4a7e-9268-cf1d58931da2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:10:25 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-3aaf6aa2-de25-4c3f-828a-c47e2de919f3 tempest-VolumesListTestJSON-1862703095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3785565b-db74-4a7e-9268-cf1d58931da2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c082556e-9e4b-460f-beb6-8162f2f7488b', 'volume_name': 'volume-c082556e-9e4b-460f-beb6-8162f2f7488b', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:10:25 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-3aaf6aa2-de25-4c3f-828a-c47e2de919f3 tempest-VolumesListTestJSON-1862703095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22c66e34-77ff-4b4b-bdf9-52d728b6da4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:10:25 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-3aaf6aa2-de25-4c3f-828a-c47e2de919f3 tempest-VolumesListTestJSON-1862703095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22c66e34-77ff-4b4b-bdf9-52d728b6da4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:10:25 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-3aaf6aa2-de25-4c3f-828a-c47e2de919f3 tempest-VolumesListTestJSON-1862703095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0798b03d-6e3e-4da7-84a0-986430b5fec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:10:25 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-3aaf6aa2-de25-4c3f-828a-c47e2de919f3 tempest-VolumesListTestJSON-1862703095 None] Volume c082556e-9e4b-460f-beb6-8162f2f7488b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c082556e-9e4b-460f-beb6-8162f2f7488b', 'volume_size': 1} Apr 16 15:10:25 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-3aaf6aa2-de25-4c3f-828a-c47e2de919f3 tempest-VolumesListTestJSON-1862703095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:10:25 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-3aaf6aa2-de25-4c3f-828a-c47e2de919f3 tempest-VolumesListTestJSON-1862703095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:10:25 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-3aaf6aa2-de25-4c3f-828a-c47e2de919f3 tempest-VolumesListTestJSON-1862703095 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:10:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1885661032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c082556e-9e4b-460f-beb6-8162f2f7488b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2caeafdec6444d1db2f44f9ba8b4ceb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:10:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:10:25Z,use_quota=True,user_id='1ce8e489ec1f436dbdc1703d75a14fdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)}" {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 15:10:25 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-3aaf6aa2-de25-4c3f-828a-c47e2de919f3 tempest-VolumesListTestJSON-1862703095 None] Creating volume c082556e-9e4b-460f-beb6-8162f2f7488b {{(pid=82756) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 15:10:25 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-3aaf6aa2-de25-4c3f-828a-c47e2de919f3 tempest-VolumesListTestJSON-1862703095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:10:25 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-3aaf6aa2-de25-4c3f-828a-c47e2de919f3 tempest-VolumesListTestJSON-1862703095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:10:25 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-3aaf6aa2-de25-4c3f-828a-c47e2de919f3 tempest-VolumesListTestJSON-1862703095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:10:25 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-3aaf6aa2-de25-4c3f-828a-c47e2de919f3 tempest-VolumesListTestJSON-1862703095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:10:25 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-3aaf6aa2-de25-4c3f-828a-c47e2de919f3 tempest-VolumesListTestJSON-1862703095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:10:25 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-3aaf6aa2-de25-4c3f-828a-c47e2de919f3 tempest-VolumesListTestJSON-1862703095 None] Selected osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 as target Quobyte volume. {{(pid=82756) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 15:10:25 devstack cinder-volume[82756]: INFO cinder.volume.drivers.remotefs [None req-3aaf6aa2-de25-4c3f-828a-c47e2de919f3 tempest-VolumesListTestJSON-1862703095 None] casted to osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 Apr 16 15:10:25 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-3aaf6aa2-de25-4c3f-828a-c47e2de919f3 tempest-VolumesListTestJSON-1862703095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c082556e-9e4b-460f-beb6-8162f2f7488b 1073741824 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:25 devstack sudo[88363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c082556e-9e4b-460f-beb6-8162f2f7488b 1073741824 Apr 16 15:10:25 devstack sudo[88363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:25 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-269120de-76e2-4e53-a351-976b20018d19 tempest-VolumesExtendTest-595654496 None] Created reservations ['c0005dd3-07c9-4880-b0e4-550ab8d65888', '261a03ea-bf27-451d-ab60-38d76c57549a', 'ab88441f-c4f6-4714-9bc8-f3993d364752', '3bed0907-380a-4497-b092-579c07cbee25'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:10:25 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-269120de-76e2-4e53-a351-976b20018d19 tempest-VolumesExtendTest-595654496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:10:25 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-269120de-76e2-4e53-a351-976b20018d19 tempest-VolumesExtendTest-595654496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:10:25 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-269120de-76e2-4e53-a351-976b20018d19 tempest-VolumesExtendTest-595654496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:10:25 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-269120de-76e2-4e53-a351-976b20018d19 tempest-VolumesExtendTest-595654496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:10:25 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-269120de-76e2-4e53-a351-976b20018d19 tempest-VolumesExtendTest-595654496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:10:25 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-269120de-76e2-4e53-a351-976b20018d19 tempest-VolumesExtendTest-595654496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:25 devstack sudo[88365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:10:25 devstack sudo[88365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:25 devstack sudo[88365]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:25 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-269120de-76e2-4e53-a351-976b20018d19 tempest-VolumesExtendTest-595654496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.419s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:25 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-269120de-76e2-4e53-a351-976b20018d19 tempest-VolumesExtendTest-595654496 None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:10:26 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-269120de-76e2-4e53-a351-976b20018d19 tempest-VolumesExtendTest-595654496 None] Deleted volume successfully. Apr 16 15:10:26 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-269120de-76e2-4e53-a351-976b20018d19 tempest-VolumesExtendTest-595654496 None] Lock "cinder-2ae365ca-89f7-41d1-8332-85e232f2b22e-delete_volume" released by "delete_volume" :: held 1.734s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:10:26 devstack sudo[88363]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:26 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-3aaf6aa2-de25-4c3f-828a-c47e2de919f3 tempest-VolumesListTestJSON-1862703095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c082556e-9e4b-460f-beb6-8162f2f7488b 1073741824" returned: 0 in 0.584s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:26 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-3aaf6aa2-de25-4c3f-828a-c47e2de919f3 tempest-VolumesListTestJSON-1862703095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c082556e-9e4b-460f-beb6-8162f2f7488b {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:26 devstack sudo[88372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c082556e-9e4b-460f-beb6-8162f2f7488b Apr 16 15:10:26 devstack sudo[88372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:26 devstack sudo[88372]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:26 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-3aaf6aa2-de25-4c3f-828a-c47e2de919f3 tempest-VolumesListTestJSON-1862703095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c082556e-9e4b-460f-beb6-8162f2f7488b" returned: 0 in 0.526s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:26 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-3aaf6aa2-de25-4c3f-828a-c47e2de919f3 tempest-VolumesListTestJSON-1862703095 None] <== create_volume: return (1147ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'} {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 15:10:26 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-3aaf6aa2-de25-4c3f-828a-c47e2de919f3 tempest-VolumesListTestJSON-1862703095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.150s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:10:26 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-3aaf6aa2-de25-4c3f-828a-c47e2de919f3 tempest-VolumesListTestJSON-1862703095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0798b03d-6e3e-4da7-84a0-986430b5fec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c082556e-9e4b-460f-beb6-8162f2f7488b', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:10:26 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-3aaf6aa2-de25-4c3f-828a-c47e2de919f3 tempest-VolumesListTestJSON-1862703095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54ede99d-847f-40df-85b8-4c9b477cc0d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:10:26 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-3aaf6aa2-de25-4c3f-828a-c47e2de919f3 tempest-VolumesListTestJSON-1862703095 None] Volume volume-c082556e-9e4b-460f-beb6-8162f2f7488b (c082556e-9e4b-460f-beb6-8162f2f7488b): created successfully Apr 16 15:10:26 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-3aaf6aa2-de25-4c3f-828a-c47e2de919f3 tempest-VolumesListTestJSON-1862703095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54ede99d-847f-40df-85b8-4c9b477cc0d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:10:26 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-3aaf6aa2-de25-4c3f-828a-c47e2de919f3 tempest-VolumesListTestJSON-1862703095 None] Flow 'volume_create_manager' (1921b4bd-d69d-4eb1-a70e-5ff2b856977c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:10:26 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-3aaf6aa2-de25-4c3f-828a-c47e2de919f3 tempest-VolumesListTestJSON-1862703095 None] Created volume successfully. Apr 16 15:10:29 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-2fd56688-d0a5-49ee-8d33-1ccb70095eae tempest-VolumesListTestJSON-1862703095 None] Acquiring lock "cinder-c082556e-9e4b-460f-beb6-8162f2f7488b-delete_volume" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:10:29 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-2fd56688-d0a5-49ee-8d33-1ccb70095eae tempest-VolumesListTestJSON-1862703095 None] Lock "cinder-c082556e-9e4b-460f-beb6-8162f2f7488b-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:10:29 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-2fd56688-d0a5-49ee-8d33-1ccb70095eae tempest-VolumesListTestJSON-1862703095 None] Acquiring lock "cinder-quobyte-c082556e-9e4b-460f-beb6-8162f2f7488b" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:10:29 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-2fd56688-d0a5-49ee-8d33-1ccb70095eae tempest-VolumesListTestJSON-1862703095 None] Lock "cinder-quobyte-c082556e-9e4b-460f-beb6-8162f2f7488b" acquired by "delete_volume" :: waited 0.009s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:10:29 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2afb237-34e1-4805-aee3-776c8a1960a0]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:10:29 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-2fd56688-d0a5-49ee-8d33-1ccb70095eae tempest-VolumesListTestJSON-1862703095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c082556e-9e4b-460f-beb6-8162f2f7488b {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:29 devstack sudo[88403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c082556e-9e4b-460f-beb6-8162f2f7488b Apr 16 15:10:29 devstack sudo[88403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:30 devstack sudo[88403]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:30 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-2fd56688-d0a5-49ee-8d33-1ccb70095eae tempest-VolumesListTestJSON-1862703095 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c082556e-9e4b-460f-beb6-8162f2f7488b" returned: 0 in 0.552s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:30 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-2fd56688-d0a5-49ee-8d33-1ccb70095eae tempest-VolumesListTestJSON-1862703095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c082556e-9e4b-460f-beb6-8162f2f7488b {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:30 devstack sudo[88408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c082556e-9e4b-460f-beb6-8162f2f7488b Apr 16 15:10:30 devstack sudo[88408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:30 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf4c0a4f-d503-4621-9631-a12ba840df2a tempest-VolumesSnapshotListTestJSON-717220033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82756) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 15:10:30 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-bf4c0a4f-d503-4621-9631-a12ba840df2a tempest-VolumesSnapshotListTestJSON-717220033 None] Flow 'volume_create_manager' (028b0eac-7050-42ac-b76c-3106898a7c52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:10:30 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-bf4c0a4f-d503-4621-9631-a12ba840df2a tempest-VolumesSnapshotListTestJSON-717220033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b39f2c9d-bf13-4df9-b40e-28eea4f96ccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:10:30 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-bf4c0a4f-d503-4621-9631-a12ba840df2a tempest-VolumesSnapshotListTestJSON-717220033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b39f2c9d-bf13-4df9-b40e-28eea4f96ccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:10:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1804818346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf134331-c63f-4e30-9b6a-2cf8412d168b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78c9617b72bc49cfb29717b2f00fdb0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:10:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:10:30Z,use_quota=True,user_id='47b0042022bc4846ac3529e3c9cbf39b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:10:30 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-bf4c0a4f-d503-4621-9631-a12ba840df2a tempest-VolumesSnapshotListTestJSON-717220033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb08d269-576c-40f7-b5b5-6acfd0a42cf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:10:30 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-bf4c0a4f-d503-4621-9631-a12ba840df2a tempest-VolumesSnapshotListTestJSON-717220033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb08d269-576c-40f7-b5b5-6acfd0a42cf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:10:30 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-bf4c0a4f-d503-4621-9631-a12ba840df2a tempest-VolumesSnapshotListTestJSON-717220033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d790d67a-5e17-44c0-bcab-9ae1a1012ef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:10:30 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-bf4c0a4f-d503-4621-9631-a12ba840df2a tempest-VolumesSnapshotListTestJSON-717220033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d790d67a-5e17-44c0-bcab-9ae1a1012ef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf134331-c63f-4e30-9b6a-2cf8412d168b', 'volume_name': 'volume-bf134331-c63f-4e30-9b6a-2cf8412d168b', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:10:30 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-bf4c0a4f-d503-4621-9631-a12ba840df2a tempest-VolumesSnapshotListTestJSON-717220033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d79b142f-47ff-46c1-88ac-6d601d0b8921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:10:30 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-bf4c0a4f-d503-4621-9631-a12ba840df2a tempest-VolumesSnapshotListTestJSON-717220033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d79b142f-47ff-46c1-88ac-6d601d0b8921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:10:30 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-bf4c0a4f-d503-4621-9631-a12ba840df2a tempest-VolumesSnapshotListTestJSON-717220033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4616543c-c11b-4033-8f64-5097bc4c39ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:10:30 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-bf4c0a4f-d503-4621-9631-a12ba840df2a tempest-VolumesSnapshotListTestJSON-717220033 None] Volume bf134331-c63f-4e30-9b6a-2cf8412d168b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf134331-c63f-4e30-9b6a-2cf8412d168b', 'volume_size': 1} Apr 16 15:10:30 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-bf4c0a4f-d503-4621-9631-a12ba840df2a tempest-VolumesSnapshotListTestJSON-717220033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:10:30 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-bf4c0a4f-d503-4621-9631-a12ba840df2a tempest-VolumesSnapshotListTestJSON-717220033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:10:30 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-bf4c0a4f-d503-4621-9631-a12ba840df2a tempest-VolumesSnapshotListTestJSON-717220033 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:10:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1804818346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf134331-c63f-4e30-9b6a-2cf8412d168b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78c9617b72bc49cfb29717b2f00fdb0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:10:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:10:30Z,use_quota=True,user_id='47b0042022bc4846ac3529e3c9cbf39b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)}" {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 15:10:30 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-bf4c0a4f-d503-4621-9631-a12ba840df2a tempest-VolumesSnapshotListTestJSON-717220033 None] Creating volume bf134331-c63f-4e30-9b6a-2cf8412d168b {{(pid=82756) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 15:10:30 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-bf4c0a4f-d503-4621-9631-a12ba840df2a tempest-VolumesSnapshotListTestJSON-717220033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:10:30 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-bf4c0a4f-d503-4621-9631-a12ba840df2a tempest-VolumesSnapshotListTestJSON-717220033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:10:30 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-bf4c0a4f-d503-4621-9631-a12ba840df2a tempest-VolumesSnapshotListTestJSON-717220033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:10:30 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-bf4c0a4f-d503-4621-9631-a12ba840df2a tempest-VolumesSnapshotListTestJSON-717220033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:10:30 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-bf4c0a4f-d503-4621-9631-a12ba840df2a tempest-VolumesSnapshotListTestJSON-717220033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:10:30 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-bf4c0a4f-d503-4621-9631-a12ba840df2a tempest-VolumesSnapshotListTestJSON-717220033 None] Selected osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 as target Quobyte volume. {{(pid=82756) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 15:10:30 devstack cinder-volume[82756]: INFO cinder.volume.drivers.remotefs [None req-bf4c0a4f-d503-4621-9631-a12ba840df2a tempest-VolumesSnapshotListTestJSON-717220033 None] casted to osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 Apr 16 15:10:30 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-bf4c0a4f-d503-4621-9631-a12ba840df2a tempest-VolumesSnapshotListTestJSON-717220033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-bf134331-c63f-4e30-9b6a-2cf8412d168b 1073741824 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:30 devstack sudo[88410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-bf134331-c63f-4e30-9b6a-2cf8412d168b 1073741824 Apr 16 15:10:30 devstack sudo[88410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:30 devstack sudo[88408]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:30 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-2fd56688-d0a5-49ee-8d33-1ccb70095eae tempest-VolumesListTestJSON-1862703095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c082556e-9e4b-460f-beb6-8162f2f7488b" returned: 0 in 0.487s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:30 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-2fd56688-d0a5-49ee-8d33-1ccb70095eae tempest-VolumesListTestJSON-1862703095 None] Lock "cinder-quobyte-c082556e-9e4b-460f-beb6-8162f2f7488b" released by "delete_volume" :: held 1.070s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:10:30 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-2fd56688-d0a5-49ee-8d33-1ccb70095eae tempest-VolumesListTestJSON-1862703095 None] Created reservations ['8c258f42-a566-4692-995e-65254c0c1d35', '9bfdce4c-be14-436d-99fe-dc29721d2c48', '07ed0780-5129-4bb4-9c42-f7baf4f8f315', 'd964970d-094d-4d1a-958a-7bbb44536b93'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:10:30 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-2fd56688-d0a5-49ee-8d33-1ccb70095eae tempest-VolumesListTestJSON-1862703095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:10:30 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-2fd56688-d0a5-49ee-8d33-1ccb70095eae tempest-VolumesListTestJSON-1862703095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:10:30 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-2fd56688-d0a5-49ee-8d33-1ccb70095eae tempest-VolumesListTestJSON-1862703095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:10:30 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-2fd56688-d0a5-49ee-8d33-1ccb70095eae tempest-VolumesListTestJSON-1862703095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:10:30 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-2fd56688-d0a5-49ee-8d33-1ccb70095eae tempest-VolumesListTestJSON-1862703095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:10:30 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-2fd56688-d0a5-49ee-8d33-1ccb70095eae tempest-VolumesListTestJSON-1862703095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:30 devstack sudo[88416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:10:30 devstack sudo[88416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:30 devstack sudo[88410]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:30 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-bf4c0a4f-d503-4621-9631-a12ba840df2a tempest-VolumesSnapshotListTestJSON-717220033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-bf134331-c63f-4e30-9b6a-2cf8412d168b 1073741824" returned: 0 in 0.521s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:30 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-bf4c0a4f-d503-4621-9631-a12ba840df2a tempest-VolumesSnapshotListTestJSON-717220033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-bf134331-c63f-4e30-9b6a-2cf8412d168b {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:30 devstack sudo[88418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-bf134331-c63f-4e30-9b6a-2cf8412d168b Apr 16 15:10:30 devstack sudo[88418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:31 devstack sudo[88416]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:31 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-2fd56688-d0a5-49ee-8d33-1ccb70095eae tempest-VolumesListTestJSON-1862703095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.424s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:31 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-2fd56688-d0a5-49ee-8d33-1ccb70095eae tempest-VolumesListTestJSON-1862703095 None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:10:31 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-2fd56688-d0a5-49ee-8d33-1ccb70095eae tempest-VolumesListTestJSON-1862703095 None] Deleted volume successfully. Apr 16 15:10:31 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-2fd56688-d0a5-49ee-8d33-1ccb70095eae tempest-VolumesListTestJSON-1862703095 None] Lock "cinder-c082556e-9e4b-460f-beb6-8162f2f7488b-delete_volume" released by "delete_volume" :: held 1.642s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:10:31 devstack sudo[88418]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:31 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-bf4c0a4f-d503-4621-9631-a12ba840df2a tempest-VolumesSnapshotListTestJSON-717220033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-bf134331-c63f-4e30-9b6a-2cf8412d168b" returned: 0 in 0.447s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:31 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-bf4c0a4f-d503-4621-9631-a12ba840df2a tempest-VolumesSnapshotListTestJSON-717220033 None] <== create_volume: return (999ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'} {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 15:10:31 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-bf4c0a4f-d503-4621-9631-a12ba840df2a tempest-VolumesSnapshotListTestJSON-717220033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:10:31 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-bf4c0a4f-d503-4621-9631-a12ba840df2a tempest-VolumesSnapshotListTestJSON-717220033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4616543c-c11b-4033-8f64-5097bc4c39ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf134331-c63f-4e30-9b6a-2cf8412d168b', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:10:31 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-bf4c0a4f-d503-4621-9631-a12ba840df2a tempest-VolumesSnapshotListTestJSON-717220033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a24010d-c0db-42dc-9426-e0f051589b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:10:31 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-bf4c0a4f-d503-4621-9631-a12ba840df2a tempest-VolumesSnapshotListTestJSON-717220033 None] Volume volume-bf134331-c63f-4e30-9b6a-2cf8412d168b (bf134331-c63f-4e30-9b6a-2cf8412d168b): created successfully Apr 16 15:10:31 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-bf4c0a4f-d503-4621-9631-a12ba840df2a tempest-VolumesSnapshotListTestJSON-717220033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a24010d-c0db-42dc-9426-e0f051589b3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:10:31 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-bf4c0a4f-d503-4621-9631-a12ba840df2a tempest-VolumesSnapshotListTestJSON-717220033 None] Flow 'volume_create_manager' (028b0eac-7050-42ac-b76c-3106898a7c52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:10:31 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-bf4c0a4f-d503-4621-9631-a12ba840df2a tempest-VolumesSnapshotListTestJSON-717220033 None] Created volume successfully. Apr 16 15:10:31 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-d6074c18-e6c7-4f5a-a318-3df26aa6aae5 tempest-VolumesListTestJSON-1862703095 None] Acquiring lock "cinder-7d8bf7e0-195b-4b4f-adc4-171c6e3b196e-delete_volume" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:10:31 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-d6074c18-e6c7-4f5a-a318-3df26aa6aae5 tempest-VolumesListTestJSON-1862703095 None] Lock "cinder-7d8bf7e0-195b-4b4f-adc4-171c6e3b196e-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:10:31 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-d6074c18-e6c7-4f5a-a318-3df26aa6aae5 tempest-VolumesListTestJSON-1862703095 None] Acquiring lock "cinder-quobyte-7d8bf7e0-195b-4b4f-adc4-171c6e3b196e" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:10:31 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-d6074c18-e6c7-4f5a-a318-3df26aa6aae5 tempest-VolumesListTestJSON-1862703095 None] Lock "cinder-quobyte-7d8bf7e0-195b-4b4f-adc4-171c6e3b196e" acquired by "delete_volume" :: waited 0.009s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:10:31 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[557671f0-0596-4b4a-8e94-d04fb62525c8]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:10:31 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-d6074c18-e6c7-4f5a-a318-3df26aa6aae5 tempest-VolumesListTestJSON-1862703095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-7d8bf7e0-195b-4b4f-adc4-171c6e3b196e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:31 devstack sudo[88422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-7d8bf7e0-195b-4b4f-adc4-171c6e3b196e Apr 16 15:10:31 devstack sudo[88422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:32 devstack sudo[88422]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:32 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-d6074c18-e6c7-4f5a-a318-3df26aa6aae5 tempest-VolumesListTestJSON-1862703095 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-7d8bf7e0-195b-4b4f-adc4-171c6e3b196e" returned: 0 in 0.445s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:32 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-d6074c18-e6c7-4f5a-a318-3df26aa6aae5 tempest-VolumesListTestJSON-1862703095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-7d8bf7e0-195b-4b4f-adc4-171c6e3b196e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:32 devstack sudo[88427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-7d8bf7e0-195b-4b4f-adc4-171c6e3b196e Apr 16 15:10:32 devstack sudo[88427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:32 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-35cc05fc-22ab-4745-b416-8f439bc8c2d3 tempest-VolumesSnapshotListTestJSON-717220033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:10:32 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-35cc05fc-22ab-4745-b416-8f439bc8c2d3 tempest-VolumesSnapshotListTestJSON-717220033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:10:32 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-35cc05fc-22ab-4745-b416-8f439bc8c2d3 tempest-VolumesSnapshotListTestJSON-717220033 None] Creating offline snapshot 007c9566-2cda-42d5-b7f8-ff2bdde1cd26 of volume bf134331-c63f-4e30-9b6a-2cf8412d168b {{(pid=82756) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 16 15:10:32 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[969445fc-04ca-4210-b317-774e4317d88f]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:10:32 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-35cc05fc-22ab-4745-b416-8f439bc8c2d3 tempest-VolumesSnapshotListTestJSON-717220033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-bf134331-c63f-4e30-9b6a-2cf8412d168b {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:32 devstack sudo[88429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-bf134331-c63f-4e30-9b6a-2cf8412d168b Apr 16 15:10:32 devstack sudo[88429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:32 devstack sudo[88427]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:32 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-d6074c18-e6c7-4f5a-a318-3df26aa6aae5 tempest-VolumesListTestJSON-1862703095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-7d8bf7e0-195b-4b4f-adc4-171c6e3b196e" returned: 0 in 0.459s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:32 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-d6074c18-e6c7-4f5a-a318-3df26aa6aae5 tempest-VolumesListTestJSON-1862703095 None] Lock "cinder-quobyte-7d8bf7e0-195b-4b4f-adc4-171c6e3b196e" released by "delete_volume" :: held 0.928s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:10:32 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-d6074c18-e6c7-4f5a-a318-3df26aa6aae5 tempest-VolumesListTestJSON-1862703095 None] Created reservations ['ebc60bbd-c720-49d0-9ae8-8ef0972681c3', '57e2ac5f-2281-410d-a73e-2041d625995a', '9bcf7063-560b-44d7-8f46-baf1a799ec05', '9d76cc69-397a-4ed9-afc7-bdae7bfbceaa'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:10:32 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-d6074c18-e6c7-4f5a-a318-3df26aa6aae5 tempest-VolumesListTestJSON-1862703095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:10:32 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-d6074c18-e6c7-4f5a-a318-3df26aa6aae5 tempest-VolumesListTestJSON-1862703095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:10:32 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-d6074c18-e6c7-4f5a-a318-3df26aa6aae5 tempest-VolumesListTestJSON-1862703095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:10:32 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-d6074c18-e6c7-4f5a-a318-3df26aa6aae5 tempest-VolumesListTestJSON-1862703095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:10:32 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-d6074c18-e6c7-4f5a-a318-3df26aa6aae5 tempest-VolumesListTestJSON-1862703095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:10:32 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-d6074c18-e6c7-4f5a-a318-3df26aa6aae5 tempest-VolumesListTestJSON-1862703095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:32 devstack sudo[88432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:10:32 devstack sudo[88432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:32 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-bb8cac18-27c5-4ea6-87e9-5df231ae5bad tempest-VolumesListTestJSON-1862703095 None] Acquiring lock "cinder-32b64ae1-d4f6-4ed5-b5b5-5fa4263484a5-delete_volume" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:10:32 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-bb8cac18-27c5-4ea6-87e9-5df231ae5bad tempest-VolumesListTestJSON-1862703095 None] Lock "cinder-32b64ae1-d4f6-4ed5-b5b5-5fa4263484a5-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:10:32 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-bb8cac18-27c5-4ea6-87e9-5df231ae5bad tempest-VolumesListTestJSON-1862703095 None] Acquiring lock "cinder-quobyte-32b64ae1-d4f6-4ed5-b5b5-5fa4263484a5" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:10:32 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-bb8cac18-27c5-4ea6-87e9-5df231ae5bad tempest-VolumesListTestJSON-1862703095 None] Lock "cinder-quobyte-32b64ae1-d4f6-4ed5-b5b5-5fa4263484a5" acquired by "delete_volume" :: waited 0.009s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:10:32 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[922d2bb5-2040-4d1b-8a84-b6eb6c09c6ff]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:10:33 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-bb8cac18-27c5-4ea6-87e9-5df231ae5bad tempest-VolumesListTestJSON-1862703095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-32b64ae1-d4f6-4ed5-b5b5-5fa4263484a5 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:33 devstack sudo[88437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-32b64ae1-d4f6-4ed5-b5b5-5fa4263484a5 Apr 16 15:10:33 devstack sudo[88437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:33 devstack sudo[88429]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:33 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-35cc05fc-22ab-4745-b416-8f439bc8c2d3 tempest-VolumesSnapshotListTestJSON-717220033 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-bf134331-c63f-4e30-9b6a-2cf8412d168b" returned: 0 in 0.598s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:33 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-35cc05fc-22ab-4745-b416-8f439bc8c2d3 tempest-VolumesSnapshotListTestJSON-717220033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-bf134331-c63f-4e30-9b6a-2cf8412d168b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-bf134331-c63f-4e30-9b6a-2cf8412d168b.007c9566-2cda-42d5-b7f8-ff2bdde1cd26 1G {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:33 devstack sudo[88439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-bf134331-c63f-4e30-9b6a-2cf8412d168b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-bf134331-c63f-4e30-9b6a-2cf8412d168b.007c9566-2cda-42d5-b7f8-ff2bdde1cd26 1G Apr 16 15:10:33 devstack sudo[88439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:33 devstack sudo[88432]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:33 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-d6074c18-e6c7-4f5a-a318-3df26aa6aae5 tempest-VolumesListTestJSON-1862703095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.501s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:33 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-d6074c18-e6c7-4f5a-a318-3df26aa6aae5 tempest-VolumesListTestJSON-1862703095 None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:10:33 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-d6074c18-e6c7-4f5a-a318-3df26aa6aae5 tempest-VolumesListTestJSON-1862703095 None] Deleted volume successfully. Apr 16 15:10:33 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-d6074c18-e6c7-4f5a-a318-3df26aa6aae5 tempest-VolumesListTestJSON-1862703095 None] Lock "cinder-7d8bf7e0-195b-4b4f-adc4-171c6e3b196e-delete_volume" released by "delete_volume" :: held 1.599s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:10:33 devstack sudo[88437]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:33 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-bb8cac18-27c5-4ea6-87e9-5df231ae5bad tempest-VolumesListTestJSON-1862703095 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-32b64ae1-d4f6-4ed5-b5b5-5fa4263484a5" returned: 0 in 0.585s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:33 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-bb8cac18-27c5-4ea6-87e9-5df231ae5bad tempest-VolumesListTestJSON-1862703095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-32b64ae1-d4f6-4ed5-b5b5-5fa4263484a5 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:33 devstack sudo[88449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-32b64ae1-d4f6-4ed5-b5b5-5fa4263484a5 Apr 16 15:10:33 devstack sudo[88449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:33 devstack sudo[88439]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:33 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-35cc05fc-22ab-4745-b416-8f439bc8c2d3 tempest-VolumesSnapshotListTestJSON-717220033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-bf134331-c63f-4e30-9b6a-2cf8412d168b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-bf134331-c63f-4e30-9b6a-2cf8412d168b.007c9566-2cda-42d5-b7f8-ff2bdde1cd26 1G" returned: 0 in 0.579s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:33 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-35cc05fc-22ab-4745-b416-8f439bc8c2d3 tempest-VolumesSnapshotListTestJSON-717220033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf134331-c63f-4e30-9b6a-2cf8412d168b -F qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-bf134331-c63f-4e30-9b6a-2cf8412d168b.007c9566-2cda-42d5-b7f8-ff2bdde1cd26 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:33 devstack sudo[88451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf134331-c63f-4e30-9b6a-2cf8412d168b -F qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-bf134331-c63f-4e30-9b6a-2cf8412d168b.007c9566-2cda-42d5-b7f8-ff2bdde1cd26 Apr 16 15:10:33 devstack sudo[88451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:34 devstack sudo[88449]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:34 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-bb8cac18-27c5-4ea6-87e9-5df231ae5bad tempest-VolumesListTestJSON-1862703095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-32b64ae1-d4f6-4ed5-b5b5-5fa4263484a5" returned: 0 in 0.439s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:34 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-bb8cac18-27c5-4ea6-87e9-5df231ae5bad tempest-VolumesListTestJSON-1862703095 None] Lock "cinder-quobyte-32b64ae1-d4f6-4ed5-b5b5-5fa4263484a5" released by "delete_volume" :: held 1.048s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:10:34 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-bb8cac18-27c5-4ea6-87e9-5df231ae5bad tempest-VolumesListTestJSON-1862703095 None] Created reservations ['0b61500c-e36f-4cc3-893d-19a3ba0cac1d', 'a4370219-7772-4abc-90bf-0a49827da7c5', '8e785cd6-71a8-411a-b7a5-5fa7f39209b8', '74f8e5b8-866a-4016-970e-1a7f002d5a35'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:10:34 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-bb8cac18-27c5-4ea6-87e9-5df231ae5bad tempest-VolumesListTestJSON-1862703095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:10:34 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-bb8cac18-27c5-4ea6-87e9-5df231ae5bad tempest-VolumesListTestJSON-1862703095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:10:34 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-bb8cac18-27c5-4ea6-87e9-5df231ae5bad tempest-VolumesListTestJSON-1862703095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:10:34 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-bb8cac18-27c5-4ea6-87e9-5df231ae5bad tempest-VolumesListTestJSON-1862703095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:10:34 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-bb8cac18-27c5-4ea6-87e9-5df231ae5bad tempest-VolumesListTestJSON-1862703095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:10:34 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-bb8cac18-27c5-4ea6-87e9-5df231ae5bad tempest-VolumesListTestJSON-1862703095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:34 devstack sudo[88457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:10:34 devstack sudo[88457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:34 devstack sudo[88451]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:34 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-35cc05fc-22ab-4745-b416-8f439bc8c2d3 tempest-VolumesSnapshotListTestJSON-717220033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf134331-c63f-4e30-9b6a-2cf8412d168b -F qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-bf134331-c63f-4e30-9b6a-2cf8412d168b.007c9566-2cda-42d5-b7f8-ff2bdde1cd26" returned: 0 in 0.589s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:34 devstack cinder-volume[82756]: WARNING cinder.volume.drivers.remotefs [None req-35cc05fc-22ab-4745-b416-8f439bc8c2d3 tempest-VolumesSnapshotListTestJSON-717220033 None] /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-bf134331-c63f-4e30-9b6a-2cf8412d168b.007c9566-2cda-42d5-b7f8-ff2bdde1cd26 is being set with open permissions: ugo+rw Apr 16 15:10:34 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-35cc05fc-22ab-4745-b416-8f439bc8c2d3 tempest-VolumesSnapshotListTestJSON-717220033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-bf134331-c63f-4e30-9b6a-2cf8412d168b.007c9566-2cda-42d5-b7f8-ff2bdde1cd26 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:34 devstack sudo[88460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-bf134331-c63f-4e30-9b6a-2cf8412d168b.007c9566-2cda-42d5-b7f8-ff2bdde1cd26 Apr 16 15:10:34 devstack sudo[88460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:34 devstack sudo[88457]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:34 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-bb8cac18-27c5-4ea6-87e9-5df231ae5bad tempest-VolumesListTestJSON-1862703095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.419s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:34 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-bb8cac18-27c5-4ea6-87e9-5df231ae5bad tempest-VolumesListTestJSON-1862703095 None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:10:34 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-bb8cac18-27c5-4ea6-87e9-5df231ae5bad tempest-VolumesListTestJSON-1862703095 None] Deleted volume successfully. Apr 16 15:10:34 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-bb8cac18-27c5-4ea6-87e9-5df231ae5bad tempest-VolumesListTestJSON-1862703095 None] Lock "cinder-32b64ae1-d4f6-4ed5-b5b5-5fa4263484a5-delete_volume" released by "delete_volume" :: held 1.622s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:10:34 devstack sudo[88460]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:34 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-35cc05fc-22ab-4745-b416-8f439bc8c2d3 tempest-VolumesSnapshotListTestJSON-717220033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-bf134331-c63f-4e30-9b6a-2cf8412d168b.007c9566-2cda-42d5-b7f8-ff2bdde1cd26" returned: 0 in 0.498s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:34 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-35cc05fc-22ab-4745-b416-8f439bc8c2d3 tempest-VolumesSnapshotListTestJSON-717220033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-bf134331-c63f-4e30-9b6a-2cf8412d168b.info {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:34 devstack sudo[88464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-bf134331-c63f-4e30-9b6a-2cf8412d168b.info Apr 16 15:10:34 devstack sudo[88464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:35 devstack sudo[88464]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:35 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-35cc05fc-22ab-4745-b416-8f439bc8c2d3 tempest-VolumesSnapshotListTestJSON-717220033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-bf134331-c63f-4e30-9b6a-2cf8412d168b.info" returned: 0 in 0.495s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:35 devstack cinder-volume[82756]: WARNING cinder.volume.drivers.remotefs [None req-35cc05fc-22ab-4745-b416-8f439bc8c2d3 tempest-VolumesSnapshotListTestJSON-717220033 None] /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-bf134331-c63f-4e30-9b6a-2cf8412d168b.info is being set with open permissions: ugo+rw Apr 16 15:10:35 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-35cc05fc-22ab-4745-b416-8f439bc8c2d3 tempest-VolumesSnapshotListTestJSON-717220033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-bf134331-c63f-4e30-9b6a-2cf8412d168b.info {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:35 devstack sudo[88468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-bf134331-c63f-4e30-9b6a-2cf8412d168b.info Apr 16 15:10:35 devstack sudo[88468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:35 devstack sudo[88468]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:35 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-35cc05fc-22ab-4745-b416-8f439bc8c2d3 tempest-VolumesSnapshotListTestJSON-717220033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-bf134331-c63f-4e30-9b6a-2cf8412d168b.info" returned: 0 in 0.455s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:35 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-35cc05fc-22ab-4745-b416-8f439bc8c2d3 tempest-VolumesSnapshotListTestJSON-717220033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.279s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:10:35 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-35cc05fc-22ab-4745-b416-8f439bc8c2d3 tempest-VolumesSnapshotListTestJSON-717220033 None] Create snapshot completed successfully Apr 16 15:10:36 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-da8a586b-aea3-449d-8d86-194f7d04848c tempest-VolumesSnapshotListTestJSON-717220033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:10:36 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-da8a586b-aea3-449d-8d86-194f7d04848c tempest-VolumesSnapshotListTestJSON-717220033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:10:36 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-da8a586b-aea3-449d-8d86-194f7d04848c tempest-VolumesSnapshotListTestJSON-717220033 None] Creating offline snapshot d881e206-e953-4674-954e-1485c9a1ea41 of volume bf134331-c63f-4e30-9b6a-2cf8412d168b {{(pid=82756) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 16 15:10:36 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[282e08e5-f892-43b6-a621-7c920481baaf]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:10:36 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-da8a586b-aea3-449d-8d86-194f7d04848c tempest-VolumesSnapshotListTestJSON-717220033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-bf134331-c63f-4e30-9b6a-2cf8412d168b.007c9566-2cda-42d5-b7f8-ff2bdde1cd26 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:36 devstack sudo[88473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-bf134331-c63f-4e30-9b6a-2cf8412d168b.007c9566-2cda-42d5-b7f8-ff2bdde1cd26 Apr 16 15:10:36 devstack sudo[88473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:37 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a390d84-8d8c-41a1-acda-d409f82115b4 tempest-CreateVolumesFromImageTest-1563869356 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82756) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 15:10:37 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-6a390d84-8d8c-41a1-acda-d409f82115b4 tempest-CreateVolumesFromImageTest-1563869356 None] Flow 'volume_create_manager' (61e9420a-ac33-4c35-ae22-a5a63fb115c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:10:37 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-6a390d84-8d8c-41a1-acda-d409f82115b4 tempest-CreateVolumesFromImageTest-1563869356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edfa4249-b70e-44eb-ac88-ecd6e61900f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:10:37 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-6a390d84-8d8c-41a1-acda-d409f82115b4 tempest-CreateVolumesFromImageTest-1563869356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edfa4249-b70e-44eb-ac88-ecd6e61900f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:10:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-709977339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=237725f9-8ec2-4b05-9d24-19a69b3294cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11c041b9a46040aca8b57648499e50d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:10:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:10:37Z,use_quota=True,user_id='7181fcfdaeee4ad68c7b7da18311d2b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:10:37 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-6a390d84-8d8c-41a1-acda-d409f82115b4 tempest-CreateVolumesFromImageTest-1563869356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5fcc892-1d3e-4de0-a2cb-c4d22ab02b50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:10:37 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-6a390d84-8d8c-41a1-acda-d409f82115b4 tempest-CreateVolumesFromImageTest-1563869356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5fcc892-1d3e-4de0-a2cb-c4d22ab02b50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:10:37 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-6a390d84-8d8c-41a1-acda-d409f82115b4 tempest-CreateVolumesFromImageTest-1563869356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a77593b6-aa5b-47fc-a18c-5a83abdafe9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:10:37 devstack sudo[88473]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:37 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-6a390d84-8d8c-41a1-acda-d409f82115b4 tempest-CreateVolumesFromImageTest-1563869356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a77593b6-aa5b-47fc-a18c-5a83abdafe9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '237725f9-8ec2-4b05-9d24-19a69b3294cc', 'volume_name': 'volume-237725f9-8ec2-4b05-9d24-19a69b3294cc', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:10:37 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-6a390d84-8d8c-41a1-acda-d409f82115b4 tempest-CreateVolumesFromImageTest-1563869356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29beab22-6182-4327-b473-6a108efcd158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:10:37 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-6a390d84-8d8c-41a1-acda-d409f82115b4 tempest-CreateVolumesFromImageTest-1563869356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29beab22-6182-4327-b473-6a108efcd158) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:10:37 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-6a390d84-8d8c-41a1-acda-d409f82115b4 tempest-CreateVolumesFromImageTest-1563869356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee019a72-612b-4693-b44f-ad85e1899262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:10:37 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-6a390d84-8d8c-41a1-acda-d409f82115b4 tempest-CreateVolumesFromImageTest-1563869356 None] Volume 237725f9-8ec2-4b05-9d24-19a69b3294cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-237725f9-8ec2-4b05-9d24-19a69b3294cc', 'volume_size': 1} Apr 16 15:10:37 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-6a390d84-8d8c-41a1-acda-d409f82115b4 tempest-CreateVolumesFromImageTest-1563869356 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:10:37 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-da8a586b-aea3-449d-8d86-194f7d04848c tempest-VolumesSnapshotListTestJSON-717220033 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-bf134331-c63f-4e30-9b6a-2cf8412d168b.007c9566-2cda-42d5-b7f8-ff2bdde1cd26" returned: 0 in 0.611s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:37 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-da8a586b-aea3-449d-8d86-194f7d04848c tempest-VolumesSnapshotListTestJSON-717220033 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf134331-c63f-4e30-9b6a-2cf8412d168b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82756) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 15:10:37 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-da8a586b-aea3-449d-8d86-194f7d04848c tempest-VolumesSnapshotListTestJSON-717220033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-bf134331-c63f-4e30-9b6a-2cf8412d168b.007c9566-2cda-42d5-b7f8-ff2bdde1cd26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-bf134331-c63f-4e30-9b6a-2cf8412d168b.d881e206-e953-4674-954e-1485c9a1ea41 1G {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:37 devstack sudo[88478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-bf134331-c63f-4e30-9b6a-2cf8412d168b.007c9566-2cda-42d5-b7f8-ff2bdde1cd26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-bf134331-c63f-4e30-9b6a-2cf8412d168b.d881e206-e953-4674-954e-1485c9a1ea41 1G Apr 16 15:10:37 devstack sudo[88478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:37 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [None req-12734c66-afd4-4618-a268-e319d8dc6dca tempest-CreateVolumesFromImageTest-1563869356 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82756) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 15:10:37 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-12734c66-afd4-4618-a268-e319d8dc6dca tempest-CreateVolumesFromImageTest-1563869356 None] Flow 'volume_create_manager' (bae90c21-3bed-4a05-addb-8c92223fc0bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:10:37 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-12734c66-afd4-4618-a268-e319d8dc6dca tempest-CreateVolumesFromImageTest-1563869356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9875e273-2028-4978-923c-880ae37e2873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:10:37 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-12734c66-afd4-4618-a268-e319d8dc6dca tempest-CreateVolumesFromImageTest-1563869356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9875e273-2028-4978-923c-880ae37e2873) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:10:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2000930569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=526d6142-b04b-47a7-9719-a10fff634bc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11c041b9a46040aca8b57648499e50d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:10:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:10:37Z,use_quota=True,user_id='7181fcfdaeee4ad68c7b7da18311d2b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:10:37 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-12734c66-afd4-4618-a268-e319d8dc6dca tempest-CreateVolumesFromImageTest-1563869356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9163b7ae-5e8f-4cdc-ad6f-f95185196873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:10:37 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-12734c66-afd4-4618-a268-e319d8dc6dca tempest-CreateVolumesFromImageTest-1563869356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9163b7ae-5e8f-4cdc-ad6f-f95185196873) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:10:37 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-12734c66-afd4-4618-a268-e319d8dc6dca tempest-CreateVolumesFromImageTest-1563869356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42009de9-a2c5-4b65-84ea-7cc2adf652f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:10:37 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-12734c66-afd4-4618-a268-e319d8dc6dca tempest-CreateVolumesFromImageTest-1563869356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42009de9-a2c5-4b65-84ea-7cc2adf652f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '526d6142-b04b-47a7-9719-a10fff634bc3', 'volume_name': 'volume-526d6142-b04b-47a7-9719-a10fff634bc3', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:10:37 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-12734c66-afd4-4618-a268-e319d8dc6dca tempest-CreateVolumesFromImageTest-1563869356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88627b8e-f941-4f1d-8b92-3a54fb4e636b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:10:37 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-12734c66-afd4-4618-a268-e319d8dc6dca tempest-CreateVolumesFromImageTest-1563869356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88627b8e-f941-4f1d-8b92-3a54fb4e636b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:10:37 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-12734c66-afd4-4618-a268-e319d8dc6dca tempest-CreateVolumesFromImageTest-1563869356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d386d607-65e4-440e-a698-d6a1d4aa56bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:10:37 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-12734c66-afd4-4618-a268-e319d8dc6dca tempest-CreateVolumesFromImageTest-1563869356 None] Volume 526d6142-b04b-47a7-9719-a10fff634bc3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-526d6142-b04b-47a7-9719-a10fff634bc3', 'volume_size': 1} Apr 16 15:10:37 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-12734c66-afd4-4618-a268-e319d8dc6dca tempest-CreateVolumesFromImageTest-1563869356 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:10:37 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [None req-88af741f-435d-447b-8363-65cfd2166fc8 tempest-CreateVolumesFromImageTest-1563869356 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82756) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 15:10:37 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-88af741f-435d-447b-8363-65cfd2166fc8 tempest-CreateVolumesFromImageTest-1563869356 None] Flow 'volume_create_manager' (0bdc8c59-6cc6-4232-a85b-e71682d00127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:10:37 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-88af741f-435d-447b-8363-65cfd2166fc8 tempest-CreateVolumesFromImageTest-1563869356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40dc2c9b-6aba-4b5f-8fe1-effbe3ae6ddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:10:37 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-753e67c6-86c2-4636-9caa-0a2f10139c71 tempest-GroupSnapshotsTest-180858973 None] Group tempest-GroupSnapshotsTest-Group-968964226: creating Apr 16 15:10:37 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-88af741f-435d-447b-8363-65cfd2166fc8 tempest-CreateVolumesFromImageTest-1563869356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40dc2c9b-6aba-4b5f-8fe1-effbe3ae6ddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:10:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1928575799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de976469-0541-4b7b-a081-d0d9dd290c5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11c041b9a46040aca8b57648499e50d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:10:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:10:38Z,use_quota=True,user_id='7181fcfdaeee4ad68c7b7da18311d2b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:10:37 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-88af741f-435d-447b-8363-65cfd2166fc8 tempest-CreateVolumesFromImageTest-1563869356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c2d81ac-59b9-40b6-af3b-d0ef08994545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:10:37 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-88af741f-435d-447b-8363-65cfd2166fc8 tempest-CreateVolumesFromImageTest-1563869356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c2d81ac-59b9-40b6-af3b-d0ef08994545) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:10:37 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-88af741f-435d-447b-8363-65cfd2166fc8 tempest-CreateVolumesFromImageTest-1563869356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b09b86f8-563b-4c16-b53d-bffeb038cbe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:10:37 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-88af741f-435d-447b-8363-65cfd2166fc8 tempest-CreateVolumesFromImageTest-1563869356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b09b86f8-563b-4c16-b53d-bffeb038cbe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de976469-0541-4b7b-a081-d0d9dd290c5d', 'volume_name': 'volume-de976469-0541-4b7b-a081-d0d9dd290c5d', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:10:37 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-88af741f-435d-447b-8363-65cfd2166fc8 tempest-CreateVolumesFromImageTest-1563869356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2dbf0c4-fd02-4f01-8cea-d43b1b92bde7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:10:37 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-88af741f-435d-447b-8363-65cfd2166fc8 tempest-CreateVolumesFromImageTest-1563869356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2dbf0c4-fd02-4f01-8cea-d43b1b92bde7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:10:37 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-88af741f-435d-447b-8363-65cfd2166fc8 tempest-CreateVolumesFromImageTest-1563869356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d79b1c1-b127-470d-a86b-bf28bb538a1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:10:37 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-88af741f-435d-447b-8363-65cfd2166fc8 tempest-CreateVolumesFromImageTest-1563869356 None] Volume de976469-0541-4b7b-a081-d0d9dd290c5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de976469-0541-4b7b-a081-d0d9dd290c5d', 'volume_size': 1} Apr 16 15:10:37 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-88af741f-435d-447b-8363-65cfd2166fc8 tempest-CreateVolumesFromImageTest-1563869356 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:10:37 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-753e67c6-86c2-4636-9caa-0a2f10139c71 tempest-GroupSnapshotsTest-180858973 None] Group tempest-GroupSnapshotsTest-Group-968964226: created successfully Apr 16 15:10:37 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-753e67c6-86c2-4636-9caa-0a2f10139c71 tempest-GroupSnapshotsTest-180858973 None] Create group completed successfully. Apr 16 15:10:37 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [None req-b95a5d17-173b-44ff-8772-7ae45a13c35d tempest-CreateVolumesFromImageTest-1563869356 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82756) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 15:10:37 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-b95a5d17-173b-44ff-8772-7ae45a13c35d tempest-CreateVolumesFromImageTest-1563869356 None] Flow 'volume_create_manager' (f342bae4-a318-465b-a20e-bc64b25d0d94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:10:37 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-b95a5d17-173b-44ff-8772-7ae45a13c35d tempest-CreateVolumesFromImageTest-1563869356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15a25dc9-e4be-4844-a37f-6ed303d93f5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:10:37 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-b95a5d17-173b-44ff-8772-7ae45a13c35d tempest-CreateVolumesFromImageTest-1563869356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15a25dc9-e4be-4844-a37f-6ed303d93f5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:10:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-832368940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2bb0dd3-5e63-484d-ab54-d607b46f5c29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11c041b9a46040aca8b57648499e50d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:10:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:10:38Z,use_quota=True,user_id='7181fcfdaeee4ad68c7b7da18311d2b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:10:37 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-b95a5d17-173b-44ff-8772-7ae45a13c35d tempest-CreateVolumesFromImageTest-1563869356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4efc09b4-5dca-4cbd-acb3-7d7ea3f07ec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:10:37 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-b95a5d17-173b-44ff-8772-7ae45a13c35d tempest-CreateVolumesFromImageTest-1563869356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4efc09b4-5dca-4cbd-acb3-7d7ea3f07ec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:10:37 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-b95a5d17-173b-44ff-8772-7ae45a13c35d tempest-CreateVolumesFromImageTest-1563869356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b90c041-ab51-46f4-867d-551de64b6a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:10:37 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-b95a5d17-173b-44ff-8772-7ae45a13c35d tempest-CreateVolumesFromImageTest-1563869356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b90c041-ab51-46f4-867d-551de64b6a51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2bb0dd3-5e63-484d-ab54-d607b46f5c29', 'volume_name': 'volume-d2bb0dd3-5e63-484d-ab54-d607b46f5c29', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:10:37 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-b95a5d17-173b-44ff-8772-7ae45a13c35d tempest-CreateVolumesFromImageTest-1563869356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8fe0b11-bc8a-42b8-8320-57be717c6dbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:10:37 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-b95a5d17-173b-44ff-8772-7ae45a13c35d tempest-CreateVolumesFromImageTest-1563869356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8fe0b11-bc8a-42b8-8320-57be717c6dbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:10:37 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-b95a5d17-173b-44ff-8772-7ae45a13c35d tempest-CreateVolumesFromImageTest-1563869356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ae9dc6f-9050-4a20-ad78-c2e80200f675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:10:37 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-b95a5d17-173b-44ff-8772-7ae45a13c35d tempest-CreateVolumesFromImageTest-1563869356 None] Volume d2bb0dd3-5e63-484d-ab54-d607b46f5c29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2bb0dd3-5e63-484d-ab54-d607b46f5c29', 'volume_size': 1} Apr 16 15:10:37 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-b95a5d17-173b-44ff-8772-7ae45a13c35d tempest-CreateVolumesFromImageTest-1563869356 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:10:38 devstack sudo[88478]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:38 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-da8a586b-aea3-449d-8d86-194f7d04848c tempest-VolumesSnapshotListTestJSON-717220033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-bf134331-c63f-4e30-9b6a-2cf8412d168b.007c9566-2cda-42d5-b7f8-ff2bdde1cd26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-bf134331-c63f-4e30-9b6a-2cf8412d168b.d881e206-e953-4674-954e-1485c9a1ea41 1G" returned: 0 in 0.662s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:38 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-da8a586b-aea3-449d-8d86-194f7d04848c tempest-VolumesSnapshotListTestJSON-717220033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf134331-c63f-4e30-9b6a-2cf8412d168b.007c9566-2cda-42d5-b7f8-ff2bdde1cd26 -F qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-bf134331-c63f-4e30-9b6a-2cf8412d168b.d881e206-e953-4674-954e-1485c9a1ea41 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:38 devstack sudo[88484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf134331-c63f-4e30-9b6a-2cf8412d168b.007c9566-2cda-42d5-b7f8-ff2bdde1cd26 -F qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-bf134331-c63f-4e30-9b6a-2cf8412d168b.d881e206-e953-4674-954e-1485c9a1ea41 Apr 16 15:10:38 devstack sudo[88484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:38 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [None req-a593b1f0-7b4b-42be-9e5a-bde3748309c3 tempest-CreateVolumesFromImageTest-1563869356 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82756) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 15:10:38 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-a593b1f0-7b4b-42be-9e5a-bde3748309c3 tempest-CreateVolumesFromImageTest-1563869356 None] Flow 'volume_create_manager' (c454df15-4e64-47c5-81cf-b672024981da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:10:38 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-a593b1f0-7b4b-42be-9e5a-bde3748309c3 tempest-CreateVolumesFromImageTest-1563869356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c31b8349-1557-457b-8ddb-e3eb2717d4f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:10:38 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-a593b1f0-7b4b-42be-9e5a-bde3748309c3 tempest-CreateVolumesFromImageTest-1563869356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c31b8349-1557-457b-8ddb-e3eb2717d4f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:10:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1721330421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87c116db-e87b-4a56-8663-32444451b93d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11c041b9a46040aca8b57648499e50d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:10:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:10:38Z,use_quota=True,user_id='7181fcfdaeee4ad68c7b7da18311d2b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:10:38 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-a593b1f0-7b4b-42be-9e5a-bde3748309c3 tempest-CreateVolumesFromImageTest-1563869356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b51aa5a4-240c-4c15-8d04-4a2856d42cd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:10:38 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-a593b1f0-7b4b-42be-9e5a-bde3748309c3 tempest-CreateVolumesFromImageTest-1563869356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b51aa5a4-240c-4c15-8d04-4a2856d42cd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:10:38 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-a593b1f0-7b4b-42be-9e5a-bde3748309c3 tempest-CreateVolumesFromImageTest-1563869356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (101bdf7a-22cd-4c15-b07a-d8d35dcefdd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:10:38 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-a593b1f0-7b4b-42be-9e5a-bde3748309c3 tempest-CreateVolumesFromImageTest-1563869356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (101bdf7a-22cd-4c15-b07a-d8d35dcefdd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87c116db-e87b-4a56-8663-32444451b93d', 'volume_name': 'volume-87c116db-e87b-4a56-8663-32444451b93d', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:10:38 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-a593b1f0-7b4b-42be-9e5a-bde3748309c3 tempest-CreateVolumesFromImageTest-1563869356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6e366d2-cd57-4e30-9e41-86abbf7cb3a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:10:38 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-a593b1f0-7b4b-42be-9e5a-bde3748309c3 tempest-CreateVolumesFromImageTest-1563869356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6e366d2-cd57-4e30-9e41-86abbf7cb3a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:10:38 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-a593b1f0-7b4b-42be-9e5a-bde3748309c3 tempest-CreateVolumesFromImageTest-1563869356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fff4de4-1198-4dde-be3e-4857cdbb482e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:10:38 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-a593b1f0-7b4b-42be-9e5a-bde3748309c3 tempest-CreateVolumesFromImageTest-1563869356 None] Volume 87c116db-e87b-4a56-8663-32444451b93d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87c116db-e87b-4a56-8663-32444451b93d', 'volume_size': 1} Apr 16 15:10:38 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-a593b1f0-7b4b-42be-9e5a-bde3748309c3 tempest-CreateVolumesFromImageTest-1563869356 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:10:38 devstack sudo[88484]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:38 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-da8a586b-aea3-449d-8d86-194f7d04848c tempest-VolumesSnapshotListTestJSON-717220033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf134331-c63f-4e30-9b6a-2cf8412d168b.007c9566-2cda-42d5-b7f8-ff2bdde1cd26 -F qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-bf134331-c63f-4e30-9b6a-2cf8412d168b.d881e206-e953-4674-954e-1485c9a1ea41" returned: 0 in 0.428s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:38 devstack cinder-volume[82756]: WARNING cinder.volume.drivers.remotefs [None req-da8a586b-aea3-449d-8d86-194f7d04848c tempest-VolumesSnapshotListTestJSON-717220033 None] /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-bf134331-c63f-4e30-9b6a-2cf8412d168b.d881e206-e953-4674-954e-1485c9a1ea41 is being set with open permissions: ugo+rw Apr 16 15:10:38 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-da8a586b-aea3-449d-8d86-194f7d04848c tempest-VolumesSnapshotListTestJSON-717220033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-bf134331-c63f-4e30-9b6a-2cf8412d168b.d881e206-e953-4674-954e-1485c9a1ea41 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:38 devstack sudo[88489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-bf134331-c63f-4e30-9b6a-2cf8412d168b.d881e206-e953-4674-954e-1485c9a1ea41 Apr 16 15:10:38 devstack sudo[88489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:39 devstack sudo[88489]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:39 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-da8a586b-aea3-449d-8d86-194f7d04848c tempest-VolumesSnapshotListTestJSON-717220033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-bf134331-c63f-4e30-9b6a-2cf8412d168b.d881e206-e953-4674-954e-1485c9a1ea41" returned: 0 in 0.518s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:39 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-da8a586b-aea3-449d-8d86-194f7d04848c tempest-VolumesSnapshotListTestJSON-717220033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.282s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:10:39 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-6a390d84-8d8c-41a1-acda-d409f82115b4 tempest-CreateVolumesFromImageTest-1563869356 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.640s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:10:39 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-6a390d84-8d8c-41a1-acda-d409f82115b4 tempest-CreateVolumesFromImageTest-1563869356 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:10:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-709977339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=237725f9-8ec2-4b05-9d24-19a69b3294cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11c041b9a46040aca8b57648499e50d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:10:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:10:37Z,use_quota=True,user_id='7181fcfdaeee4ad68c7b7da18311d2b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)}" {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 15:10:39 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-6a390d84-8d8c-41a1-acda-d409f82115b4 tempest-CreateVolumesFromImageTest-1563869356 None] Creating volume 237725f9-8ec2-4b05-9d24-19a69b3294cc {{(pid=82756) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 15:10:39 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-6a390d84-8d8c-41a1-acda-d409f82115b4 tempest-CreateVolumesFromImageTest-1563869356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:10:39 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-6a390d84-8d8c-41a1-acda-d409f82115b4 tempest-CreateVolumesFromImageTest-1563869356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:10:39 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-6a390d84-8d8c-41a1-acda-d409f82115b4 tempest-CreateVolumesFromImageTest-1563869356 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:10:39 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-6a390d84-8d8c-41a1-acda-d409f82115b4 tempest-CreateVolumesFromImageTest-1563869356 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:10:39 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-6a390d84-8d8c-41a1-acda-d409f82115b4 tempest-CreateVolumesFromImageTest-1563869356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:10:39 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-6a390d84-8d8c-41a1-acda-d409f82115b4 tempest-CreateVolumesFromImageTest-1563869356 None] Selected osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 as target Quobyte volume. {{(pid=82756) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 15:10:39 devstack cinder-volume[82756]: INFO cinder.volume.drivers.remotefs [None req-6a390d84-8d8c-41a1-acda-d409f82115b4 tempest-CreateVolumesFromImageTest-1563869356 None] casted to osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 Apr 16 15:10:39 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-6a390d84-8d8c-41a1-acda-d409f82115b4 tempest-CreateVolumesFromImageTest-1563869356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-237725f9-8ec2-4b05-9d24-19a69b3294cc 1073741824 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:39 devstack sudo[88492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-237725f9-8ec2-4b05-9d24-19a69b3294cc 1073741824 Apr 16 15:10:39 devstack sudo[88492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:39 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-da8a586b-aea3-449d-8d86-194f7d04848c tempest-VolumesSnapshotListTestJSON-717220033 None] Create snapshot completed successfully Apr 16 15:10:39 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4484921-e016-4d6c-9af2-d1c9412dfdb5 tempest-GroupSnapshotsTest-180858973 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82756) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 15:10:39 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-e4484921-e016-4d6c-9af2-d1c9412dfdb5 tempest-GroupSnapshotsTest-180858973 None] Flow 'volume_create_manager' (a922e2bc-1d4b-41ee-a23a-e5ad54d4d6aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:10:39 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-e4484921-e016-4d6c-9af2-d1c9412dfdb5 tempest-GroupSnapshotsTest-180858973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a65169b4-b676-4a00-b06f-2aaa6f95cce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:10:39 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-e4484921-e016-4d6c-9af2-d1c9412dfdb5 tempest-GroupSnapshotsTest-180858973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a65169b4-b676-4a00-b06f-2aaa6f95cce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:10:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1563163064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=686c729e-8373-4727-b97d-e882e4c2a40e,host='devstack@QuobyteHD#QuobyteHD',id=db0e82c0-1155-45e7-9959-3fa545ce081f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe52d01decbe4a18a804934f56346c39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:10:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:10:39Z,use_quota=True,user_id='8c3648f05e984f90b1939e843f0cea32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e43b17f-f2c2-4344-9aa1-b39b585cab2e),volume_type_id=6e43b17f-f2c2-4344-9aa1-b39b585cab2e)' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:10:39 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-e4484921-e016-4d6c-9af2-d1c9412dfdb5 tempest-GroupSnapshotsTest-180858973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9355578-f7ff-4df1-8bc8-0d472aead865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:10:39 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-e4484921-e016-4d6c-9af2-d1c9412dfdb5 tempest-GroupSnapshotsTest-180858973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9355578-f7ff-4df1-8bc8-0d472aead865) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:10:39 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-e4484921-e016-4d6c-9af2-d1c9412dfdb5 tempest-GroupSnapshotsTest-180858973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d6a30d5-76da-4c28-8bc7-4a64c860a55c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:10:39 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-e4484921-e016-4d6c-9af2-d1c9412dfdb5 tempest-GroupSnapshotsTest-180858973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d6a30d5-76da-4c28-8bc7-4a64c860a55c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db0e82c0-1155-45e7-9959-3fa545ce081f', 'volume_name': 'volume-db0e82c0-1155-45e7-9959-3fa545ce081f', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:10:39 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-e4484921-e016-4d6c-9af2-d1c9412dfdb5 tempest-GroupSnapshotsTest-180858973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b699327-d22d-49d6-b9b6-c9e14dcb3120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:10:39 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-e4484921-e016-4d6c-9af2-d1c9412dfdb5 tempest-GroupSnapshotsTest-180858973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b699327-d22d-49d6-b9b6-c9e14dcb3120) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:10:39 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-e4484921-e016-4d6c-9af2-d1c9412dfdb5 tempest-GroupSnapshotsTest-180858973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb88efc4-ade4-4b3d-aae7-517ab3d4f7ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:10:39 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-e4484921-e016-4d6c-9af2-d1c9412dfdb5 tempest-GroupSnapshotsTest-180858973 None] Volume db0e82c0-1155-45e7-9959-3fa545ce081f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db0e82c0-1155-45e7-9959-3fa545ce081f', 'volume_size': 1} Apr 16 15:10:39 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-e4484921-e016-4d6c-9af2-d1c9412dfdb5 tempest-GroupSnapshotsTest-180858973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:10:39 devstack sudo[88492]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:39 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-6a390d84-8d8c-41a1-acda-d409f82115b4 tempest-CreateVolumesFromImageTest-1563869356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-237725f9-8ec2-4b05-9d24-19a69b3294cc 1073741824" returned: 0 in 0.475s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:39 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-6a390d84-8d8c-41a1-acda-d409f82115b4 tempest-CreateVolumesFromImageTest-1563869356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-237725f9-8ec2-4b05-9d24-19a69b3294cc {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:39 devstack sudo[88497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-237725f9-8ec2-4b05-9d24-19a69b3294cc Apr 16 15:10:39 devstack sudo[88497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:40 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-ec4aad39-92a7-4426-a97a-81d00bd84891 tempest-VolumesSnapshotListTestJSON-717220033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:10:40 devstack sudo[88497]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:40 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-6a390d84-8d8c-41a1-acda-d409f82115b4 tempest-CreateVolumesFromImageTest-1563869356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-237725f9-8ec2-4b05-9d24-19a69b3294cc" returned: 0 in 0.461s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:40 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-6a390d84-8d8c-41a1-acda-d409f82115b4 tempest-CreateVolumesFromImageTest-1563869356 None] <== create_volume: return (962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'} {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 15:10:40 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-6a390d84-8d8c-41a1-acda-d409f82115b4 tempest-CreateVolumesFromImageTest-1563869356 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.966s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:10:40 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-12734c66-afd4-4618-a268-e319d8dc6dca tempest-CreateVolumesFromImageTest-1563869356 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.405s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:10:40 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-12734c66-afd4-4618-a268-e319d8dc6dca tempest-CreateVolumesFromImageTest-1563869356 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:10:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2000930569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=526d6142-b04b-47a7-9719-a10fff634bc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11c041b9a46040aca8b57648499e50d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:10:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:10:37Z,use_quota=True,user_id='7181fcfdaeee4ad68c7b7da18311d2b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)}" {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 15:10:40 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-12734c66-afd4-4618-a268-e319d8dc6dca tempest-CreateVolumesFromImageTest-1563869356 None] Creating volume 526d6142-b04b-47a7-9719-a10fff634bc3 {{(pid=82756) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 15:10:40 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-12734c66-afd4-4618-a268-e319d8dc6dca tempest-CreateVolumesFromImageTest-1563869356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:10:40 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-12734c66-afd4-4618-a268-e319d8dc6dca tempest-CreateVolumesFromImageTest-1563869356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:10:40 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-12734c66-afd4-4618-a268-e319d8dc6dca tempest-CreateVolumesFromImageTest-1563869356 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:10:40 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-12734c66-afd4-4618-a268-e319d8dc6dca tempest-CreateVolumesFromImageTest-1563869356 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:10:40 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-12734c66-afd4-4618-a268-e319d8dc6dca tempest-CreateVolumesFromImageTest-1563869356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:10:40 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-12734c66-afd4-4618-a268-e319d8dc6dca tempest-CreateVolumesFromImageTest-1563869356 None] Selected osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 as target Quobyte volume. {{(pid=82756) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 15:10:40 devstack cinder-volume[82756]: INFO cinder.volume.drivers.remotefs [None req-12734c66-afd4-4618-a268-e319d8dc6dca tempest-CreateVolumesFromImageTest-1563869356 None] casted to osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 Apr 16 15:10:40 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-12734c66-afd4-4618-a268-e319d8dc6dca tempest-CreateVolumesFromImageTest-1563869356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-526d6142-b04b-47a7-9719-a10fff634bc3 1073741824 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:40 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-6a390d84-8d8c-41a1-acda-d409f82115b4 tempest-CreateVolumesFromImageTest-1563869356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee019a72-612b-4693-b44f-ad85e1899262) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-237725f9-8ec2-4b05-9d24-19a69b3294cc', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:10:40 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-6a390d84-8d8c-41a1-acda-d409f82115b4 tempest-CreateVolumesFromImageTest-1563869356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (728969f4-00e1-4673-8bb9-27f04c3813fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:10:40 devstack sudo[88500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-526d6142-b04b-47a7-9719-a10fff634bc3 1073741824 Apr 16 15:10:40 devstack sudo[88500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:40 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-6a390d84-8d8c-41a1-acda-d409f82115b4 tempest-CreateVolumesFromImageTest-1563869356 None] Volume volume-237725f9-8ec2-4b05-9d24-19a69b3294cc (237725f9-8ec2-4b05-9d24-19a69b3294cc): created successfully Apr 16 15:10:40 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-6a390d84-8d8c-41a1-acda-d409f82115b4 tempest-CreateVolumesFromImageTest-1563869356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (728969f4-00e1-4673-8bb9-27f04c3813fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:10:40 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-6a390d84-8d8c-41a1-acda-d409f82115b4 tempest-CreateVolumesFromImageTest-1563869356 None] Flow 'volume_create_manager' (61e9420a-ac33-4c35-ae22-a5a63fb115c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:10:40 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-6a390d84-8d8c-41a1-acda-d409f82115b4 tempest-CreateVolumesFromImageTest-1563869356 None] Created volume successfully. Apr 16 15:10:40 devstack sudo[88500]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:40 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-12734c66-afd4-4618-a268-e319d8dc6dca tempest-CreateVolumesFromImageTest-1563869356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-526d6142-b04b-47a7-9719-a10fff634bc3 1073741824" returned: 0 in 0.484s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:40 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-12734c66-afd4-4618-a268-e319d8dc6dca tempest-CreateVolumesFromImageTest-1563869356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-526d6142-b04b-47a7-9719-a10fff634bc3 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:40 devstack sudo[88505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-526d6142-b04b-47a7-9719-a10fff634bc3 Apr 16 15:10:40 devstack sudo[88505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:40 devstack sudo[88505]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:40 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-12734c66-afd4-4618-a268-e319d8dc6dca tempest-CreateVolumesFromImageTest-1563869356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-526d6142-b04b-47a7-9719-a10fff634bc3" returned: 0 in 0.396s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:40 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-12734c66-afd4-4618-a268-e319d8dc6dca tempest-CreateVolumesFromImageTest-1563869356 None] <== create_volume: return (902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'} {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 15:10:40 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-12734c66-afd4-4618-a268-e319d8dc6dca tempest-CreateVolumesFromImageTest-1563869356 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:10:40 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-88af741f-435d-447b-8363-65cfd2166fc8 tempest-CreateVolumesFromImageTest-1563869356 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.087s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:10:40 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-88af741f-435d-447b-8363-65cfd2166fc8 tempest-CreateVolumesFromImageTest-1563869356 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:10:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1928575799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de976469-0541-4b7b-a081-d0d9dd290c5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11c041b9a46040aca8b57648499e50d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:10:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:10:38Z,use_quota=True,user_id='7181fcfdaeee4ad68c7b7da18311d2b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)}" {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 15:10:40 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-88af741f-435d-447b-8363-65cfd2166fc8 tempest-CreateVolumesFromImageTest-1563869356 None] Creating volume de976469-0541-4b7b-a081-d0d9dd290c5d {{(pid=82756) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 15:10:40 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-88af741f-435d-447b-8363-65cfd2166fc8 tempest-CreateVolumesFromImageTest-1563869356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:10:40 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-88af741f-435d-447b-8363-65cfd2166fc8 tempest-CreateVolumesFromImageTest-1563869356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:10:40 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-88af741f-435d-447b-8363-65cfd2166fc8 tempest-CreateVolumesFromImageTest-1563869356 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:10:40 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-88af741f-435d-447b-8363-65cfd2166fc8 tempest-CreateVolumesFromImageTest-1563869356 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:10:40 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-88af741f-435d-447b-8363-65cfd2166fc8 tempest-CreateVolumesFromImageTest-1563869356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:10:40 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-88af741f-435d-447b-8363-65cfd2166fc8 tempest-CreateVolumesFromImageTest-1563869356 None] Selected osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 as target Quobyte volume. {{(pid=82756) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 15:10:40 devstack cinder-volume[82756]: INFO cinder.volume.drivers.remotefs [None req-88af741f-435d-447b-8363-65cfd2166fc8 tempest-CreateVolumesFromImageTest-1563869356 None] casted to osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 Apr 16 15:10:40 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-88af741f-435d-447b-8363-65cfd2166fc8 tempest-CreateVolumesFromImageTest-1563869356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-de976469-0541-4b7b-a081-d0d9dd290c5d 1073741824 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:40 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-12734c66-afd4-4618-a268-e319d8dc6dca tempest-CreateVolumesFromImageTest-1563869356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d386d607-65e4-440e-a698-d6a1d4aa56bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-526d6142-b04b-47a7-9719-a10fff634bc3', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:10:40 devstack sudo[88508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-de976469-0541-4b7b-a081-d0d9dd290c5d 1073741824 Apr 16 15:10:40 devstack sudo[88508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:40 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-12734c66-afd4-4618-a268-e319d8dc6dca tempest-CreateVolumesFromImageTest-1563869356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27486614-4324-417c-8238-ebc6c8bf966a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:10:40 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-12734c66-afd4-4618-a268-e319d8dc6dca tempest-CreateVolumesFromImageTest-1563869356 None] Volume volume-526d6142-b04b-47a7-9719-a10fff634bc3 (526d6142-b04b-47a7-9719-a10fff634bc3): created successfully Apr 16 15:10:40 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-12734c66-afd4-4618-a268-e319d8dc6dca tempest-CreateVolumesFromImageTest-1563869356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27486614-4324-417c-8238-ebc6c8bf966a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:10:40 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-12734c66-afd4-4618-a268-e319d8dc6dca tempest-CreateVolumesFromImageTest-1563869356 None] Flow 'volume_create_manager' (bae90c21-3bed-4a05-addb-8c92223fc0bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:10:40 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-12734c66-afd4-4618-a268-e319d8dc6dca tempest-CreateVolumesFromImageTest-1563869356 None] Created volume successfully. Apr 16 15:10:41 devstack sudo[88508]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:41 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-88af741f-435d-447b-8363-65cfd2166fc8 tempest-CreateVolumesFromImageTest-1563869356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-de976469-0541-4b7b-a081-d0d9dd290c5d 1073741824" returned: 0 in 0.484s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:41 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-88af741f-435d-447b-8363-65cfd2166fc8 tempest-CreateVolumesFromImageTest-1563869356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-de976469-0541-4b7b-a081-d0d9dd290c5d {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:41 devstack sudo[88513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-de976469-0541-4b7b-a081-d0d9dd290c5d Apr 16 15:10:41 devstack sudo[88513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:41 devstack sudo[88513]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:41 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-88af741f-435d-447b-8363-65cfd2166fc8 tempest-CreateVolumesFromImageTest-1563869356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-de976469-0541-4b7b-a081-d0d9dd290c5d" returned: 0 in 0.384s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:41 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-88af741f-435d-447b-8363-65cfd2166fc8 tempest-CreateVolumesFromImageTest-1563869356 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'} {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 15:10:41 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-88af741f-435d-447b-8363-65cfd2166fc8 tempest-CreateVolumesFromImageTest-1563869356 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.893s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:10:41 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-b95a5d17-173b-44ff-8772-7ae45a13c35d tempest-CreateVolumesFromImageTest-1563869356 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.857s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:10:41 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-b95a5d17-173b-44ff-8772-7ae45a13c35d tempest-CreateVolumesFromImageTest-1563869356 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:10:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-832368940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2bb0dd3-5e63-484d-ab54-d607b46f5c29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11c041b9a46040aca8b57648499e50d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:10:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:10:38Z,use_quota=True,user_id='7181fcfdaeee4ad68c7b7da18311d2b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)}" {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 15:10:41 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-b95a5d17-173b-44ff-8772-7ae45a13c35d tempest-CreateVolumesFromImageTest-1563869356 None] Creating volume d2bb0dd3-5e63-484d-ab54-d607b46f5c29 {{(pid=82756) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 15:10:41 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-b95a5d17-173b-44ff-8772-7ae45a13c35d tempest-CreateVolumesFromImageTest-1563869356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:10:41 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-b95a5d17-173b-44ff-8772-7ae45a13c35d tempest-CreateVolumesFromImageTest-1563869356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:10:41 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-b95a5d17-173b-44ff-8772-7ae45a13c35d tempest-CreateVolumesFromImageTest-1563869356 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:10:41 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-b95a5d17-173b-44ff-8772-7ae45a13c35d tempest-CreateVolumesFromImageTest-1563869356 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:10:41 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-b95a5d17-173b-44ff-8772-7ae45a13c35d tempest-CreateVolumesFromImageTest-1563869356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:10:41 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-b95a5d17-173b-44ff-8772-7ae45a13c35d tempest-CreateVolumesFromImageTest-1563869356 None] Selected osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 as target Quobyte volume. {{(pid=82756) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 15:10:41 devstack cinder-volume[82756]: INFO cinder.volume.drivers.remotefs [None req-b95a5d17-173b-44ff-8772-7ae45a13c35d tempest-CreateVolumesFromImageTest-1563869356 None] casted to osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 Apr 16 15:10:41 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-b95a5d17-173b-44ff-8772-7ae45a13c35d tempest-CreateVolumesFromImageTest-1563869356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-d2bb0dd3-5e63-484d-ab54-d607b46f5c29 1073741824 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:41 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-88af741f-435d-447b-8363-65cfd2166fc8 tempest-CreateVolumesFromImageTest-1563869356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d79b1c1-b127-470d-a86b-bf28bb538a1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de976469-0541-4b7b-a081-d0d9dd290c5d', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:10:41 devstack sudo[88516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-d2bb0dd3-5e63-484d-ab54-d607b46f5c29 1073741824 Apr 16 15:10:41 devstack sudo[88516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:41 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-88af741f-435d-447b-8363-65cfd2166fc8 tempest-CreateVolumesFromImageTest-1563869356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4c36681-0ad8-4fa9-bb3b-5621577ea0f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:10:41 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-88af741f-435d-447b-8363-65cfd2166fc8 tempest-CreateVolumesFromImageTest-1563869356 None] Volume volume-de976469-0541-4b7b-a081-d0d9dd290c5d (de976469-0541-4b7b-a081-d0d9dd290c5d): created successfully Apr 16 15:10:41 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-88af741f-435d-447b-8363-65cfd2166fc8 tempest-CreateVolumesFromImageTest-1563869356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4c36681-0ad8-4fa9-bb3b-5621577ea0f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:10:41 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-88af741f-435d-447b-8363-65cfd2166fc8 tempest-CreateVolumesFromImageTest-1563869356 None] Flow 'volume_create_manager' (0bdc8c59-6cc6-4232-a85b-e71682d00127) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:10:41 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-88af741f-435d-447b-8363-65cfd2166fc8 tempest-CreateVolumesFromImageTest-1563869356 None] Created volume successfully. Apr 16 15:10:42 devstack sudo[88516]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:42 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-b95a5d17-173b-44ff-8772-7ae45a13c35d tempest-CreateVolumesFromImageTest-1563869356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-d2bb0dd3-5e63-484d-ab54-d607b46f5c29 1073741824" returned: 0 in 0.479s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:42 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-b95a5d17-173b-44ff-8772-7ae45a13c35d tempest-CreateVolumesFromImageTest-1563869356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-d2bb0dd3-5e63-484d-ab54-d607b46f5c29 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:42 devstack sudo[88521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-d2bb0dd3-5e63-484d-ab54-d607b46f5c29 Apr 16 15:10:42 devstack sudo[88521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:42 devstack sudo[88521]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:42 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-b95a5d17-173b-44ff-8772-7ae45a13c35d tempest-CreateVolumesFromImageTest-1563869356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-d2bb0dd3-5e63-484d-ab54-d607b46f5c29" returned: 0 in 0.402s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:42 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-b95a5d17-173b-44ff-8772-7ae45a13c35d tempest-CreateVolumesFromImageTest-1563869356 None] <== create_volume: return (907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'} {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 15:10:42 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-b95a5d17-173b-44ff-8772-7ae45a13c35d tempest-CreateVolumesFromImageTest-1563869356 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.909s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:10:42 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-a593b1f0-7b4b-42be-9e5a-bde3748309c3 tempest-CreateVolumesFromImageTest-1563869356 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.552s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:10:42 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-a593b1f0-7b4b-42be-9e5a-bde3748309c3 tempest-CreateVolumesFromImageTest-1563869356 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:10:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1721330421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87c116db-e87b-4a56-8663-32444451b93d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11c041b9a46040aca8b57648499e50d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:10:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:10:38Z,use_quota=True,user_id='7181fcfdaeee4ad68c7b7da18311d2b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)}" {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 15:10:42 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-a593b1f0-7b4b-42be-9e5a-bde3748309c3 tempest-CreateVolumesFromImageTest-1563869356 None] Creating volume 87c116db-e87b-4a56-8663-32444451b93d {{(pid=82756) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 15:10:42 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-a593b1f0-7b4b-42be-9e5a-bde3748309c3 tempest-CreateVolumesFromImageTest-1563869356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:10:42 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-a593b1f0-7b4b-42be-9e5a-bde3748309c3 tempest-CreateVolumesFromImageTest-1563869356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:10:42 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-a593b1f0-7b4b-42be-9e5a-bde3748309c3 tempest-CreateVolumesFromImageTest-1563869356 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:10:42 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-a593b1f0-7b4b-42be-9e5a-bde3748309c3 tempest-CreateVolumesFromImageTest-1563869356 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:10:42 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-a593b1f0-7b4b-42be-9e5a-bde3748309c3 tempest-CreateVolumesFromImageTest-1563869356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:10:42 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-a593b1f0-7b4b-42be-9e5a-bde3748309c3 tempest-CreateVolumesFromImageTest-1563869356 None] Selected osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 as target Quobyte volume. {{(pid=82756) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 15:10:42 devstack cinder-volume[82756]: INFO cinder.volume.drivers.remotefs [None req-a593b1f0-7b4b-42be-9e5a-bde3748309c3 tempest-CreateVolumesFromImageTest-1563869356 None] casted to osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 Apr 16 15:10:42 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-a593b1f0-7b4b-42be-9e5a-bde3748309c3 tempest-CreateVolumesFromImageTest-1563869356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-87c116db-e87b-4a56-8663-32444451b93d 1073741824 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:42 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-b95a5d17-173b-44ff-8772-7ae45a13c35d tempest-CreateVolumesFromImageTest-1563869356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ae9dc6f-9050-4a20-ad78-c2e80200f675) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2bb0dd3-5e63-484d-ab54-d607b46f5c29', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:10:42 devstack sudo[88524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-87c116db-e87b-4a56-8663-32444451b93d 1073741824 Apr 16 15:10:42 devstack sudo[88524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:42 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-b95a5d17-173b-44ff-8772-7ae45a13c35d tempest-CreateVolumesFromImageTest-1563869356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eaf24b91-b21c-4f03-a77e-f39e17d21444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:10:42 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-b95a5d17-173b-44ff-8772-7ae45a13c35d tempest-CreateVolumesFromImageTest-1563869356 None] Volume volume-d2bb0dd3-5e63-484d-ab54-d607b46f5c29 (d2bb0dd3-5e63-484d-ab54-d607b46f5c29): created successfully Apr 16 15:10:42 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-b95a5d17-173b-44ff-8772-7ae45a13c35d tempest-CreateVolumesFromImageTest-1563869356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eaf24b91-b21c-4f03-a77e-f39e17d21444) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:10:42 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-b95a5d17-173b-44ff-8772-7ae45a13c35d tempest-CreateVolumesFromImageTest-1563869356 None] Flow 'volume_create_manager' (f342bae4-a318-465b-a20e-bc64b25d0d94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:10:42 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-b95a5d17-173b-44ff-8772-7ae45a13c35d tempest-CreateVolumesFromImageTest-1563869356 None] Created volume successfully. Apr 16 15:10:43 devstack sudo[88524]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:43 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-a593b1f0-7b4b-42be-9e5a-bde3748309c3 tempest-CreateVolumesFromImageTest-1563869356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-87c116db-e87b-4a56-8663-32444451b93d 1073741824" returned: 0 in 0.456s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:43 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-a593b1f0-7b4b-42be-9e5a-bde3748309c3 tempest-CreateVolumesFromImageTest-1563869356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-87c116db-e87b-4a56-8663-32444451b93d {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:43 devstack sudo[88529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-87c116db-e87b-4a56-8663-32444451b93d Apr 16 15:10:43 devstack sudo[88529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:43 devstack sudo[88529]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:43 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-a593b1f0-7b4b-42be-9e5a-bde3748309c3 tempest-CreateVolumesFromImageTest-1563869356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-87c116db-e87b-4a56-8663-32444451b93d" returned: 0 in 0.413s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:43 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-a593b1f0-7b4b-42be-9e5a-bde3748309c3 tempest-CreateVolumesFromImageTest-1563869356 None] <== create_volume: return (892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'} {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 15:10:43 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-a593b1f0-7b4b-42be-9e5a-bde3748309c3 tempest-CreateVolumesFromImageTest-1563869356 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.895s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:10:43 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-e4484921-e016-4d6c-9af2-d1c9412dfdb5 tempest-GroupSnapshotsTest-180858973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.455s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:10:43 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-e4484921-e016-4d6c-9af2-d1c9412dfdb5 tempest-GroupSnapshotsTest-180858973 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=686c729e-8373-4727-b97d-e882e4c2a40e,created_at=2026-04-16T13:10:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1563163064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=686c729e-8373-4727-b97d-e882e4c2a40e,host='devstack@QuobyteHD#QuobyteHD',id=db0e82c0-1155-45e7-9959-3fa545ce081f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe52d01decbe4a18a804934f56346c39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:10:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:10:39Z,use_quota=True,user_id='8c3648f05e984f90b1939e843f0cea32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e43b17f-f2c2-4344-9aa1-b39b585cab2e),volume_type_id=6e43b17f-f2c2-4344-9aa1-b39b585cab2e)}" {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 15:10:43 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-e4484921-e016-4d6c-9af2-d1c9412dfdb5 tempest-GroupSnapshotsTest-180858973 None] Creating volume db0e82c0-1155-45e7-9959-3fa545ce081f {{(pid=82756) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 15:10:43 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-e4484921-e016-4d6c-9af2-d1c9412dfdb5 tempest-GroupSnapshotsTest-180858973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:10:43 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-e4484921-e016-4d6c-9af2-d1c9412dfdb5 tempest-GroupSnapshotsTest-180858973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:10:43 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-e4484921-e016-4d6c-9af2-d1c9412dfdb5 tempest-GroupSnapshotsTest-180858973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:10:43 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-e4484921-e016-4d6c-9af2-d1c9412dfdb5 tempest-GroupSnapshotsTest-180858973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:10:43 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-e4484921-e016-4d6c-9af2-d1c9412dfdb5 tempest-GroupSnapshotsTest-180858973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:10:43 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-e4484921-e016-4d6c-9af2-d1c9412dfdb5 tempest-GroupSnapshotsTest-180858973 None] Selected osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 as target Quobyte volume. {{(pid=82756) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 15:10:43 devstack cinder-volume[82756]: INFO cinder.volume.drivers.remotefs [None req-e4484921-e016-4d6c-9af2-d1c9412dfdb5 tempest-GroupSnapshotsTest-180858973 None] casted to osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 Apr 16 15:10:43 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-e4484921-e016-4d6c-9af2-d1c9412dfdb5 tempest-GroupSnapshotsTest-180858973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-db0e82c0-1155-45e7-9959-3fa545ce081f 1073741824 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:43 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-a593b1f0-7b4b-42be-9e5a-bde3748309c3 tempest-CreateVolumesFromImageTest-1563869356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fff4de4-1198-4dde-be3e-4857cdbb482e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87c116db-e87b-4a56-8663-32444451b93d', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:10:43 devstack sudo[88533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-db0e82c0-1155-45e7-9959-3fa545ce081f 1073741824 Apr 16 15:10:43 devstack sudo[88533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:43 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-a593b1f0-7b4b-42be-9e5a-bde3748309c3 tempest-CreateVolumesFromImageTest-1563869356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f76f1d58-ae21-442f-8f1c-8576323e563f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:10:43 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-a593b1f0-7b4b-42be-9e5a-bde3748309c3 tempest-CreateVolumesFromImageTest-1563869356 None] Volume volume-87c116db-e87b-4a56-8663-32444451b93d (87c116db-e87b-4a56-8663-32444451b93d): created successfully Apr 16 15:10:43 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-a593b1f0-7b4b-42be-9e5a-bde3748309c3 tempest-CreateVolumesFromImageTest-1563869356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f76f1d58-ae21-442f-8f1c-8576323e563f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:10:43 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-a593b1f0-7b4b-42be-9e5a-bde3748309c3 tempest-CreateVolumesFromImageTest-1563869356 None] Flow 'volume_create_manager' (c454df15-4e64-47c5-81cf-b672024981da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:10:43 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-a593b1f0-7b4b-42be-9e5a-bde3748309c3 tempest-CreateVolumesFromImageTest-1563869356 None] Created volume successfully. Apr 16 15:10:44 devstack sudo[88533]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:44 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-e4484921-e016-4d6c-9af2-d1c9412dfdb5 tempest-GroupSnapshotsTest-180858973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-db0e82c0-1155-45e7-9959-3fa545ce081f 1073741824" returned: 0 in 0.452s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:44 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-e4484921-e016-4d6c-9af2-d1c9412dfdb5 tempest-GroupSnapshotsTest-180858973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-db0e82c0-1155-45e7-9959-3fa545ce081f {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:44 devstack sudo[88538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-db0e82c0-1155-45e7-9959-3fa545ce081f Apr 16 15:10:44 devstack sudo[88538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:44 devstack sudo[88538]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:44 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-e4484921-e016-4d6c-9af2-d1c9412dfdb5 tempest-GroupSnapshotsTest-180858973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-db0e82c0-1155-45e7-9959-3fa545ce081f" returned: 0 in 0.426s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:44 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-e4484921-e016-4d6c-9af2-d1c9412dfdb5 tempest-GroupSnapshotsTest-180858973 None] <== create_volume: return (900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'} {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 15:10:44 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-e4484921-e016-4d6c-9af2-d1c9412dfdb5 tempest-GroupSnapshotsTest-180858973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.903s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:10:44 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-ec4aad39-92a7-4426-a97a-81d00bd84891 tempest-VolumesSnapshotListTestJSON-717220033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.549s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:10:44 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-e4484921-e016-4d6c-9af2-d1c9412dfdb5 tempest-GroupSnapshotsTest-180858973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb88efc4-ade4-4b3d-aae7-517ab3d4f7ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db0e82c0-1155-45e7-9959-3fa545ce081f', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:10:44 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-e4484921-e016-4d6c-9af2-d1c9412dfdb5 tempest-GroupSnapshotsTest-180858973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed93ef67-0d8f-44da-a145-f3fd3ec9770f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:10:44 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-ec4aad39-92a7-4426-a97a-81d00bd84891 tempest-VolumesSnapshotListTestJSON-717220033 None] Creating offline snapshot 60dea6fd-0562-4b4e-bca4-26c8783ee5f1 of volume bf134331-c63f-4e30-9b6a-2cf8412d168b {{(pid=82756) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 16 15:10:44 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[22257225-aae2-4617-9f0d-29be562acc38]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:10:44 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-ec4aad39-92a7-4426-a97a-81d00bd84891 tempest-VolumesSnapshotListTestJSON-717220033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-bf134331-c63f-4e30-9b6a-2cf8412d168b.d881e206-e953-4674-954e-1485c9a1ea41 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:44 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-e4484921-e016-4d6c-9af2-d1c9412dfdb5 tempest-GroupSnapshotsTest-180858973 None] Volume volume-db0e82c0-1155-45e7-9959-3fa545ce081f (db0e82c0-1155-45e7-9959-3fa545ce081f): created successfully Apr 16 15:10:44 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-e4484921-e016-4d6c-9af2-d1c9412dfdb5 tempest-GroupSnapshotsTest-180858973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed93ef67-0d8f-44da-a145-f3fd3ec9770f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:10:44 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-e4484921-e016-4d6c-9af2-d1c9412dfdb5 tempest-GroupSnapshotsTest-180858973 None] Flow 'volume_create_manager' (a922e2bc-1d4b-41ee-a23a-e5ad54d4d6aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:10:44 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-e4484921-e016-4d6c-9af2-d1c9412dfdb5 tempest-GroupSnapshotsTest-180858973 None] Created volume successfully. Apr 16 15:10:44 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-5f21b8d0-78b4-43df-add0-1094f3257def tempest-CreateVolumesFromImageTest-1563869356 None] Acquiring lock "cinder-87c116db-e87b-4a56-8663-32444451b93d-delete_volume" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:10:44 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-5f21b8d0-78b4-43df-add0-1094f3257def tempest-CreateVolumesFromImageTest-1563869356 None] Lock "cinder-87c116db-e87b-4a56-8663-32444451b93d-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:10:44 devstack sudo[88541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-bf134331-c63f-4e30-9b6a-2cf8412d168b.d881e206-e953-4674-954e-1485c9a1ea41 Apr 16 15:10:44 devstack sudo[88541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:44 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-5f21b8d0-78b4-43df-add0-1094f3257def tempest-CreateVolumesFromImageTest-1563869356 None] Acquiring lock "cinder-quobyte-87c116db-e87b-4a56-8663-32444451b93d" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:10:44 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-5f21b8d0-78b4-43df-add0-1094f3257def tempest-CreateVolumesFromImageTest-1563869356 None] Lock "cinder-quobyte-87c116db-e87b-4a56-8663-32444451b93d" acquired by "delete_volume" :: waited 0.008s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:10:44 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[43df5257-55b8-4c17-a69e-c285dcca5806]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:10:44 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-5f21b8d0-78b4-43df-add0-1094f3257def tempest-CreateVolumesFromImageTest-1563869356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-87c116db-e87b-4a56-8663-32444451b93d {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:44 devstack sudo[88543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-87c116db-e87b-4a56-8663-32444451b93d Apr 16 15:10:44 devstack sudo[88543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:45 devstack sudo[88541]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:45 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-ec4aad39-92a7-4426-a97a-81d00bd84891 tempest-VolumesSnapshotListTestJSON-717220033 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-bf134331-c63f-4e30-9b6a-2cf8412d168b.d881e206-e953-4674-954e-1485c9a1ea41" returned: 0 in 0.556s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:45 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-ec4aad39-92a7-4426-a97a-81d00bd84891 tempest-VolumesSnapshotListTestJSON-717220033 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf134331-c63f-4e30-9b6a-2cf8412d168b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82756) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 15:10:45 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-ec4aad39-92a7-4426-a97a-81d00bd84891 tempest-VolumesSnapshotListTestJSON-717220033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-bf134331-c63f-4e30-9b6a-2cf8412d168b.d881e206-e953-4674-954e-1485c9a1ea41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-bf134331-c63f-4e30-9b6a-2cf8412d168b.60dea6fd-0562-4b4e-bca4-26c8783ee5f1 1G {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:45 devstack sudo[88551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-bf134331-c63f-4e30-9b6a-2cf8412d168b.d881e206-e953-4674-954e-1485c9a1ea41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-bf134331-c63f-4e30-9b6a-2cf8412d168b.60dea6fd-0562-4b4e-bca4-26c8783ee5f1 1G Apr 16 15:10:45 devstack sudo[88551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:45 devstack sudo[88543]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:45 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-5f21b8d0-78b4-43df-add0-1094f3257def tempest-CreateVolumesFromImageTest-1563869356 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-87c116db-e87b-4a56-8663-32444451b93d" returned: 0 in 0.496s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:45 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-5f21b8d0-78b4-43df-add0-1094f3257def tempest-CreateVolumesFromImageTest-1563869356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-87c116db-e87b-4a56-8663-32444451b93d {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:45 devstack sudo[88553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-87c116db-e87b-4a56-8663-32444451b93d Apr 16 15:10:45 devstack sudo[88553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:45 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-ff8d090e-b991-4fa8-a598-52af68cf8458 tempest-GroupSnapshotsTest-180858973 None] GroupSnapshot 7e88555e-fb51-4aa7-bfe8-d36f41bc63ef: creating. Apr 16 15:10:45 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-ff8d090e-b991-4fa8-a598-52af68cf8458 tempest-GroupSnapshotsTest-180858973 None] Group snapshot 7e88555e-fb51-4aa7-bfe8-d36f41bc63ef: creating. {{(pid=82756) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 16 15:10:45 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-ff8d090e-b991-4fa8-a598-52af68cf8458 tempest-GroupSnapshotsTest-180858973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:10:45 devstack sudo[88551]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:45 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-ec4aad39-92a7-4426-a97a-81d00bd84891 tempest-VolumesSnapshotListTestJSON-717220033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-bf134331-c63f-4e30-9b6a-2cf8412d168b.d881e206-e953-4674-954e-1485c9a1ea41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-bf134331-c63f-4e30-9b6a-2cf8412d168b.60dea6fd-0562-4b4e-bca4-26c8783ee5f1 1G" returned: 0 in 0.542s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:45 devstack sudo[88553]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:45 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-ec4aad39-92a7-4426-a97a-81d00bd84891 tempest-VolumesSnapshotListTestJSON-717220033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf134331-c63f-4e30-9b6a-2cf8412d168b.d881e206-e953-4674-954e-1485c9a1ea41 -F qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-bf134331-c63f-4e30-9b6a-2cf8412d168b.60dea6fd-0562-4b4e-bca4-26c8783ee5f1 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:45 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-5f21b8d0-78b4-43df-add0-1094f3257def tempest-CreateVolumesFromImageTest-1563869356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-87c116db-e87b-4a56-8663-32444451b93d" returned: 0 in 0.485s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:45 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-5f21b8d0-78b4-43df-add0-1094f3257def tempest-CreateVolumesFromImageTest-1563869356 None] Lock "cinder-quobyte-87c116db-e87b-4a56-8663-32444451b93d" released by "delete_volume" :: held 1.003s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:10:45 devstack sudo[88559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf134331-c63f-4e30-9b6a-2cf8412d168b.d881e206-e953-4674-954e-1485c9a1ea41 -F qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-bf134331-c63f-4e30-9b6a-2cf8412d168b.60dea6fd-0562-4b4e-bca4-26c8783ee5f1 Apr 16 15:10:45 devstack sudo[88559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:45 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-5f21b8d0-78b4-43df-add0-1094f3257def tempest-CreateVolumesFromImageTest-1563869356 None] Created reservations ['b017dcfe-1b80-40d3-8c2c-3e23dd01d276', '204ed829-2493-48e2-a451-1b586731edf0', '312ccb3a-c251-4e5e-abdb-135119f0e92b', '639aaac3-6575-4c2a-88b1-5d562f3a5faf'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:10:45 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-5f21b8d0-78b4-43df-add0-1094f3257def tempest-CreateVolumesFromImageTest-1563869356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:10:45 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-5f21b8d0-78b4-43df-add0-1094f3257def tempest-CreateVolumesFromImageTest-1563869356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:10:45 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-5f21b8d0-78b4-43df-add0-1094f3257def tempest-CreateVolumesFromImageTest-1563869356 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:10:45 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-5f21b8d0-78b4-43df-add0-1094f3257def tempest-CreateVolumesFromImageTest-1563869356 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:10:45 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-5f21b8d0-78b4-43df-add0-1094f3257def tempest-CreateVolumesFromImageTest-1563869356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:10:45 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-5f21b8d0-78b4-43df-add0-1094f3257def tempest-CreateVolumesFromImageTest-1563869356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:45 devstack sudo[88561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:10:45 devstack sudo[88561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:46 devstack sudo[88559]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:46 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-ec4aad39-92a7-4426-a97a-81d00bd84891 tempest-VolumesSnapshotListTestJSON-717220033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf134331-c63f-4e30-9b6a-2cf8412d168b.d881e206-e953-4674-954e-1485c9a1ea41 -F qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-bf134331-c63f-4e30-9b6a-2cf8412d168b.60dea6fd-0562-4b4e-bca4-26c8783ee5f1" returned: 0 in 0.478s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:46 devstack cinder-volume[82756]: WARNING cinder.volume.drivers.remotefs [None req-ec4aad39-92a7-4426-a97a-81d00bd84891 tempest-VolumesSnapshotListTestJSON-717220033 None] /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-bf134331-c63f-4e30-9b6a-2cf8412d168b.60dea6fd-0562-4b4e-bca4-26c8783ee5f1 is being set with open permissions: ugo+rw Apr 16 15:10:46 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-ec4aad39-92a7-4426-a97a-81d00bd84891 tempest-VolumesSnapshotListTestJSON-717220033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-bf134331-c63f-4e30-9b6a-2cf8412d168b.60dea6fd-0562-4b4e-bca4-26c8783ee5f1 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:46 devstack sudo[88567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-bf134331-c63f-4e30-9b6a-2cf8412d168b.60dea6fd-0562-4b4e-bca4-26c8783ee5f1 Apr 16 15:10:46 devstack sudo[88567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:46 devstack sudo[88561]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:46 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-5f21b8d0-78b4-43df-add0-1094f3257def tempest-CreateVolumesFromImageTest-1563869356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.414s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:46 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-5f21b8d0-78b4-43df-add0-1094f3257def tempest-CreateVolumesFromImageTest-1563869356 None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:10:46 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-5f21b8d0-78b4-43df-add0-1094f3257def tempest-CreateVolumesFromImageTest-1563869356 None] Deleted volume successfully. Apr 16 15:10:46 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-5f21b8d0-78b4-43df-add0-1094f3257def tempest-CreateVolumesFromImageTest-1563869356 None] Lock "cinder-87c116db-e87b-4a56-8663-32444451b93d-delete_volume" released by "delete_volume" :: held 1.554s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:10:46 devstack sudo[88567]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:46 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-ec4aad39-92a7-4426-a97a-81d00bd84891 tempest-VolumesSnapshotListTestJSON-717220033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-bf134331-c63f-4e30-9b6a-2cf8412d168b.60dea6fd-0562-4b4e-bca4-26c8783ee5f1" returned: 0 in 0.403s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:46 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-ec4aad39-92a7-4426-a97a-81d00bd84891 tempest-VolumesSnapshotListTestJSON-717220033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.042s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:10:46 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-ff8d090e-b991-4fa8-a598-52af68cf8458 tempest-GroupSnapshotsTest-180858973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.930s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:10:46 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-ff8d090e-b991-4fa8-a598-52af68cf8458 tempest-GroupSnapshotsTest-180858973 None] Creating offline snapshot cc089348-2ec9-4377-9975-da68228d8c16 of volume db0e82c0-1155-45e7-9959-3fa545ce081f {{(pid=82756) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 16 15:10:46 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cc33aa9-ef3a-4793-8dca-e682db7087a3]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:10:46 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-ff8d090e-b991-4fa8-a598-52af68cf8458 tempest-GroupSnapshotsTest-180858973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-db0e82c0-1155-45e7-9959-3fa545ce081f {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:46 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-ec4aad39-92a7-4426-a97a-81d00bd84891 tempest-VolumesSnapshotListTestJSON-717220033 None] Create snapshot completed successfully Apr 16 15:10:46 devstack sudo[88570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-db0e82c0-1155-45e7-9959-3fa545ce081f Apr 16 15:10:46 devstack sudo[88570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:46 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-0f622d8e-0653-4d66-86f8-5c3840e978ca tempest-CreateVolumesFromImageTest-1563869356 None] Acquiring lock "cinder-d2bb0dd3-5e63-484d-ab54-d607b46f5c29-delete_volume" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:10:46 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-0f622d8e-0653-4d66-86f8-5c3840e978ca tempest-CreateVolumesFromImageTest-1563869356 None] Lock "cinder-d2bb0dd3-5e63-484d-ab54-d607b46f5c29-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:10:46 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-0f622d8e-0653-4d66-86f8-5c3840e978ca tempest-CreateVolumesFromImageTest-1563869356 None] Acquiring lock "cinder-quobyte-d2bb0dd3-5e63-484d-ab54-d607b46f5c29" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:10:46 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-0f622d8e-0653-4d66-86f8-5c3840e978ca tempest-CreateVolumesFromImageTest-1563869356 None] Lock "cinder-quobyte-d2bb0dd3-5e63-484d-ab54-d607b46f5c29" acquired by "delete_volume" :: waited 0.019s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:10:46 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d47a17b-ff1b-4593-920c-c5b5dc525c03]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:10:46 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-0f622d8e-0653-4d66-86f8-5c3840e978ca tempest-CreateVolumesFromImageTest-1563869356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-d2bb0dd3-5e63-484d-ab54-d607b46f5c29 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:46 devstack sudo[88572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-d2bb0dd3-5e63-484d-ab54-d607b46f5c29 Apr 16 15:10:46 devstack sudo[88572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:47 devstack sudo[88570]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:47 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-ff8d090e-b991-4fa8-a598-52af68cf8458 tempest-GroupSnapshotsTest-180858973 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-db0e82c0-1155-45e7-9959-3fa545ce081f" returned: 0 in 0.539s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:47 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-ff8d090e-b991-4fa8-a598-52af68cf8458 tempest-GroupSnapshotsTest-180858973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-db0e82c0-1155-45e7-9959-3fa545ce081f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-db0e82c0-1155-45e7-9959-3fa545ce081f.cc089348-2ec9-4377-9975-da68228d8c16 1G {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:47 devstack sudo[88577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-db0e82c0-1155-45e7-9959-3fa545ce081f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-db0e82c0-1155-45e7-9959-3fa545ce081f.cc089348-2ec9-4377-9975-da68228d8c16 1G Apr 16 15:10:47 devstack sudo[88577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:47 devstack sudo[88572]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:47 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-0f622d8e-0653-4d66-86f8-5c3840e978ca tempest-CreateVolumesFromImageTest-1563869356 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-d2bb0dd3-5e63-484d-ab54-d607b46f5c29" returned: 0 in 0.499s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:47 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-0f622d8e-0653-4d66-86f8-5c3840e978ca tempest-CreateVolumesFromImageTest-1563869356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-d2bb0dd3-5e63-484d-ab54-d607b46f5c29 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:47 devstack sudo[88582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-d2bb0dd3-5e63-484d-ab54-d607b46f5c29 Apr 16 15:10:47 devstack sudo[88582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:47 devstack sudo[88577]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:47 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-ff8d090e-b991-4fa8-a598-52af68cf8458 tempest-GroupSnapshotsTest-180858973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-db0e82c0-1155-45e7-9959-3fa545ce081f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-db0e82c0-1155-45e7-9959-3fa545ce081f.cc089348-2ec9-4377-9975-da68228d8c16 1G" returned: 0 in 0.504s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:47 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-ff8d090e-b991-4fa8-a598-52af68cf8458 tempest-GroupSnapshotsTest-180858973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db0e82c0-1155-45e7-9959-3fa545ce081f -F qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-db0e82c0-1155-45e7-9959-3fa545ce081f.cc089348-2ec9-4377-9975-da68228d8c16 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:47 devstack sudo[88587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db0e82c0-1155-45e7-9959-3fa545ce081f -F qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-db0e82c0-1155-45e7-9959-3fa545ce081f.cc089348-2ec9-4377-9975-da68228d8c16 Apr 16 15:10:47 devstack sudo[88587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:47 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-b143e6f7-0c4e-45f1-b721-38dbd6105145 tempest-VolumesSnapshotListTestJSON-717220033 None] Acquiring lock "cinder-60dea6fd-0562-4b4e-bca4-26c8783ee5f1-delete_snapshot" by "delete_snapshot" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:10:47 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-b143e6f7-0c4e-45f1-b721-38dbd6105145 tempest-VolumesSnapshotListTestJSON-717220033 None] Lock "cinder-60dea6fd-0562-4b4e-bca4-26c8783ee5f1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:10:47 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-b143e6f7-0c4e-45f1-b721-38dbd6105145 tempest-VolumesSnapshotListTestJSON-717220033 None] Acquiring lock "cinder-quobyte-bf134331-c63f-4e30-9b6a-2cf8412d168b" by "delete_snapshot" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:10:47 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-b143e6f7-0c4e-45f1-b721-38dbd6105145 tempest-VolumesSnapshotListTestJSON-717220033 None] Lock "cinder-quobyte-bf134331-c63f-4e30-9b6a-2cf8412d168b" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:10:47 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-b143e6f7-0c4e-45f1-b721-38dbd6105145 tempest-VolumesSnapshotListTestJSON-717220033 None] Acquiring lock "cinder-quobyte-60dea6fd-0562-4b4e-bca4-26c8783ee5f1" by "_delete_snapshot" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:10:47 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-b143e6f7-0c4e-45f1-b721-38dbd6105145 tempest-VolumesSnapshotListTestJSON-717220033 None] Lock "cinder-quobyte-60dea6fd-0562-4b4e-bca4-26c8783ee5f1" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:10:47 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-b143e6f7-0c4e-45f1-b721-38dbd6105145 tempest-VolumesSnapshotListTestJSON-717220033 None] Deleting offline snapshot 60dea6fd-0562-4b4e-bca4-26c8783ee5f1 of volume bf134331-c63f-4e30-9b6a-2cf8412d168b {{(pid=82756) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 15:10:47 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-b143e6f7-0c4e-45f1-b721-38dbd6105145 tempest-VolumesSnapshotListTestJSON-717220033 None] snapshot_file for this snap is: volume-bf134331-c63f-4e30-9b6a-2cf8412d168b.60dea6fd-0562-4b4e-bca4-26c8783ee5f1 {{(pid=82756) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 15:10:47 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[58a2dd81-1418-4704-8912-87e579f77f04]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:10:47 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-b143e6f7-0c4e-45f1-b721-38dbd6105145 tempest-VolumesSnapshotListTestJSON-717220033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-bf134331-c63f-4e30-9b6a-2cf8412d168b.60dea6fd-0562-4b4e-bca4-26c8783ee5f1 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:47 devstack sudo[88582]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:47 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-0f622d8e-0653-4d66-86f8-5c3840e978ca tempest-CreateVolumesFromImageTest-1563869356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-d2bb0dd3-5e63-484d-ab54-d607b46f5c29" returned: 0 in 0.490s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:47 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-0f622d8e-0653-4d66-86f8-5c3840e978ca tempest-CreateVolumesFromImageTest-1563869356 None] Lock "cinder-quobyte-d2bb0dd3-5e63-484d-ab54-d607b46f5c29" released by "delete_volume" :: held 1.017s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:10:47 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-0f622d8e-0653-4d66-86f8-5c3840e978ca tempest-CreateVolumesFromImageTest-1563869356 None] Created reservations ['621fa4dc-f540-4243-bae7-35087e5fbfb9', 'd549f571-4ff9-4005-bb37-03658461d5ce', '86701c7c-1083-4e51-988c-ab9bf4947dfa', '4999d79e-b677-47fa-a821-458605e1b231'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:10:47 devstack sudo[88590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-bf134331-c63f-4e30-9b6a-2cf8412d168b.60dea6fd-0562-4b4e-bca4-26c8783ee5f1 Apr 16 15:10:47 devstack sudo[88590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:48 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-0f622d8e-0653-4d66-86f8-5c3840e978ca tempest-CreateVolumesFromImageTest-1563869356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:10:48 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-0f622d8e-0653-4d66-86f8-5c3840e978ca tempest-CreateVolumesFromImageTest-1563869356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:10:48 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-0f622d8e-0653-4d66-86f8-5c3840e978ca tempest-CreateVolumesFromImageTest-1563869356 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:10:48 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-0f622d8e-0653-4d66-86f8-5c3840e978ca tempest-CreateVolumesFromImageTest-1563869356 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:10:48 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-0f622d8e-0653-4d66-86f8-5c3840e978ca tempest-CreateVolumesFromImageTest-1563869356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:10:48 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-0f622d8e-0653-4d66-86f8-5c3840e978ca tempest-CreateVolumesFromImageTest-1563869356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:48 devstack sudo[88592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:10:48 devstack sudo[88592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:48 devstack sudo[88587]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:48 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-ff8d090e-b991-4fa8-a598-52af68cf8458 tempest-GroupSnapshotsTest-180858973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db0e82c0-1155-45e7-9959-3fa545ce081f -F qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-db0e82c0-1155-45e7-9959-3fa545ce081f.cc089348-2ec9-4377-9975-da68228d8c16" returned: 0 in 0.464s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:48 devstack cinder-volume[82756]: WARNING cinder.volume.drivers.remotefs [None req-ff8d090e-b991-4fa8-a598-52af68cf8458 tempest-GroupSnapshotsTest-180858973 None] /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-db0e82c0-1155-45e7-9959-3fa545ce081f.cc089348-2ec9-4377-9975-da68228d8c16 is being set with open permissions: ugo+rw: NotImplementedError Apr 16 15:10:48 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-ff8d090e-b991-4fa8-a598-52af68cf8458 tempest-GroupSnapshotsTest-180858973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-db0e82c0-1155-45e7-9959-3fa545ce081f.cc089348-2ec9-4377-9975-da68228d8c16 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:48 devstack sudo[88597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-db0e82c0-1155-45e7-9959-3fa545ce081f.cc089348-2ec9-4377-9975-da68228d8c16 Apr 16 15:10:48 devstack sudo[88597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:48 devstack sudo[88592]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:48 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-0f622d8e-0653-4d66-86f8-5c3840e978ca tempest-CreateVolumesFromImageTest-1563869356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.405s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:48 devstack sudo[88590]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:48 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-0f622d8e-0653-4d66-86f8-5c3840e978ca tempest-CreateVolumesFromImageTest-1563869356 None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:10:48 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-0f622d8e-0653-4d66-86f8-5c3840e978ca tempest-CreateVolumesFromImageTest-1563869356 None] Deleted volume successfully. Apr 16 15:10:48 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-b143e6f7-0c4e-45f1-b721-38dbd6105145 tempest-VolumesSnapshotListTestJSON-717220033 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-bf134331-c63f-4e30-9b6a-2cf8412d168b.60dea6fd-0562-4b4e-bca4-26c8783ee5f1" returned: 0 in 0.539s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:48 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-b143e6f7-0c4e-45f1-b721-38dbd6105145 tempest-VolumesSnapshotListTestJSON-717220033 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf134331-c63f-4e30-9b6a-2cf8412d168b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82756) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 15:10:48 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[68f7980c-a9e6-4572-acdf-b30867a4b5cc]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:10:48 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-b143e6f7-0c4e-45f1-b721-38dbd6105145 tempest-VolumesSnapshotListTestJSON-717220033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-bf134331-c63f-4e30-9b6a-2cf8412d168b.d881e206-e953-4674-954e-1485c9a1ea41 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:48 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-0f622d8e-0653-4d66-86f8-5c3840e978ca tempest-CreateVolumesFromImageTest-1563869356 None] Lock "cinder-d2bb0dd3-5e63-484d-ab54-d607b46f5c29-delete_volume" released by "delete_volume" :: held 1.607s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:10:48 devstack sudo[88603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-bf134331-c63f-4e30-9b6a-2cf8412d168b.d881e206-e953-4674-954e-1485c9a1ea41 Apr 16 15:10:48 devstack sudo[88603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:48 devstack sudo[88597]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:48 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-ff8d090e-b991-4fa8-a598-52af68cf8458 tempest-GroupSnapshotsTest-180858973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-db0e82c0-1155-45e7-9959-3fa545ce081f.cc089348-2ec9-4377-9975-da68228d8c16" returned: 0 in 0.416s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:48 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-ff8d090e-b991-4fa8-a598-52af68cf8458 tempest-GroupSnapshotsTest-180858973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-db0e82c0-1155-45e7-9959-3fa545ce081f.info {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:48 devstack sudo[88606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-db0e82c0-1155-45e7-9959-3fa545ce081f.info Apr 16 15:10:48 devstack sudo[88606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:48 devstack sudo[88603]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:48 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-b143e6f7-0c4e-45f1-b721-38dbd6105145 tempest-VolumesSnapshotListTestJSON-717220033 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-bf134331-c63f-4e30-9b6a-2cf8412d168b.d881e206-e953-4674-954e-1485c9a1ea41" returned: 0 in 0.494s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:48 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-b143e6f7-0c4e-45f1-b721-38dbd6105145 tempest-VolumesSnapshotListTestJSON-717220033 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf134331-c63f-4e30-9b6a-2cf8412d168b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82756) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 15:10:48 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-b143e6f7-0c4e-45f1-b721-38dbd6105145 tempest-VolumesSnapshotListTestJSON-717220033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-bf134331-c63f-4e30-9b6a-2cf8412d168b.60dea6fd-0562-4b4e-bca4-26c8783ee5f1 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:48 devstack sudo[88612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-bf134331-c63f-4e30-9b6a-2cf8412d168b.60dea6fd-0562-4b4e-bca4-26c8783ee5f1 Apr 16 15:10:48 devstack sudo[88612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:49 devstack sudo[88606]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:49 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-ff8d090e-b991-4fa8-a598-52af68cf8458 tempest-GroupSnapshotsTest-180858973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-db0e82c0-1155-45e7-9959-3fa545ce081f.info" returned: 0 in 0.442s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:49 devstack cinder-volume[82756]: WARNING cinder.volume.drivers.remotefs [None req-ff8d090e-b991-4fa8-a598-52af68cf8458 tempest-GroupSnapshotsTest-180858973 None] /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-db0e82c0-1155-45e7-9959-3fa545ce081f.info is being set with open permissions: ugo+rw: NotImplementedError Apr 16 15:10:49 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-ff8d090e-b991-4fa8-a598-52af68cf8458 tempest-GroupSnapshotsTest-180858973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-db0e82c0-1155-45e7-9959-3fa545ce081f.info {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:49 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-743cbff3-5b70-4dbe-9bdc-064c2895bf87 tempest-CreateVolumesFromImageTest-1563869356 None] Acquiring lock "cinder-de976469-0541-4b7b-a081-d0d9dd290c5d-delete_volume" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:10:49 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-743cbff3-5b70-4dbe-9bdc-064c2895bf87 tempest-CreateVolumesFromImageTest-1563869356 None] Lock "cinder-de976469-0541-4b7b-a081-d0d9dd290c5d-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:10:49 devstack sudo[88614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-db0e82c0-1155-45e7-9959-3fa545ce081f.info Apr 16 15:10:49 devstack sudo[88614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:49 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-743cbff3-5b70-4dbe-9bdc-064c2895bf87 tempest-CreateVolumesFromImageTest-1563869356 None] Acquiring lock "cinder-quobyte-de976469-0541-4b7b-a081-d0d9dd290c5d" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:10:49 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-743cbff3-5b70-4dbe-9bdc-064c2895bf87 tempest-CreateVolumesFromImageTest-1563869356 None] Lock "cinder-quobyte-de976469-0541-4b7b-a081-d0d9dd290c5d" acquired by "delete_volume" :: waited 0.007s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:10:49 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[eab22032-aa09-435e-a2b8-2291353f97ac]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:10:49 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-743cbff3-5b70-4dbe-9bdc-064c2895bf87 tempest-CreateVolumesFromImageTest-1563869356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-de976469-0541-4b7b-a081-d0d9dd290c5d {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:49 devstack sudo[88616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-de976469-0541-4b7b-a081-d0d9dd290c5d Apr 16 15:10:49 devstack sudo[88616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:49 devstack sudo[88614]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:49 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-ff8d090e-b991-4fa8-a598-52af68cf8458 tempest-GroupSnapshotsTest-180858973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-db0e82c0-1155-45e7-9959-3fa545ce081f.info" returned: 0 in 0.431s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:49 devstack sudo[88612]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:49 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-ff8d090e-b991-4fa8-a598-52af68cf8458 tempest-GroupSnapshotsTest-180858973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.851s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:10:49 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-b143e6f7-0c4e-45f1-b721-38dbd6105145 tempest-VolumesSnapshotListTestJSON-717220033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-bf134331-c63f-4e30-9b6a-2cf8412d168b.60dea6fd-0562-4b4e-bca4-26c8783ee5f1" returned: 0 in 0.507s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:49 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-b143e6f7-0c4e-45f1-b721-38dbd6105145 tempest-VolumesSnapshotListTestJSON-717220033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-bf134331-c63f-4e30-9b6a-2cf8412d168b.60dea6fd-0562-4b4e-bca4-26c8783ee5f1 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:49 devstack sudo[88622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-bf134331-c63f-4e30-9b6a-2cf8412d168b.60dea6fd-0562-4b4e-bca4-26c8783ee5f1 Apr 16 15:10:49 devstack sudo[88622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:49 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-ff8d090e-b991-4fa8-a598-52af68cf8458 tempest-GroupSnapshotsTest-180858973 None] group_snapshot 7e88555e-fb51-4aa7-bfe8-d36f41bc63ef: created successfully Apr 16 15:10:49 devstack sudo[88616]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:49 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-743cbff3-5b70-4dbe-9bdc-064c2895bf87 tempest-CreateVolumesFromImageTest-1563869356 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-de976469-0541-4b7b-a081-d0d9dd290c5d" returned: 0 in 0.472s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:49 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-743cbff3-5b70-4dbe-9bdc-064c2895bf87 tempest-CreateVolumesFromImageTest-1563869356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-de976469-0541-4b7b-a081-d0d9dd290c5d {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:49 devstack sudo[88627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-de976469-0541-4b7b-a081-d0d9dd290c5d Apr 16 15:10:49 devstack sudo[88627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:49 devstack sudo[88622]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:49 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-b143e6f7-0c4e-45f1-b721-38dbd6105145 tempest-VolumesSnapshotListTestJSON-717220033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-bf134331-c63f-4e30-9b6a-2cf8412d168b.60dea6fd-0562-4b4e-bca4-26c8783ee5f1" returned: 0 in 0.451s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:49 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-b143e6f7-0c4e-45f1-b721-38dbd6105145 tempest-VolumesSnapshotListTestJSON-717220033 None] Lock "cinder-quobyte-60dea6fd-0562-4b4e-bca4-26c8783ee5f1" released by "_delete_snapshot" :: held 2.043s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:10:49 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-b143e6f7-0c4e-45f1-b721-38dbd6105145 tempest-VolumesSnapshotListTestJSON-717220033 None] Lock "cinder-quobyte-bf134331-c63f-4e30-9b6a-2cf8412d168b" released by "delete_snapshot" :: held 2.054s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:10:49 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-b143e6f7-0c4e-45f1-b721-38dbd6105145 tempest-VolumesSnapshotListTestJSON-717220033 None] Created reservations ['6626ec9b-3d1d-45a7-80a0-58545af3d9d9', '30751135-2936-4f70-8a08-35cbf492dcff', '1b4532f1-cb25-4b03-a1f2-bfda21358012', 'cfc70efc-bc5b-486a-a807-4455294af336'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:10:50 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-b143e6f7-0c4e-45f1-b721-38dbd6105145 tempest-VolumesSnapshotListTestJSON-717220033 None] Delete snapshot completed successfully. Apr 16 15:10:50 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-b143e6f7-0c4e-45f1-b721-38dbd6105145 tempest-VolumesSnapshotListTestJSON-717220033 None] Lock "cinder-60dea6fd-0562-4b4e-bca4-26c8783ee5f1-delete_snapshot" released by "delete_snapshot" :: held 2.151s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:10:50 devstack sudo[88627]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:50 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-743cbff3-5b70-4dbe-9bdc-064c2895bf87 tempest-CreateVolumesFromImageTest-1563869356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-de976469-0541-4b7b-a081-d0d9dd290c5d" returned: 0 in 0.457s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:50 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-743cbff3-5b70-4dbe-9bdc-064c2895bf87 tempest-CreateVolumesFromImageTest-1563869356 None] Lock "cinder-quobyte-de976469-0541-4b7b-a081-d0d9dd290c5d" released by "delete_volume" :: held 0.947s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:10:50 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-743cbff3-5b70-4dbe-9bdc-064c2895bf87 tempest-CreateVolumesFromImageTest-1563869356 None] Created reservations ['a649c28c-9ff9-4c8e-a973-b278e33fee41', '691bf83c-4a2d-4e04-ab11-d72bff52f2f5', '3c1e9474-cad0-4cfc-80f6-85fe52b623c5', 'e2141201-3d3a-4278-ab2b-2d0baa74db23'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:10:50 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-743cbff3-5b70-4dbe-9bdc-064c2895bf87 tempest-CreateVolumesFromImageTest-1563869356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:10:50 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-743cbff3-5b70-4dbe-9bdc-064c2895bf87 tempest-CreateVolumesFromImageTest-1563869356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:10:50 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-743cbff3-5b70-4dbe-9bdc-064c2895bf87 tempest-CreateVolumesFromImageTest-1563869356 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:10:50 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-743cbff3-5b70-4dbe-9bdc-064c2895bf87 tempest-CreateVolumesFromImageTest-1563869356 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:10:50 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-743cbff3-5b70-4dbe-9bdc-064c2895bf87 tempest-CreateVolumesFromImageTest-1563869356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:10:50 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-743cbff3-5b70-4dbe-9bdc-064c2895bf87 tempest-CreateVolumesFromImageTest-1563869356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:50 devstack sudo[88631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:10:50 devstack sudo[88631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:50 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-d6f3bfdb-26cb-480b-aa5f-f30cefe4ba7b tempest-CreateVolumesFromImageTest-1563869356 None] Acquiring lock "cinder-526d6142-b04b-47a7-9719-a10fff634bc3-delete_volume" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:10:50 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-d6f3bfdb-26cb-480b-aa5f-f30cefe4ba7b tempest-CreateVolumesFromImageTest-1563869356 None] Lock "cinder-526d6142-b04b-47a7-9719-a10fff634bc3-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:10:50 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-d6f3bfdb-26cb-480b-aa5f-f30cefe4ba7b tempest-CreateVolumesFromImageTest-1563869356 None] Acquiring lock "cinder-quobyte-526d6142-b04b-47a7-9719-a10fff634bc3" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:10:50 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-d6f3bfdb-26cb-480b-aa5f-f30cefe4ba7b tempest-CreateVolumesFromImageTest-1563869356 None] Lock "cinder-quobyte-526d6142-b04b-47a7-9719-a10fff634bc3" acquired by "delete_volume" :: waited 0.006s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:10:50 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[c416cb3b-58e6-46e0-b0a4-5e48b7575583]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:10:50 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-d6f3bfdb-26cb-480b-aa5f-f30cefe4ba7b tempest-CreateVolumesFromImageTest-1563869356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-526d6142-b04b-47a7-9719-a10fff634bc3 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:50 devstack sudo[88633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-526d6142-b04b-47a7-9719-a10fff634bc3 Apr 16 15:10:50 devstack sudo[88633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:50 devstack sudo[88631]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:50 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-743cbff3-5b70-4dbe-9bdc-064c2895bf87 tempest-CreateVolumesFromImageTest-1563869356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.416s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:50 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-743cbff3-5b70-4dbe-9bdc-064c2895bf87 tempest-CreateVolumesFromImageTest-1563869356 None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:10:50 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-743cbff3-5b70-4dbe-9bdc-064c2895bf87 tempest-CreateVolumesFromImageTest-1563869356 None] Deleted volume successfully. Apr 16 15:10:50 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-743cbff3-5b70-4dbe-9bdc-064c2895bf87 tempest-CreateVolumesFromImageTest-1563869356 None] Lock "cinder-de976469-0541-4b7b-a081-d0d9dd290c5d-delete_volume" released by "delete_volume" :: held 1.510s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:10:50 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-57838dd4-6311-46a4-9110-3652fea53347 tempest-GroupSnapshotsTest-180858973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:10:50 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-57838dd4-6311-46a4-9110-3652fea53347 tempest-GroupSnapshotsTest-180858973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:10:50 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-57838dd4-6311-46a4-9110-3652fea53347 tempest-GroupSnapshotsTest-180858973 None] Acquiring lock "cinder-quobyte-cc089348-2ec9-4377-9975-da68228d8c16-a4b3e6d2-fbd9-434f-bffd-3e400b19c024" by "_create_volume_from_snapshot" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:10:50 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-57838dd4-6311-46a4-9110-3652fea53347 tempest-GroupSnapshotsTest-180858973 None] Lock "cinder-quobyte-cc089348-2ec9-4377-9975-da68228d8c16-a4b3e6d2-fbd9-434f-bffd-3e400b19c024" acquired by "_create_volume_from_snapshot" :: waited 0.010s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:10:50 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-57838dd4-6311-46a4-9110-3652fea53347 tempest-GroupSnapshotsTest-180858973 None] Creating volume a4b3e6d2-fbd9-434f-bffd-3e400b19c024 from snapshot cc089348-2ec9-4377-9975-da68228d8c16 {{(pid=82756) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 16 15:10:50 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-57838dd4-6311-46a4-9110-3652fea53347 tempest-GroupSnapshotsTest-180858973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:10:50 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-57838dd4-6311-46a4-9110-3652fea53347 tempest-GroupSnapshotsTest-180858973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:10:50 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-57838dd4-6311-46a4-9110-3652fea53347 tempest-GroupSnapshotsTest-180858973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:10:50 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-57838dd4-6311-46a4-9110-3652fea53347 tempest-GroupSnapshotsTest-180858973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:10:50 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-57838dd4-6311-46a4-9110-3652fea53347 tempest-GroupSnapshotsTest-180858973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:10:50 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-57838dd4-6311-46a4-9110-3652fea53347 tempest-GroupSnapshotsTest-180858973 None] Selected osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 as target Quobyte volume. {{(pid=82756) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 15:10:50 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-57838dd4-6311-46a4-9110-3652fea53347 tempest-GroupSnapshotsTest-180858973 None] Acquiring lock "cinder-quobyte-a4b3e6d2-fbd9-434f-bffd-3e400b19c024" by "_copy_volume_from_snapshot" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:10:50 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-57838dd4-6311-46a4-9110-3652fea53347 tempest-GroupSnapshotsTest-180858973 None] Lock "cinder-quobyte-a4b3e6d2-fbd9-434f-bffd-3e400b19c024" acquired by "_copy_volume_from_snapshot" :: waited 0.006s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:10:50 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-57838dd4-6311-46a4-9110-3652fea53347 tempest-GroupSnapshotsTest-180858973 None] snapshot: cc089348-2ec9-4377-9975-da68228d8c16, volume: a4b3e6d2-fbd9-434f-bffd-3e400b19c024, {{(pid=82756) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 16 15:10:50 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-57838dd4-6311-46a4-9110-3652fea53347 tempest-GroupSnapshotsTest-180858973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:10:50 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-57838dd4-6311-46a4-9110-3652fea53347 tempest-GroupSnapshotsTest-180858973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:10:50 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-57838dd4-6311-46a4-9110-3652fea53347 tempest-GroupSnapshotsTest-180858973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:10:50 devstack sudo[88633]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:50 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-57838dd4-6311-46a4-9110-3652fea53347 tempest-GroupSnapshotsTest-180858973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:10:50 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-57838dd4-6311-46a4-9110-3652fea53347 tempest-GroupSnapshotsTest-180858973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:10:50 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-d6f3bfdb-26cb-480b-aa5f-f30cefe4ba7b tempest-CreateVolumesFromImageTest-1563869356 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-526d6142-b04b-47a7-9719-a10fff634bc3" returned: 0 in 0.503s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:50 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-d6f3bfdb-26cb-480b-aa5f-f30cefe4ba7b tempest-CreateVolumesFromImageTest-1563869356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-526d6142-b04b-47a7-9719-a10fff634bc3 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:50 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[74660207-9f61-413e-a248-4ce95f645ff0]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:10:50 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-57838dd4-6311-46a4-9110-3652fea53347 tempest-GroupSnapshotsTest-180858973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-db0e82c0-1155-45e7-9959-3fa545ce081f.cc089348-2ec9-4377-9975-da68228d8c16 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:50 devstack sudo[88639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-526d6142-b04b-47a7-9719-a10fff634bc3 Apr 16 15:10:50 devstack sudo[88639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:50 devstack sudo[88640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-db0e82c0-1155-45e7-9959-3fa545ce081f.cc089348-2ec9-4377-9975-da68228d8c16 Apr 16 15:10:50 devstack sudo[88640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:50 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-353bcb49-ec38-41e9-8677-755667089ec8 tempest-VolumesSnapshotListTestJSON-717220033 None] Acquiring lock "cinder-d881e206-e953-4674-954e-1485c9a1ea41-delete_snapshot" by "delete_snapshot" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:10:51 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-353bcb49-ec38-41e9-8677-755667089ec8 tempest-VolumesSnapshotListTestJSON-717220033 None] Lock "cinder-d881e206-e953-4674-954e-1485c9a1ea41-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:10:51 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-353bcb49-ec38-41e9-8677-755667089ec8 tempest-VolumesSnapshotListTestJSON-717220033 None] Acquiring lock "cinder-quobyte-bf134331-c63f-4e30-9b6a-2cf8412d168b" by "delete_snapshot" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:10:51 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-353bcb49-ec38-41e9-8677-755667089ec8 tempest-VolumesSnapshotListTestJSON-717220033 None] Lock "cinder-quobyte-bf134331-c63f-4e30-9b6a-2cf8412d168b" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:10:51 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-353bcb49-ec38-41e9-8677-755667089ec8 tempest-VolumesSnapshotListTestJSON-717220033 None] Acquiring lock "cinder-quobyte-d881e206-e953-4674-954e-1485c9a1ea41" by "_delete_snapshot" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:10:51 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-353bcb49-ec38-41e9-8677-755667089ec8 tempest-VolumesSnapshotListTestJSON-717220033 None] Lock "cinder-quobyte-d881e206-e953-4674-954e-1485c9a1ea41" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:10:51 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-353bcb49-ec38-41e9-8677-755667089ec8 tempest-VolumesSnapshotListTestJSON-717220033 None] Deleting offline snapshot d881e206-e953-4674-954e-1485c9a1ea41 of volume bf134331-c63f-4e30-9b6a-2cf8412d168b {{(pid=82756) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 15:10:51 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-353bcb49-ec38-41e9-8677-755667089ec8 tempest-VolumesSnapshotListTestJSON-717220033 None] snapshot_file for this snap is: volume-bf134331-c63f-4e30-9b6a-2cf8412d168b.d881e206-e953-4674-954e-1485c9a1ea41 {{(pid=82756) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 15:10:51 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc38bf09-bbb2-4dbe-b09a-60e3216084f9]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:10:51 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-353bcb49-ec38-41e9-8677-755667089ec8 tempest-VolumesSnapshotListTestJSON-717220033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-bf134331-c63f-4e30-9b6a-2cf8412d168b.d881e206-e953-4674-954e-1485c9a1ea41 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:51 devstack sudo[88643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-bf134331-c63f-4e30-9b6a-2cf8412d168b.d881e206-e953-4674-954e-1485c9a1ea41 Apr 16 15:10:51 devstack sudo[88643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:51 devstack sudo[88639]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:51 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-d6f3bfdb-26cb-480b-aa5f-f30cefe4ba7b tempest-CreateVolumesFromImageTest-1563869356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-526d6142-b04b-47a7-9719-a10fff634bc3" returned: 0 in 0.490s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:51 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-d6f3bfdb-26cb-480b-aa5f-f30cefe4ba7b tempest-CreateVolumesFromImageTest-1563869356 None] Lock "cinder-quobyte-526d6142-b04b-47a7-9719-a10fff634bc3" released by "delete_volume" :: held 1.024s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:10:51 devstack sudo[88640]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:51 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-57838dd4-6311-46a4-9110-3652fea53347 tempest-GroupSnapshotsTest-180858973 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-db0e82c0-1155-45e7-9959-3fa545ce081f.cc089348-2ec9-4377-9975-da68228d8c16" returned: 0 in 0.528s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:51 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-57838dd4-6311-46a4-9110-3652fea53347 tempest-GroupSnapshotsTest-180858973 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-db0e82c0-1155-45e7-9959-3fa545ce081f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82756) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 15:10:51 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-57838dd4-6311-46a4-9110-3652fea53347 tempest-GroupSnapshotsTest-180858973 None] will copy from snapshot at /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-db0e82c0-1155-45e7-9959-3fa545ce081f {{(pid=82756) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 16 15:10:51 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-57838dd4-6311-46a4-9110-3652fea53347 tempest-GroupSnapshotsTest-180858973 None] Creating direct copy from snapshot {{(pid=82756) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 16 15:10:51 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cfb27ab-2f55-4719-9a4f-df773d8e1181]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:10:51 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-57838dd4-6311-46a4-9110-3652fea53347 tempest-GroupSnapshotsTest-180858973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-db0e82c0-1155-45e7-9959-3fa545ce081f {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:51 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-d6f3bfdb-26cb-480b-aa5f-f30cefe4ba7b tempest-CreateVolumesFromImageTest-1563869356 None] Created reservations ['91115a1a-5d51-4912-882f-a2c2dea2c41f', 'c9f3e2bb-e84e-4e34-bec0-efabf7eb62e0', 'd4538881-ab5f-426e-bd1a-099904504fd0', '64ed7c55-bdd8-431d-850c-f06107bf3af4'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:10:51 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-d6f3bfdb-26cb-480b-aa5f-f30cefe4ba7b tempest-CreateVolumesFromImageTest-1563869356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:10:51 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-d6f3bfdb-26cb-480b-aa5f-f30cefe4ba7b tempest-CreateVolumesFromImageTest-1563869356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:10:51 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-d6f3bfdb-26cb-480b-aa5f-f30cefe4ba7b tempest-CreateVolumesFromImageTest-1563869356 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:10:51 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-d6f3bfdb-26cb-480b-aa5f-f30cefe4ba7b tempest-CreateVolumesFromImageTest-1563869356 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:10:51 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-d6f3bfdb-26cb-480b-aa5f-f30cefe4ba7b tempest-CreateVolumesFromImageTest-1563869356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:10:51 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-d6f3bfdb-26cb-480b-aa5f-f30cefe4ba7b tempest-CreateVolumesFromImageTest-1563869356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:51 devstack sudo[88649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-db0e82c0-1155-45e7-9959-3fa545ce081f Apr 16 15:10:51 devstack sudo[88649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:51 devstack sudo[88650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:10:51 devstack sudo[88650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:51 devstack sudo[88643]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:51 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-353bcb49-ec38-41e9-8677-755667089ec8 tempest-VolumesSnapshotListTestJSON-717220033 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-bf134331-c63f-4e30-9b6a-2cf8412d168b.d881e206-e953-4674-954e-1485c9a1ea41" returned: 0 in 0.626s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:51 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-353bcb49-ec38-41e9-8677-755667089ec8 tempest-VolumesSnapshotListTestJSON-717220033 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf134331-c63f-4e30-9b6a-2cf8412d168b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82756) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 15:10:51 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[d188be96-ac0b-4ef1-b604-e8f79d59d3d4]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:10:51 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-353bcb49-ec38-41e9-8677-755667089ec8 tempest-VolumesSnapshotListTestJSON-717220033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-bf134331-c63f-4e30-9b6a-2cf8412d168b.007c9566-2cda-42d5-b7f8-ff2bdde1cd26 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:51 devstack cinder-volume[82756]: DEBUG oslo_service.periodic_task [None req-9570f02d-5ef9-412b-993f-520a9e5bfa81 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82756) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 16 15:10:51 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-9570f02d-5ef9-412b-993f-520a9e5bfa81 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:10:51 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-9570f02d-5ef9-412b-993f-520a9e5bfa81 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:10:51 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-9570f02d-5ef9-412b-993f-520a9e5bfa81 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:10:51 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-9570f02d-5ef9-412b-993f-520a9e5bfa81 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:10:51 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-9570f02d-5ef9-412b-993f-520a9e5bfa81 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:10:51 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-9570f02d-5ef9-412b-993f-520a9e5bfa81 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:51 devstack sudo[88650]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:51 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-d6f3bfdb-26cb-480b-aa5f-f30cefe4ba7b tempest-CreateVolumesFromImageTest-1563869356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.435s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:51 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-d6f3bfdb-26cb-480b-aa5f-f30cefe4ba7b tempest-CreateVolumesFromImageTest-1563869356 None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:10:51 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-d6f3bfdb-26cb-480b-aa5f-f30cefe4ba7b tempest-CreateVolumesFromImageTest-1563869356 None] Deleted volume successfully. Apr 16 15:10:51 devstack sudo[88661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:10:51 devstack sudo[88661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:51 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-d6f3bfdb-26cb-480b-aa5f-f30cefe4ba7b tempest-CreateVolumesFromImageTest-1563869356 None] Lock "cinder-526d6142-b04b-47a7-9719-a10fff634bc3-delete_volume" released by "delete_volume" :: held 1.627s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:10:51 devstack sudo[88659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-bf134331-c63f-4e30-9b6a-2cf8412d168b.007c9566-2cda-42d5-b7f8-ff2bdde1cd26 Apr 16 15:10:51 devstack sudo[88659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:51 devstack sudo[88649]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:51 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-57838dd4-6311-46a4-9110-3652fea53347 tempest-GroupSnapshotsTest-180858973 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-db0e82c0-1155-45e7-9959-3fa545ce081f" returned: 0 in 0.548s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:51 devstack cinder-volume[82756]: DEBUG cinder.utils [None req-57838dd4-6311-46a4-9110-3652fea53347 tempest-GroupSnapshotsTest-180858973 None] Path /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-a4b3e6d2-fbd9-434f-bffd-3e400b19c024 not found in is_blk_device check {{(pid=82756) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 16 15:10:51 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-57838dd4-6311-46a4-9110-3652fea53347 tempest-GroupSnapshotsTest-180858973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-db0e82c0-1155-45e7-9959-3fa545ce081f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-a4b3e6d2-fbd9-434f-bffd-3e400b19c024 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:51 devstack sudo[88664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-db0e82c0-1155-45e7-9959-3fa545ce081f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-a4b3e6d2-fbd9-434f-bffd-3e400b19c024 Apr 16 15:10:51 devstack sudo[88664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:52 devstack sudo[88661]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:52 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-9570f02d-5ef9-412b-993f-520a9e5bfa81 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.472s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:52 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-9570f02d-5ef9-412b-993f-520a9e5bfa81 None None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:10:52 devstack sudo[88659]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:52 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-353bcb49-ec38-41e9-8677-755667089ec8 tempest-VolumesSnapshotListTestJSON-717220033 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-bf134331-c63f-4e30-9b6a-2cf8412d168b.007c9566-2cda-42d5-b7f8-ff2bdde1cd26" returned: 0 in 0.583s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:52 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-353bcb49-ec38-41e9-8677-755667089ec8 tempest-VolumesSnapshotListTestJSON-717220033 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf134331-c63f-4e30-9b6a-2cf8412d168b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82756) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 15:10:52 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-353bcb49-ec38-41e9-8677-755667089ec8 tempest-VolumesSnapshotListTestJSON-717220033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-bf134331-c63f-4e30-9b6a-2cf8412d168b.d881e206-e953-4674-954e-1485c9a1ea41 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:52 devstack sudo[88673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-bf134331-c63f-4e30-9b6a-2cf8412d168b.d881e206-e953-4674-954e-1485c9a1ea41 Apr 16 15:10:52 devstack sudo[88673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:52 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-1d65c7b2-e7a8-4f36-94d8-87e4c4950d89 tempest-CreateVolumesFromImageTest-1563869356 None] Acquiring lock "cinder-237725f9-8ec2-4b05-9d24-19a69b3294cc-delete_volume" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:10:52 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-1d65c7b2-e7a8-4f36-94d8-87e4c4950d89 tempest-CreateVolumesFromImageTest-1563869356 None] Lock "cinder-237725f9-8ec2-4b05-9d24-19a69b3294cc-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:10:52 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-1d65c7b2-e7a8-4f36-94d8-87e4c4950d89 tempest-CreateVolumesFromImageTest-1563869356 None] Acquiring lock "cinder-quobyte-237725f9-8ec2-4b05-9d24-19a69b3294cc" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:10:52 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-1d65c7b2-e7a8-4f36-94d8-87e4c4950d89 tempest-CreateVolumesFromImageTest-1563869356 None] Lock "cinder-quobyte-237725f9-8ec2-4b05-9d24-19a69b3294cc" acquired by "delete_volume" :: waited 0.009s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:10:52 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d145fa9-649d-45c5-95e1-231e6e5b1b37]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:10:52 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-1d65c7b2-e7a8-4f36-94d8-87e4c4950d89 tempest-CreateVolumesFromImageTest-1563869356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-237725f9-8ec2-4b05-9d24-19a69b3294cc {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:52 devstack sudo[88682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-237725f9-8ec2-4b05-9d24-19a69b3294cc Apr 16 15:10:52 devstack sudo[88682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:53 devstack sudo[88673]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:53 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-353bcb49-ec38-41e9-8677-755667089ec8 tempest-VolumesSnapshotListTestJSON-717220033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-bf134331-c63f-4e30-9b6a-2cf8412d168b.d881e206-e953-4674-954e-1485c9a1ea41" returned: 0 in 1.373s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:53 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-353bcb49-ec38-41e9-8677-755667089ec8 tempest-VolumesSnapshotListTestJSON-717220033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-bf134331-c63f-4e30-9b6a-2cf8412d168b.d881e206-e953-4674-954e-1485c9a1ea41 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:53 devstack sudo[88689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-bf134331-c63f-4e30-9b6a-2cf8412d168b.d881e206-e953-4674-954e-1485c9a1ea41 Apr 16 15:10:53 devstack sudo[88689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:54 devstack sudo[88682]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:54 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-1d65c7b2-e7a8-4f36-94d8-87e4c4950d89 tempest-CreateVolumesFromImageTest-1563869356 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-237725f9-8ec2-4b05-9d24-19a69b3294cc" returned: 0 in 1.552s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:54 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-1d65c7b2-e7a8-4f36-94d8-87e4c4950d89 tempest-CreateVolumesFromImageTest-1563869356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-237725f9-8ec2-4b05-9d24-19a69b3294cc {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:54 devstack sudo[88694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-237725f9-8ec2-4b05-9d24-19a69b3294cc Apr 16 15:10:54 devstack sudo[88694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:54 devstack sudo[88664]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:54 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-57838dd4-6311-46a4-9110-3652fea53347 tempest-GroupSnapshotsTest-180858973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-db0e82c0-1155-45e7-9959-3fa545ce081f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-a4b3e6d2-fbd9-434f-bffd-3e400b19c024" returned: 0 in 2.366s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:54 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[81ebe4af-5163-4fcb-a3c0-9408e9a13f7e]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:10:54 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-57838dd4-6311-46a4-9110-3652fea53347 tempest-GroupSnapshotsTest-180858973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-db0e82c0-1155-45e7-9959-3fa545ce081f {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:54 devstack sudo[88696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-db0e82c0-1155-45e7-9959-3fa545ce081f Apr 16 15:10:54 devstack sudo[88696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:54 devstack sudo[88689]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:54 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-353bcb49-ec38-41e9-8677-755667089ec8 tempest-VolumesSnapshotListTestJSON-717220033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-bf134331-c63f-4e30-9b6a-2cf8412d168b.d881e206-e953-4674-954e-1485c9a1ea41" returned: 0 in 0.785s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:54 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-353bcb49-ec38-41e9-8677-755667089ec8 tempest-VolumesSnapshotListTestJSON-717220033 None] Lock "cinder-quobyte-d881e206-e953-4674-954e-1485c9a1ea41" released by "_delete_snapshot" :: held 3.424s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:10:54 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-353bcb49-ec38-41e9-8677-755667089ec8 tempest-VolumesSnapshotListTestJSON-717220033 None] Lock "cinder-quobyte-bf134331-c63f-4e30-9b6a-2cf8412d168b" released by "delete_snapshot" :: held 3.445s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:10:54 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-353bcb49-ec38-41e9-8677-755667089ec8 tempest-VolumesSnapshotListTestJSON-717220033 None] Created reservations ['dbeeacd8-f5a8-4a24-a625-744f029c3d2f', '9970aa1f-d035-4a40-b9a5-5d6d7a0ef6df', 'e21d1d76-c52f-4855-ae09-8911f149ad20', 'ab5da906-3eea-4ac5-b835-0846ddaa26ae'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:10:54 devstack sudo[88694]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:54 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-1d65c7b2-e7a8-4f36-94d8-87e4c4950d89 tempest-CreateVolumesFromImageTest-1563869356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-237725f9-8ec2-4b05-9d24-19a69b3294cc" returned: 0 in 0.432s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:54 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-1d65c7b2-e7a8-4f36-94d8-87e4c4950d89 tempest-CreateVolumesFromImageTest-1563869356 None] Lock "cinder-quobyte-237725f9-8ec2-4b05-9d24-19a69b3294cc" released by "delete_volume" :: held 2.030s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:10:54 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-353bcb49-ec38-41e9-8677-755667089ec8 tempest-VolumesSnapshotListTestJSON-717220033 None] Delete snapshot completed successfully. Apr 16 15:10:54 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-353bcb49-ec38-41e9-8677-755667089ec8 tempest-VolumesSnapshotListTestJSON-717220033 None] Lock "cinder-d881e206-e953-4674-954e-1485c9a1ea41-delete_snapshot" released by "delete_snapshot" :: held 3.577s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:10:54 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-1d65c7b2-e7a8-4f36-94d8-87e4c4950d89 tempest-CreateVolumesFromImageTest-1563869356 None] Created reservations ['baadd1bf-b353-4359-89b4-3a9c1bc69039', 'a324d514-9b13-4488-a2c0-83005b6148dd', '1f61b910-0136-42de-ae1f-5f85f8691a09', '69d45df1-fcf0-4a29-a212-302ac034ac0b'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:10:54 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-1d65c7b2-e7a8-4f36-94d8-87e4c4950d89 tempest-CreateVolumesFromImageTest-1563869356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:10:54 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-1d65c7b2-e7a8-4f36-94d8-87e4c4950d89 tempest-CreateVolumesFromImageTest-1563869356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:10:54 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-1d65c7b2-e7a8-4f36-94d8-87e4c4950d89 tempest-CreateVolumesFromImageTest-1563869356 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:10:54 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-1d65c7b2-e7a8-4f36-94d8-87e4c4950d89 tempest-CreateVolumesFromImageTest-1563869356 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:10:54 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-1d65c7b2-e7a8-4f36-94d8-87e4c4950d89 tempest-CreateVolumesFromImageTest-1563869356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:10:54 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-1d65c7b2-e7a8-4f36-94d8-87e4c4950d89 tempest-CreateVolumesFromImageTest-1563869356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:54 devstack sudo[88702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:10:54 devstack sudo[88702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:54 devstack sudo[88696]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:54 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-57838dd4-6311-46a4-9110-3652fea53347 tempest-GroupSnapshotsTest-180858973 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-db0e82c0-1155-45e7-9959-3fa545ce081f" returned: 0 in 0.644s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:54 devstack cinder-volume[82756]: DEBUG cinder.image.image_utils [None req-57838dd4-6311-46a4-9110-3652fea53347 tempest-GroupSnapshotsTest-180858973 None] Image conversion details: src /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-db0e82c0-1155-45e7-9959-3fa545ce081f, size 1024.00 MB, duration 2.37 sec, destination /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-a4b3e6d2-fbd9-434f-bffd-3e400b19c024 {{(pid=82756) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 15:10:54 devstack cinder-volume[82756]: INFO cinder.image.image_utils [None req-57838dd4-6311-46a4-9110-3652fea53347 tempest-GroupSnapshotsTest-180858973 None] Converted 1024.00 MB image at 432.43 MB/s Apr 16 15:10:54 devstack cinder-volume[82756]: WARNING cinder.volume.drivers.remotefs [None req-57838dd4-6311-46a4-9110-3652fea53347 tempest-GroupSnapshotsTest-180858973 None] /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-a4b3e6d2-fbd9-434f-bffd-3e400b19c024 is being set with open permissions: ugo+rw: NotImplementedError Apr 16 15:10:54 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-57838dd4-6311-46a4-9110-3652fea53347 tempest-GroupSnapshotsTest-180858973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-a4b3e6d2-fbd9-434f-bffd-3e400b19c024 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:54 devstack sudo[88705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-a4b3e6d2-fbd9-434f-bffd-3e400b19c024 Apr 16 15:10:54 devstack sudo[88705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:55 devstack sudo[88702]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:55 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-1d65c7b2-e7a8-4f36-94d8-87e4c4950d89 tempest-CreateVolumesFromImageTest-1563869356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.547s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:55 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-1d65c7b2-e7a8-4f36-94d8-87e4c4950d89 tempest-CreateVolumesFromImageTest-1563869356 None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:10:55 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-1d65c7b2-e7a8-4f36-94d8-87e4c4950d89 tempest-CreateVolumesFromImageTest-1563869356 None] Deleted volume successfully. Apr 16 15:10:55 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-1d65c7b2-e7a8-4f36-94d8-87e4c4950d89 tempest-CreateVolumesFromImageTest-1563869356 None] Lock "cinder-237725f9-8ec2-4b05-9d24-19a69b3294cc-delete_volume" released by "delete_volume" :: held 2.850s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:10:55 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-b564d4cf-49c4-4926-b41a-9d7b78cbcb5d tempest-VolumesSnapshotListTestJSON-717220033 None] Acquiring lock "cinder-007c9566-2cda-42d5-b7f8-ff2bdde1cd26-delete_snapshot" by "delete_snapshot" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:10:55 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-b564d4cf-49c4-4926-b41a-9d7b78cbcb5d tempest-VolumesSnapshotListTestJSON-717220033 None] Lock "cinder-007c9566-2cda-42d5-b7f8-ff2bdde1cd26-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:10:55 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-b564d4cf-49c4-4926-b41a-9d7b78cbcb5d tempest-VolumesSnapshotListTestJSON-717220033 None] Acquiring lock "cinder-quobyte-bf134331-c63f-4e30-9b6a-2cf8412d168b" by "delete_snapshot" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:10:55 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-b564d4cf-49c4-4926-b41a-9d7b78cbcb5d tempest-VolumesSnapshotListTestJSON-717220033 None] Lock "cinder-quobyte-bf134331-c63f-4e30-9b6a-2cf8412d168b" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:10:55 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-b564d4cf-49c4-4926-b41a-9d7b78cbcb5d tempest-VolumesSnapshotListTestJSON-717220033 None] Acquiring lock "cinder-quobyte-007c9566-2cda-42d5-b7f8-ff2bdde1cd26" by "_delete_snapshot" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:10:55 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-b564d4cf-49c4-4926-b41a-9d7b78cbcb5d tempest-VolumesSnapshotListTestJSON-717220033 None] Lock "cinder-quobyte-007c9566-2cda-42d5-b7f8-ff2bdde1cd26" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:10:55 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-b564d4cf-49c4-4926-b41a-9d7b78cbcb5d tempest-VolumesSnapshotListTestJSON-717220033 None] Deleting offline snapshot 007c9566-2cda-42d5-b7f8-ff2bdde1cd26 of volume bf134331-c63f-4e30-9b6a-2cf8412d168b {{(pid=82756) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 15:10:55 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-b564d4cf-49c4-4926-b41a-9d7b78cbcb5d tempest-VolumesSnapshotListTestJSON-717220033 None] snapshot_file for this snap is: volume-bf134331-c63f-4e30-9b6a-2cf8412d168b.007c9566-2cda-42d5-b7f8-ff2bdde1cd26 {{(pid=82756) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 15:10:55 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[11976264-8431-473f-9025-079c9e6080f5]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:10:55 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-b564d4cf-49c4-4926-b41a-9d7b78cbcb5d tempest-VolumesSnapshotListTestJSON-717220033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-bf134331-c63f-4e30-9b6a-2cf8412d168b.007c9566-2cda-42d5-b7f8-ff2bdde1cd26 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:55 devstack sudo[88705]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:55 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-57838dd4-6311-46a4-9110-3652fea53347 tempest-GroupSnapshotsTest-180858973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-a4b3e6d2-fbd9-434f-bffd-3e400b19c024" returned: 0 in 0.491s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:55 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-57838dd4-6311-46a4-9110-3652fea53347 tempest-GroupSnapshotsTest-180858973 None] Lock "cinder-quobyte-a4b3e6d2-fbd9-434f-bffd-3e400b19c024" released by "_copy_volume_from_snapshot" :: held 4.653s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:10:55 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-57838dd4-6311-46a4-9110-3652fea53347 tempest-GroupSnapshotsTest-180858973 None] Lock "cinder-quobyte-cc089348-2ec9-4377-9975-da68228d8c16-a4b3e6d2-fbd9-434f-bffd-3e400b19c024" released by "_create_volume_from_snapshot" :: held 4.670s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:10:55 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-57838dd4-6311-46a4-9110-3652fea53347 tempest-GroupSnapshotsTest-180858973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.681s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:10:55 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-57838dd4-6311-46a4-9110-3652fea53347 tempest-GroupSnapshotsTest-180858973 None] Create group from source-snapshot-7e88555e-fb51-4aa7-bfe8-d36f41bc63ef completed successfully. Apr 16 15:10:55 devstack sudo[88709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-bf134331-c63f-4e30-9b6a-2cf8412d168b.007c9566-2cda-42d5-b7f8-ff2bdde1cd26 Apr 16 15:10:55 devstack sudo[88709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:55 devstack sudo[88709]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:55 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-b564d4cf-49c4-4926-b41a-9d7b78cbcb5d tempest-VolumesSnapshotListTestJSON-717220033 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-bf134331-c63f-4e30-9b6a-2cf8412d168b.007c9566-2cda-42d5-b7f8-ff2bdde1cd26" returned: 0 in 0.519s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:55 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-b564d4cf-49c4-4926-b41a-9d7b78cbcb5d tempest-VolumesSnapshotListTestJSON-717220033 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf134331-c63f-4e30-9b6a-2cf8412d168b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82756) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 15:10:55 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[f362af4c-6362-4e48-9b0a-2b02e8561e15]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:10:55 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-b564d4cf-49c4-4926-b41a-9d7b78cbcb5d tempest-VolumesSnapshotListTestJSON-717220033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-bf134331-c63f-4e30-9b6a-2cf8412d168b {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:55 devstack sudo[88714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-bf134331-c63f-4e30-9b6a-2cf8412d168b Apr 16 15:10:55 devstack sudo[88714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:56 devstack sudo[88714]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:56 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-b564d4cf-49c4-4926-b41a-9d7b78cbcb5d tempest-VolumesSnapshotListTestJSON-717220033 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-bf134331-c63f-4e30-9b6a-2cf8412d168b" returned: 0 in 0.541s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:56 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-b564d4cf-49c4-4926-b41a-9d7b78cbcb5d tempest-VolumesSnapshotListTestJSON-717220033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-bf134331-c63f-4e30-9b6a-2cf8412d168b.007c9566-2cda-42d5-b7f8-ff2bdde1cd26 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:56 devstack sudo[88719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-bf134331-c63f-4e30-9b6a-2cf8412d168b.007c9566-2cda-42d5-b7f8-ff2bdde1cd26 Apr 16 15:10:56 devstack sudo[88719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:56 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-89772238-9e10-4f02-b84c-dcd90d1b2d43 tempest-GroupSnapshotsTest-180858973 None] Acquiring lock "cinder-quobyte-a4b3e6d2-fbd9-434f-bffd-3e400b19c024" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:10:56 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-89772238-9e10-4f02-b84c-dcd90d1b2d43 tempest-GroupSnapshotsTest-180858973 None] Lock "cinder-quobyte-a4b3e6d2-fbd9-434f-bffd-3e400b19c024" acquired by "delete_volume" :: waited 0.013s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:10:56 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[afc7492a-2431-4c78-b3e6-a9f99b89a58a]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:10:56 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-89772238-9e10-4f02-b84c-dcd90d1b2d43 tempest-GroupSnapshotsTest-180858973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-a4b3e6d2-fbd9-434f-bffd-3e400b19c024 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:56 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c0b0407-4a09-41d4-841f-577b890c548c tempest-CinderUnicodeTest-297054767 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82756) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 15:10:56 devstack sudo[88721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-a4b3e6d2-fbd9-434f-bffd-3e400b19c024 Apr 16 15:10:56 devstack sudo[88721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:56 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-8c0b0407-4a09-41d4-841f-577b890c548c tempest-CinderUnicodeTest-297054767 None] Flow 'volume_create_manager' (e7987258-6a6c-4440-b91e-b5f6bf15c5c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:10:56 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-8c0b0407-4a09-41d4-841f-577b890c548c tempest-CinderUnicodeTest-297054767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbeb36d0-d9c7-4bf0-80c1-0823e42810ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:10:56 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-8c0b0407-4a09-41d4-841f-577b890c548c tempest-CinderUnicodeTest-297054767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbeb36d0-d9c7-4bf0-80c1-0823e42810ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:10:56Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8668dbdd-bcb4-4725-87ba-9d9a4b5a3655,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61a2a8d9d71e4814a0e7c192ede37799',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:10:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:10:57Z,use_quota=True,user_id='680c9aa188b6483f83d1ca8cfd7b5f1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:10:56 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-8c0b0407-4a09-41d4-841f-577b890c548c tempest-CinderUnicodeTest-297054767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72805bf9-dc83-41d9-813f-fecbec3257ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:10:56 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-8c0b0407-4a09-41d4-841f-577b890c548c tempest-CinderUnicodeTest-297054767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72805bf9-dc83-41d9-813f-fecbec3257ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:10:56 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-8c0b0407-4a09-41d4-841f-577b890c548c tempest-CinderUnicodeTest-297054767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1a22cb7-ce14-4405-8058-79517b272ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:10:56 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-8c0b0407-4a09-41d4-841f-577b890c548c tempest-CinderUnicodeTest-297054767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1a22cb7-ce14-4405-8058-79517b272ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8668dbdd-bcb4-4725-87ba-9d9a4b5a3655', 'volume_name': 'volume-8668dbdd-bcb4-4725-87ba-9d9a4b5a3655', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:10:56 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-8c0b0407-4a09-41d4-841f-577b890c548c tempest-CinderUnicodeTest-297054767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c42b515-0922-4c4c-8a72-243de77a4949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:10:56 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-8c0b0407-4a09-41d4-841f-577b890c548c tempest-CinderUnicodeTest-297054767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c42b515-0922-4c4c-8a72-243de77a4949) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:10:56 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-8c0b0407-4a09-41d4-841f-577b890c548c tempest-CinderUnicodeTest-297054767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e85a4c0-b63f-4ff1-8f8e-e368f682a2d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:10:56 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-8c0b0407-4a09-41d4-841f-577b890c548c tempest-CinderUnicodeTest-297054767 None] Volume 8668dbdd-bcb4-4725-87ba-9d9a4b5a3655: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8668dbdd-bcb4-4725-87ba-9d9a4b5a3655', 'volume_size': 1} Apr 16 15:10:56 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-8c0b0407-4a09-41d4-841f-577b890c548c tempest-CinderUnicodeTest-297054767 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:10:56 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-8c0b0407-4a09-41d4-841f-577b890c548c tempest-CinderUnicodeTest-297054767 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:10:56 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-8c0b0407-4a09-41d4-841f-577b890c548c tempest-CinderUnicodeTest-297054767 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:10:56Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8668dbdd-bcb4-4725-87ba-9d9a4b5a3655,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61a2a8d9d71e4814a0e7c192ede37799',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:10:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:10:57Z,use_quota=True,user_id='680c9aa188b6483f83d1ca8cfd7b5f1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)}" {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 15:10:56 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-8c0b0407-4a09-41d4-841f-577b890c548c tempest-CinderUnicodeTest-297054767 None] Creating volume 8668dbdd-bcb4-4725-87ba-9d9a4b5a3655 {{(pid=82756) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 15:10:56 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-8c0b0407-4a09-41d4-841f-577b890c548c tempest-CinderUnicodeTest-297054767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:10:56 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-8c0b0407-4a09-41d4-841f-577b890c548c tempest-CinderUnicodeTest-297054767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:10:56 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-8c0b0407-4a09-41d4-841f-577b890c548c tempest-CinderUnicodeTest-297054767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:10:56 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-8c0b0407-4a09-41d4-841f-577b890c548c tempest-CinderUnicodeTest-297054767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:10:56 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-8c0b0407-4a09-41d4-841f-577b890c548c tempest-CinderUnicodeTest-297054767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:10:56 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-8c0b0407-4a09-41d4-841f-577b890c548c tempest-CinderUnicodeTest-297054767 None] Selected osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 as target Quobyte volume. {{(pid=82756) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 15:10:56 devstack cinder-volume[82756]: INFO cinder.volume.drivers.remotefs [None req-8c0b0407-4a09-41d4-841f-577b890c548c tempest-CinderUnicodeTest-297054767 None] casted to osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 Apr 16 15:10:56 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-8c0b0407-4a09-41d4-841f-577b890c548c tempest-CinderUnicodeTest-297054767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-8668dbdd-bcb4-4725-87ba-9d9a4b5a3655 1073741824 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:56 devstack sudo[88723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-8668dbdd-bcb4-4725-87ba-9d9a4b5a3655 1073741824 Apr 16 15:10:56 devstack sudo[88723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:56 devstack sudo[88719]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:56 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-b564d4cf-49c4-4926-b41a-9d7b78cbcb5d tempest-VolumesSnapshotListTestJSON-717220033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-bf134331-c63f-4e30-9b6a-2cf8412d168b.007c9566-2cda-42d5-b7f8-ff2bdde1cd26" returned: 0 in 0.515s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:56 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-b564d4cf-49c4-4926-b41a-9d7b78cbcb5d tempest-VolumesSnapshotListTestJSON-717220033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-bf134331-c63f-4e30-9b6a-2cf8412d168b.007c9566-2cda-42d5-b7f8-ff2bdde1cd26 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:56 devstack sudo[88728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-bf134331-c63f-4e30-9b6a-2cf8412d168b.007c9566-2cda-42d5-b7f8-ff2bdde1cd26 Apr 16 15:10:56 devstack sudo[88728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:57 devstack sudo[88721]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:57 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-89772238-9e10-4f02-b84c-dcd90d1b2d43 tempest-GroupSnapshotsTest-180858973 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-a4b3e6d2-fbd9-434f-bffd-3e400b19c024" returned: 0 in 0.518s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:57 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-89772238-9e10-4f02-b84c-dcd90d1b2d43 tempest-GroupSnapshotsTest-180858973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-a4b3e6d2-fbd9-434f-bffd-3e400b19c024 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:57 devstack sudo[88736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-a4b3e6d2-fbd9-434f-bffd-3e400b19c024 Apr 16 15:10:57 devstack sudo[88736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:57 devstack sudo[88723]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:57 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-8c0b0407-4a09-41d4-841f-577b890c548c tempest-CinderUnicodeTest-297054767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-8668dbdd-bcb4-4725-87ba-9d9a4b5a3655 1073741824" returned: 0 in 0.487s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:57 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-8c0b0407-4a09-41d4-841f-577b890c548c tempest-CinderUnicodeTest-297054767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-8668dbdd-bcb4-4725-87ba-9d9a4b5a3655 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:57 devstack sudo[88738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-8668dbdd-bcb4-4725-87ba-9d9a4b5a3655 Apr 16 15:10:57 devstack sudo[88738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:57 devstack sudo[88728]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:57 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-b564d4cf-49c4-4926-b41a-9d7b78cbcb5d tempest-VolumesSnapshotListTestJSON-717220033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-bf134331-c63f-4e30-9b6a-2cf8412d168b.007c9566-2cda-42d5-b7f8-ff2bdde1cd26" returned: 0 in 0.454s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:57 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-b564d4cf-49c4-4926-b41a-9d7b78cbcb5d tempest-VolumesSnapshotListTestJSON-717220033 None] Lock "cinder-quobyte-007c9566-2cda-42d5-b7f8-ff2bdde1cd26" released by "_delete_snapshot" :: held 2.099s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:10:57 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-b564d4cf-49c4-4926-b41a-9d7b78cbcb5d tempest-VolumesSnapshotListTestJSON-717220033 None] Lock "cinder-quobyte-bf134331-c63f-4e30-9b6a-2cf8412d168b" released by "delete_snapshot" :: held 2.118s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:10:57 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-b564d4cf-49c4-4926-b41a-9d7b78cbcb5d tempest-VolumesSnapshotListTestJSON-717220033 None] Created reservations ['d98f7175-8f02-4ed9-8151-41efcf9fefa9', '360939f3-eff9-4658-83da-b00d50759141', '739f17e2-e74f-4f02-9d87-df00d7354bce', '8df8cf0a-d9ee-40e2-a01b-c1d53e799f01'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:10:57 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-b564d4cf-49c4-4926-b41a-9d7b78cbcb5d tempest-VolumesSnapshotListTestJSON-717220033 None] Delete snapshot completed successfully. Apr 16 15:10:57 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-b564d4cf-49c4-4926-b41a-9d7b78cbcb5d tempest-VolumesSnapshotListTestJSON-717220033 None] Lock "cinder-007c9566-2cda-42d5-b7f8-ff2bdde1cd26-delete_snapshot" released by "delete_snapshot" :: held 2.216s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:10:57 devstack sudo[88736]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:57 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-89772238-9e10-4f02-b84c-dcd90d1b2d43 tempest-GroupSnapshotsTest-180858973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-a4b3e6d2-fbd9-434f-bffd-3e400b19c024" returned: 0 in 0.475s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:57 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-89772238-9e10-4f02-b84c-dcd90d1b2d43 tempest-GroupSnapshotsTest-180858973 None] Lock "cinder-quobyte-a4b3e6d2-fbd9-434f-bffd-3e400b19c024" released by "delete_volume" :: held 1.032s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:10:57 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-89772238-9e10-4f02-b84c-dcd90d1b2d43 tempest-GroupSnapshotsTest-180858973 None] Created reservations ['d18062e4-7710-4345-98ba-1382b7afff05'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:10:57 devstack cinder-volume[82756]: WARNING cinder.quota [None req-89772238-9e10-4f02-b84c-dcd90d1b2d43 tempest-GroupSnapshotsTest-180858973 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-788173307 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-788173307, it is now deprecated. Please use the default quota class for default quota. Apr 16 15:10:57 devstack cinder-volume[82756]: WARNING cinder.quota [None req-89772238-9e10-4f02-b84c-dcd90d1b2d43 tempest-GroupSnapshotsTest-180858973 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-788173307 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-788173307, it is now deprecated. Please use the default quota class for default quota. Apr 16 15:10:57 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-89772238-9e10-4f02-b84c-dcd90d1b2d43 tempest-GroupSnapshotsTest-180858973 None] Created reservations ['87cc1183-5bee-42bb-8f6c-b5a2923f3118', 'da0a75f3-66f5-486a-945a-7f53d84072d7', '2f4651e3-86e0-4d28-a9f7-f43dbae484f0', '9c78e6c4-2eed-450d-a670-39c0d502d920'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:10:57 devstack sudo[88738]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:57 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-8c0b0407-4a09-41d4-841f-577b890c548c tempest-CinderUnicodeTest-297054767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-8668dbdd-bcb4-4725-87ba-9d9a4b5a3655" returned: 0 in 0.483s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:57 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-8c0b0407-4a09-41d4-841f-577b890c548c tempest-CinderUnicodeTest-297054767 None] <== create_volume: return (996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'} {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 15:10:57 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-8c0b0407-4a09-41d4-841f-577b890c548c tempest-CinderUnicodeTest-297054767 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.999s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:10:57 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-8c0b0407-4a09-41d4-841f-577b890c548c tempest-CinderUnicodeTest-297054767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e85a4c0-b63f-4ff1-8f8e-e368f682a2d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8668dbdd-bcb4-4725-87ba-9d9a4b5a3655', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:10:57 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-8c0b0407-4a09-41d4-841f-577b890c548c tempest-CinderUnicodeTest-297054767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d7b42e4-0172-4504-8ace-67da4ab2b84c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:10:57 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-89772238-9e10-4f02-b84c-dcd90d1b2d43 tempest-GroupSnapshotsTest-180858973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:10:57 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-89772238-9e10-4f02-b84c-dcd90d1b2d43 tempest-GroupSnapshotsTest-180858973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:10:57 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-89772238-9e10-4f02-b84c-dcd90d1b2d43 tempest-GroupSnapshotsTest-180858973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:10:57 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-89772238-9e10-4f02-b84c-dcd90d1b2d43 tempest-GroupSnapshotsTest-180858973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:10:57 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-89772238-9e10-4f02-b84c-dcd90d1b2d43 tempest-GroupSnapshotsTest-180858973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:10:57 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-89772238-9e10-4f02-b84c-dcd90d1b2d43 tempest-GroupSnapshotsTest-180858973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:57 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-8c0b0407-4a09-41d4-841f-577b890c548c tempest-CinderUnicodeTest-297054767 None] Volume volume-8668dbdd-bcb4-4725-87ba-9d9a4b5a3655 (8668dbdd-bcb4-4725-87ba-9d9a4b5a3655): created successfully Apr 16 15:10:57 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-8c0b0407-4a09-41d4-841f-577b890c548c tempest-CinderUnicodeTest-297054767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d7b42e4-0172-4504-8ace-67da4ab2b84c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:10:57 devstack sudo[88743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:10:57 devstack sudo[88743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:57 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-8c0b0407-4a09-41d4-841f-577b890c548c tempest-CinderUnicodeTest-297054767 None] Flow 'volume_create_manager' (e7987258-6a6c-4440-b91e-b5f6bf15c5c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:10:57 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-8c0b0407-4a09-41d4-841f-577b890c548c tempest-CinderUnicodeTest-297054767 None] Created volume successfully. Apr 16 15:10:58 devstack sudo[88743]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:58 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-89772238-9e10-4f02-b84c-dcd90d1b2d43 tempest-GroupSnapshotsTest-180858973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.415s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:58 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-89772238-9e10-4f02-b84c-dcd90d1b2d43 tempest-GroupSnapshotsTest-180858973 None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:10:58 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-89772238-9e10-4f02-b84c-dcd90d1b2d43 tempest-GroupSnapshotsTest-180858973 None] Delete group completed successfully. Apr 16 15:10:58 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-bdcbe2c1-08c8-479c-895c-95f5358f2ec9 tempest-VolumesSnapshotListTestJSON-717220033 None] Acquiring lock "cinder-bf134331-c63f-4e30-9b6a-2cf8412d168b-delete_volume" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:10:58 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-bdcbe2c1-08c8-479c-895c-95f5358f2ec9 tempest-VolumesSnapshotListTestJSON-717220033 None] Lock "cinder-bf134331-c63f-4e30-9b6a-2cf8412d168b-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:10:58 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-bdcbe2c1-08c8-479c-895c-95f5358f2ec9 tempest-VolumesSnapshotListTestJSON-717220033 None] Acquiring lock "cinder-quobyte-bf134331-c63f-4e30-9b6a-2cf8412d168b" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:10:58 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-bdcbe2c1-08c8-479c-895c-95f5358f2ec9 tempest-VolumesSnapshotListTestJSON-717220033 None] Lock "cinder-quobyte-bf134331-c63f-4e30-9b6a-2cf8412d168b" acquired by "delete_volume" :: waited 0.007s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:10:58 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[21f652dd-79e2-44c6-b7f2-2e954a30ab22]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:10:58 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-bdcbe2c1-08c8-479c-895c-95f5358f2ec9 tempest-VolumesSnapshotListTestJSON-717220033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-bf134331-c63f-4e30-9b6a-2cf8412d168b {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:58 devstack sudo[88746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-bf134331-c63f-4e30-9b6a-2cf8412d168b Apr 16 15:10:58 devstack sudo[88746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:58 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-cf83e0c4-76ca-4cdd-92ea-f6f2ff47659d tempest-GroupSnapshotsTest-180858973 None] group_snapshot 7e88555e-fb51-4aa7-bfe8-d36f41bc63ef: deleting Apr 16 15:10:58 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-cf83e0c4-76ca-4cdd-92ea-f6f2ff47659d tempest-GroupSnapshotsTest-180858973 None] group_snapshot 7e88555e-fb51-4aa7-bfe8-d36f41bc63ef: deleting {{(pid=82756) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 16 15:10:58 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-cf83e0c4-76ca-4cdd-92ea-f6f2ff47659d tempest-GroupSnapshotsTest-180858973 None] Acquiring lock "cinder-quobyte-db0e82c0-1155-45e7-9959-3fa545ce081f" by "delete_snapshot" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:10:58 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-cf83e0c4-76ca-4cdd-92ea-f6f2ff47659d tempest-GroupSnapshotsTest-180858973 None] Lock "cinder-quobyte-db0e82c0-1155-45e7-9959-3fa545ce081f" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:10:58 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-cf83e0c4-76ca-4cdd-92ea-f6f2ff47659d tempest-GroupSnapshotsTest-180858973 None] Acquiring lock "cinder-quobyte-cc089348-2ec9-4377-9975-da68228d8c16" by "_delete_snapshot" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:10:58 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-cf83e0c4-76ca-4cdd-92ea-f6f2ff47659d tempest-GroupSnapshotsTest-180858973 None] Lock "cinder-quobyte-cc089348-2ec9-4377-9975-da68228d8c16" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:10:58 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-cf83e0c4-76ca-4cdd-92ea-f6f2ff47659d tempest-GroupSnapshotsTest-180858973 None] Deleting offline snapshot cc089348-2ec9-4377-9975-da68228d8c16 of volume db0e82c0-1155-45e7-9959-3fa545ce081f {{(pid=82756) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 15:10:58 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-cf83e0c4-76ca-4cdd-92ea-f6f2ff47659d tempest-GroupSnapshotsTest-180858973 None] snapshot_file for this snap is: volume-db0e82c0-1155-45e7-9959-3fa545ce081f.cc089348-2ec9-4377-9975-da68228d8c16 {{(pid=82756) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 15:10:58 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d9d6c1e-9a2b-4c86-9c3f-5eff57d74957]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:10:58 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-cf83e0c4-76ca-4cdd-92ea-f6f2ff47659d tempest-GroupSnapshotsTest-180858973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-db0e82c0-1155-45e7-9959-3fa545ce081f.cc089348-2ec9-4377-9975-da68228d8c16 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:58 devstack sudo[88748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-db0e82c0-1155-45e7-9959-3fa545ce081f.cc089348-2ec9-4377-9975-da68228d8c16 Apr 16 15:10:58 devstack sudo[88748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:59 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [None req-58b6653e-8e89-4f94-9504-3270334eced4 tempest-CinderUnicodeTest-297054767 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82756) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 15:10:59 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-58b6653e-8e89-4f94-9504-3270334eced4 tempest-CinderUnicodeTest-297054767 None] Flow 'volume_create_manager' (92944c0b-3053-44e0-a3c1-50c40de3bea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:10:59 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-58b6653e-8e89-4f94-9504-3270334eced4 tempest-CinderUnicodeTest-297054767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86c2b399-d56f-4949-aa79-d7896bb17922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:10:59 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-58b6653e-8e89-4f94-9504-3270334eced4 tempest-CinderUnicodeTest-297054767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86c2b399-d56f-4949-aa79-d7896bb17922) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:10:59Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-345033184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40c9be4d-3cb5-4d9c-8f0a-a0d44af0636e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61a2a8d9d71e4814a0e7c192ede37799',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:10:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:10:59Z,use_quota=True,user_id='680c9aa188b6483f83d1ca8cfd7b5f1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:10:59 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-58b6653e-8e89-4f94-9504-3270334eced4 tempest-CinderUnicodeTest-297054767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18728147-ca4a-4391-a6a6-08e1e9b29296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:10:59 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-58b6653e-8e89-4f94-9504-3270334eced4 tempest-CinderUnicodeTest-297054767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18728147-ca4a-4391-a6a6-08e1e9b29296) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:10:59 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-58b6653e-8e89-4f94-9504-3270334eced4 tempest-CinderUnicodeTest-297054767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97925009-97c7-48d7-94b0-548e7f544908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:10:59 devstack sudo[88746]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:59 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-58b6653e-8e89-4f94-9504-3270334eced4 tempest-CinderUnicodeTest-297054767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97925009-97c7-48d7-94b0-548e7f544908) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40c9be4d-3cb5-4d9c-8f0a-a0d44af0636e', 'volume_name': 'volume-40c9be4d-3cb5-4d9c-8f0a-a0d44af0636e', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:10:59 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-58b6653e-8e89-4f94-9504-3270334eced4 tempest-CinderUnicodeTest-297054767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6beca8ed-c988-456e-b673-e356d47c865f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:10:59 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-58b6653e-8e89-4f94-9504-3270334eced4 tempest-CinderUnicodeTest-297054767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6beca8ed-c988-456e-b673-e356d47c865f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:10:59 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-58b6653e-8e89-4f94-9504-3270334eced4 tempest-CinderUnicodeTest-297054767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (574ad62f-c6ca-43fb-bc91-2d32baf0d7b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:10:59 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-58b6653e-8e89-4f94-9504-3270334eced4 tempest-CinderUnicodeTest-297054767 None] Volume 40c9be4d-3cb5-4d9c-8f0a-a0d44af0636e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40c9be4d-3cb5-4d9c-8f0a-a0d44af0636e', 'volume_size': 1} Apr 16 15:10:59 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-58b6653e-8e89-4f94-9504-3270334eced4 tempest-CinderUnicodeTest-297054767 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:10:59 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-58b6653e-8e89-4f94-9504-3270334eced4 tempest-CinderUnicodeTest-297054767 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:10:59 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-58b6653e-8e89-4f94-9504-3270334eced4 tempest-CinderUnicodeTest-297054767 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:10:59Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-345033184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40c9be4d-3cb5-4d9c-8f0a-a0d44af0636e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61a2a8d9d71e4814a0e7c192ede37799',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:10:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:10:59Z,use_quota=True,user_id='680c9aa188b6483f83d1ca8cfd7b5f1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)}" {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 15:10:59 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-58b6653e-8e89-4f94-9504-3270334eced4 tempest-CinderUnicodeTest-297054767 None] Creating volume 40c9be4d-3cb5-4d9c-8f0a-a0d44af0636e {{(pid=82756) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 15:10:59 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-58b6653e-8e89-4f94-9504-3270334eced4 tempest-CinderUnicodeTest-297054767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:10:59 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-58b6653e-8e89-4f94-9504-3270334eced4 tempest-CinderUnicodeTest-297054767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:10:59 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-58b6653e-8e89-4f94-9504-3270334eced4 tempest-CinderUnicodeTest-297054767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:10:59 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-58b6653e-8e89-4f94-9504-3270334eced4 tempest-CinderUnicodeTest-297054767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:10:59 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-58b6653e-8e89-4f94-9504-3270334eced4 tempest-CinderUnicodeTest-297054767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:10:59 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-58b6653e-8e89-4f94-9504-3270334eced4 tempest-CinderUnicodeTest-297054767 None] Selected osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 as target Quobyte volume. {{(pid=82756) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 15:10:59 devstack cinder-volume[82756]: INFO cinder.volume.drivers.remotefs [None req-58b6653e-8e89-4f94-9504-3270334eced4 tempest-CinderUnicodeTest-297054767 None] casted to osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 Apr 16 15:10:59 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-58b6653e-8e89-4f94-9504-3270334eced4 tempest-CinderUnicodeTest-297054767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-40c9be4d-3cb5-4d9c-8f0a-a0d44af0636e 1073741824 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:59 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-bdcbe2c1-08c8-479c-895c-95f5358f2ec9 tempest-VolumesSnapshotListTestJSON-717220033 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-bf134331-c63f-4e30-9b6a-2cf8412d168b" returned: 0 in 0.568s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:59 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-bdcbe2c1-08c8-479c-895c-95f5358f2ec9 tempest-VolumesSnapshotListTestJSON-717220033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-bf134331-c63f-4e30-9b6a-2cf8412d168b {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:59 devstack sudo[88753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-40c9be4d-3cb5-4d9c-8f0a-a0d44af0636e 1073741824 Apr 16 15:10:59 devstack sudo[88753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:59 devstack sudo[88754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-bf134331-c63f-4e30-9b6a-2cf8412d168b Apr 16 15:10:59 devstack sudo[88754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:59 devstack sudo[88748]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:59 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-cf83e0c4-76ca-4cdd-92ea-f6f2ff47659d tempest-GroupSnapshotsTest-180858973 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-db0e82c0-1155-45e7-9959-3fa545ce081f.cc089348-2ec9-4377-9975-da68228d8c16" returned: 0 in 0.527s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:59 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-cf83e0c4-76ca-4cdd-92ea-f6f2ff47659d tempest-GroupSnapshotsTest-180858973 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-db0e82c0-1155-45e7-9959-3fa545ce081f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82756) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 15:10:59 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[8236006e-b4d2-4d9a-9ed8-6c1ef5bbcf42]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:10:59 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-cf83e0c4-76ca-4cdd-92ea-f6f2ff47659d tempest-GroupSnapshotsTest-180858973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-db0e82c0-1155-45e7-9959-3fa545ce081f {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:59 devstack sudo[88762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-db0e82c0-1155-45e7-9959-3fa545ce081f Apr 16 15:10:59 devstack sudo[88762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:59 devstack sudo[88754]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:59 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-bdcbe2c1-08c8-479c-895c-95f5358f2ec9 tempest-VolumesSnapshotListTestJSON-717220033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-bf134331-c63f-4e30-9b6a-2cf8412d168b" returned: 0 in 0.411s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:59 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-bdcbe2c1-08c8-479c-895c-95f5358f2ec9 tempest-VolumesSnapshotListTestJSON-717220033 None] Lock "cinder-quobyte-bf134331-c63f-4e30-9b6a-2cf8412d168b" released by "delete_volume" :: held 1.018s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:10:59 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-bdcbe2c1-08c8-479c-895c-95f5358f2ec9 tempest-VolumesSnapshotListTestJSON-717220033 None] Created reservations ['478c2585-b324-4556-b243-860223e52e9c', 'a0a096da-2296-457e-855c-0fae654cdc2c', '9c82fbc5-627c-4ba3-ae37-08530b7f9a34', 'be27bf0c-a5ee-4240-a9d5-63387d6005c8'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:10:59 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-bdcbe2c1-08c8-479c-895c-95f5358f2ec9 tempest-VolumesSnapshotListTestJSON-717220033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:10:59 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-bdcbe2c1-08c8-479c-895c-95f5358f2ec9 tempest-VolumesSnapshotListTestJSON-717220033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:10:59 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-bdcbe2c1-08c8-479c-895c-95f5358f2ec9 tempest-VolumesSnapshotListTestJSON-717220033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:10:59 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-bdcbe2c1-08c8-479c-895c-95f5358f2ec9 tempest-VolumesSnapshotListTestJSON-717220033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:10:59 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-bdcbe2c1-08c8-479c-895c-95f5358f2ec9 tempest-VolumesSnapshotListTestJSON-717220033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:10:59 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-bdcbe2c1-08c8-479c-895c-95f5358f2ec9 tempest-VolumesSnapshotListTestJSON-717220033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:59 devstack sudo[88753]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:59 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-58b6653e-8e89-4f94-9504-3270334eced4 tempest-CinderUnicodeTest-297054767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-40c9be4d-3cb5-4d9c-8f0a-a0d44af0636e 1073741824" returned: 0 in 0.549s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:59 devstack sudo[88768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:10:59 devstack sudo[88768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:59 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-58b6653e-8e89-4f94-9504-3270334eced4 tempest-CinderUnicodeTest-297054767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-40c9be4d-3cb5-4d9c-8f0a-a0d44af0636e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:59 devstack sudo[88770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-40c9be4d-3cb5-4d9c-8f0a-a0d44af0636e Apr 16 15:10:59 devstack sudo[88770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:10:59 devstack sudo[88762]: pam_unix(sudo:session): session closed for user root Apr 16 15:10:59 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-cf83e0c4-76ca-4cdd-92ea-f6f2ff47659d tempest-GroupSnapshotsTest-180858973 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-db0e82c0-1155-45e7-9959-3fa545ce081f" returned: 0 in 0.489s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:10:59 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-cf83e0c4-76ca-4cdd-92ea-f6f2ff47659d tempest-GroupSnapshotsTest-180858973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-db0e82c0-1155-45e7-9959-3fa545ce081f.cc089348-2ec9-4377-9975-da68228d8c16 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:10:59 devstack sudo[88775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-db0e82c0-1155-45e7-9959-3fa545ce081f.cc089348-2ec9-4377-9975-da68228d8c16 Apr 16 15:10:59 devstack sudo[88775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:00 devstack sudo[88768]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:00 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-bdcbe2c1-08c8-479c-895c-95f5358f2ec9 tempest-VolumesSnapshotListTestJSON-717220033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.467s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:00 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-bdcbe2c1-08c8-479c-895c-95f5358f2ec9 tempest-VolumesSnapshotListTestJSON-717220033 None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:11:00 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-bdcbe2c1-08c8-479c-895c-95f5358f2ec9 tempest-VolumesSnapshotListTestJSON-717220033 None] Deleted volume successfully. Apr 16 15:11:00 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-bdcbe2c1-08c8-479c-895c-95f5358f2ec9 tempest-VolumesSnapshotListTestJSON-717220033 None] Lock "cinder-bf134331-c63f-4e30-9b6a-2cf8412d168b-delete_volume" released by "delete_volume" :: held 1.632s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:11:00 devstack sudo[88770]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:00 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-58b6653e-8e89-4f94-9504-3270334eced4 tempest-CinderUnicodeTest-297054767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-40c9be4d-3cb5-4d9c-8f0a-a0d44af0636e" returned: 0 in 0.469s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:00 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-58b6653e-8e89-4f94-9504-3270334eced4 tempest-CinderUnicodeTest-297054767 None] <== create_volume: return (1053ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'} {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 15:11:00 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-58b6653e-8e89-4f94-9504-3270334eced4 tempest-CinderUnicodeTest-297054767 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.056s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:11:00 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-58b6653e-8e89-4f94-9504-3270334eced4 tempest-CinderUnicodeTest-297054767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (574ad62f-c6ca-43fb-bc91-2d32baf0d7b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40c9be4d-3cb5-4d9c-8f0a-a0d44af0636e', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:11:00 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-58b6653e-8e89-4f94-9504-3270334eced4 tempest-CinderUnicodeTest-297054767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1899d0e8-32af-4842-ad5e-0594ad41d4d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:11:00 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-58b6653e-8e89-4f94-9504-3270334eced4 tempest-CinderUnicodeTest-297054767 None] Volume volume-40c9be4d-3cb5-4d9c-8f0a-a0d44af0636e (40c9be4d-3cb5-4d9c-8f0a-a0d44af0636e): created successfully Apr 16 15:11:00 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-58b6653e-8e89-4f94-9504-3270334eced4 tempest-CinderUnicodeTest-297054767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1899d0e8-32af-4842-ad5e-0594ad41d4d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:11:00 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-58b6653e-8e89-4f94-9504-3270334eced4 tempest-CinderUnicodeTest-297054767 None] Flow 'volume_create_manager' (92944c0b-3053-44e0-a3c1-50c40de3bea3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:11:00 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-58b6653e-8e89-4f94-9504-3270334eced4 tempest-CinderUnicodeTest-297054767 None] Created volume successfully. Apr 16 15:11:00 devstack sudo[88775]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:00 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-cf83e0c4-76ca-4cdd-92ea-f6f2ff47659d tempest-GroupSnapshotsTest-180858973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-db0e82c0-1155-45e7-9959-3fa545ce081f.cc089348-2ec9-4377-9975-da68228d8c16" returned: 0 in 0.487s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:00 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-cf83e0c4-76ca-4cdd-92ea-f6f2ff47659d tempest-GroupSnapshotsTest-180858973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-db0e82c0-1155-45e7-9959-3fa545ce081f.cc089348-2ec9-4377-9975-da68228d8c16 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:00 devstack sudo[88782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-db0e82c0-1155-45e7-9959-3fa545ce081f.cc089348-2ec9-4377-9975-da68228d8c16 Apr 16 15:11:00 devstack sudo[88782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:00 devstack sudo[88782]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:00 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-cf83e0c4-76ca-4cdd-92ea-f6f2ff47659d tempest-GroupSnapshotsTest-180858973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-db0e82c0-1155-45e7-9959-3fa545ce081f.cc089348-2ec9-4377-9975-da68228d8c16" returned: 0 in 0.446s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:00 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-cf83e0c4-76ca-4cdd-92ea-f6f2ff47659d tempest-GroupSnapshotsTest-180858973 None] Lock "cinder-quobyte-cc089348-2ec9-4377-9975-da68228d8c16" released by "_delete_snapshot" :: held 2.005s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:11:00 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-cf83e0c4-76ca-4cdd-92ea-f6f2ff47659d tempest-GroupSnapshotsTest-180858973 None] Lock "cinder-quobyte-db0e82c0-1155-45e7-9959-3fa545ce081f" released by "delete_snapshot" :: held 2.017s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:11:00 devstack cinder-volume[82756]: WARNING cinder.quota [None req-cf83e0c4-76ca-4cdd-92ea-f6f2ff47659d tempest-GroupSnapshotsTest-180858973 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-788173307 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-788173307, it is now deprecated. Please use the default quota class for default quota. Apr 16 15:11:00 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-cf83e0c4-76ca-4cdd-92ea-f6f2ff47659d tempest-GroupSnapshotsTest-180858973 None] Created reservations ['3a3e0b65-f400-4a86-8b7c-edc378c058dc', 'c233a812-386a-4732-b16c-7e41381054fb', '7d02a71f-edd2-45f1-a80c-828687424e00', '7f2eaf47-201b-4038-ae69-30424316aa04'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:11:00 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-cf83e0c4-76ca-4cdd-92ea-f6f2ff47659d tempest-GroupSnapshotsTest-180858973 None] group_snapshot 7e88555e-fb51-4aa7-bfe8-d36f41bc63ef: deleted successfully Apr 16 15:11:01 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-2eb2b465-dac9-4663-bf65-ae1fd08a8dfb tempest-GroupSnapshotsTest-180858973 None] Acquiring lock "cinder-quobyte-db0e82c0-1155-45e7-9959-3fa545ce081f" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:11:01 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-2eb2b465-dac9-4663-bf65-ae1fd08a8dfb tempest-GroupSnapshotsTest-180858973 None] Lock "cinder-quobyte-db0e82c0-1155-45e7-9959-3fa545ce081f" acquired by "delete_volume" :: waited 0.008s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:11:01 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[2af3c589-5999-4013-a658-e5f8f463d068]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:11:01 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-2eb2b465-dac9-4663-bf65-ae1fd08a8dfb tempest-GroupSnapshotsTest-180858973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-db0e82c0-1155-45e7-9959-3fa545ce081f {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:01 devstack sudo[88785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-db0e82c0-1155-45e7-9959-3fa545ce081f Apr 16 15:11:01 devstack sudo[88785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:01 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-afa2bd38-9bb5-44fd-ab2a-0fff04e7d5b6 tempest-CinderUnicodeTest-297054767 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:11:01 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-afa2bd38-9bb5-44fd-ab2a-0fff04e7d5b6 tempest-CinderUnicodeTest-297054767 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:11:01 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-afa2bd38-9bb5-44fd-ab2a-0fff04e7d5b6 tempest-CinderUnicodeTest-297054767 None] Creating offline snapshot d5f21196-3094-49f6-8702-0e827cb34220 of volume 40c9be4d-3cb5-4d9c-8f0a-a0d44af0636e {{(pid=82756) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 16 15:11:01 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[a294db44-076a-4165-a298-f655910d7467]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:11:01 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-afa2bd38-9bb5-44fd-ab2a-0fff04e7d5b6 tempest-CinderUnicodeTest-297054767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-40c9be4d-3cb5-4d9c-8f0a-a0d44af0636e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:01 devstack sudo[88822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-40c9be4d-3cb5-4d9c-8f0a-a0d44af0636e Apr 16 15:11:01 devstack sudo[88822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:01 devstack sudo[88785]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:01 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-2eb2b465-dac9-4663-bf65-ae1fd08a8dfb tempest-GroupSnapshotsTest-180858973 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-db0e82c0-1155-45e7-9959-3fa545ce081f" returned: 0 in 0.635s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:01 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-2eb2b465-dac9-4663-bf65-ae1fd08a8dfb tempest-GroupSnapshotsTest-180858973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-db0e82c0-1155-45e7-9959-3fa545ce081f {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:01 devstack sudo[88832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-db0e82c0-1155-45e7-9959-3fa545ce081f Apr 16 15:11:01 devstack sudo[88832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:02 devstack sudo[88822]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:02 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-afa2bd38-9bb5-44fd-ab2a-0fff04e7d5b6 tempest-CinderUnicodeTest-297054767 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-40c9be4d-3cb5-4d9c-8f0a-a0d44af0636e" returned: 0 in 0.618s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:02 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-afa2bd38-9bb5-44fd-ab2a-0fff04e7d5b6 tempest-CinderUnicodeTest-297054767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-40c9be4d-3cb5-4d9c-8f0a-a0d44af0636e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-40c9be4d-3cb5-4d9c-8f0a-a0d44af0636e.d5f21196-3094-49f6-8702-0e827cb34220 1G {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:02 devstack sudo[88837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-40c9be4d-3cb5-4d9c-8f0a-a0d44af0636e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-40c9be4d-3cb5-4d9c-8f0a-a0d44af0636e.d5f21196-3094-49f6-8702-0e827cb34220 1G Apr 16 15:11:02 devstack sudo[88837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:02 devstack sudo[88832]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:02 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-2eb2b465-dac9-4663-bf65-ae1fd08a8dfb tempest-GroupSnapshotsTest-180858973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-db0e82c0-1155-45e7-9959-3fa545ce081f" returned: 0 in 0.502s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:02 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-2eb2b465-dac9-4663-bf65-ae1fd08a8dfb tempest-GroupSnapshotsTest-180858973 None] Lock "cinder-quobyte-db0e82c0-1155-45e7-9959-3fa545ce081f" released by "delete_volume" :: held 1.175s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:11:02 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-2eb2b465-dac9-4663-bf65-ae1fd08a8dfb tempest-GroupSnapshotsTest-180858973 None] Created reservations ['674c98d8-c99d-4e91-b78d-b6be852e4cc0'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:11:02 devstack cinder-volume[82756]: WARNING cinder.db.sqlalchemy.api [None req-2eb2b465-dac9-4663-bf65-ae1fd08a8dfb tempest-GroupSnapshotsTest-180858973 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-788173307'] Apr 16 15:11:02 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-2eb2b465-dac9-4663-bf65-ae1fd08a8dfb tempest-GroupSnapshotsTest-180858973 None] Created reservations ['f54b1409-9a81-4cda-ac1f-ce9571674238', '17b37e66-8645-4579-9669-199dc4595fcc', 'a11dce51-0b14-404d-9087-076dbbfb8617', 'ad82b965-a9f1-4c3d-8f16-8d9e419d5528'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:11:02 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-2eb2b465-dac9-4663-bf65-ae1fd08a8dfb tempest-GroupSnapshotsTest-180858973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:11:02 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-2eb2b465-dac9-4663-bf65-ae1fd08a8dfb tempest-GroupSnapshotsTest-180858973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:11:02 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-2eb2b465-dac9-4663-bf65-ae1fd08a8dfb tempest-GroupSnapshotsTest-180858973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:11:02 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-2eb2b465-dac9-4663-bf65-ae1fd08a8dfb tempest-GroupSnapshotsTest-180858973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:11:02 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-2eb2b465-dac9-4663-bf65-ae1fd08a8dfb tempest-GroupSnapshotsTest-180858973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:11:02 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-2eb2b465-dac9-4663-bf65-ae1fd08a8dfb tempest-GroupSnapshotsTest-180858973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:02 devstack sudo[88842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:11:02 devstack sudo[88842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:02 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [None req-60888370-409e-4f3f-b2c3-063a1d971f65 tempest-CreateVolumesFromSnapshotTest-324767205 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82756) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 15:11:02 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-60888370-409e-4f3f-b2c3-063a1d971f65 tempest-CreateVolumesFromSnapshotTest-324767205 None] Flow 'volume_create_manager' (8f36dc72-63d8-4e4b-8cad-f6c2344f5049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:11:02 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-60888370-409e-4f3f-b2c3-063a1d971f65 tempest-CreateVolumesFromSnapshotTest-324767205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89d06335-52ff-4f39-9e05-79d93d6daba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:11:02 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-60888370-409e-4f3f-b2c3-063a1d971f65 tempest-CreateVolumesFromSnapshotTest-324767205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89d06335-52ff-4f39-9e05-79d93d6daba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:11:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1791055355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9507fe66-6de6-40f6-98e7-0177919afd91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='564d54bad3b94a7c8d1015cb4cf057f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:11:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:11:02Z,use_quota=True,user_id='ac1176cc820a478ca417e47931613417',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:11:02 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-60888370-409e-4f3f-b2c3-063a1d971f65 tempest-CreateVolumesFromSnapshotTest-324767205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aff0ee91-7ab8-4a68-a4be-b92b372caa11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:11:02 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-60888370-409e-4f3f-b2c3-063a1d971f65 tempest-CreateVolumesFromSnapshotTest-324767205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aff0ee91-7ab8-4a68-a4be-b92b372caa11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:11:02 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-60888370-409e-4f3f-b2c3-063a1d971f65 tempest-CreateVolumesFromSnapshotTest-324767205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50527d45-bad5-4f57-b0db-02d24f00bea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:11:02 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-60888370-409e-4f3f-b2c3-063a1d971f65 tempest-CreateVolumesFromSnapshotTest-324767205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50527d45-bad5-4f57-b0db-02d24f00bea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9507fe66-6de6-40f6-98e7-0177919afd91', 'volume_name': 'volume-9507fe66-6de6-40f6-98e7-0177919afd91', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:11:02 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-60888370-409e-4f3f-b2c3-063a1d971f65 tempest-CreateVolumesFromSnapshotTest-324767205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (991e0f18-61e8-4468-a3a9-94e31007f127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:11:02 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-60888370-409e-4f3f-b2c3-063a1d971f65 tempest-CreateVolumesFromSnapshotTest-324767205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (991e0f18-61e8-4468-a3a9-94e31007f127) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:11:02 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-60888370-409e-4f3f-b2c3-063a1d971f65 tempest-CreateVolumesFromSnapshotTest-324767205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9025cc2f-0dc5-4c40-b35b-0390fdf849a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:11:02 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-60888370-409e-4f3f-b2c3-063a1d971f65 tempest-CreateVolumesFromSnapshotTest-324767205 None] Volume 9507fe66-6de6-40f6-98e7-0177919afd91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9507fe66-6de6-40f6-98e7-0177919afd91', 'volume_size': 1} Apr 16 15:11:02 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-60888370-409e-4f3f-b2c3-063a1d971f65 tempest-CreateVolumesFromSnapshotTest-324767205 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:11:02 devstack sudo[88837]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:02 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-afa2bd38-9bb5-44fd-ab2a-0fff04e7d5b6 tempest-CinderUnicodeTest-297054767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-40c9be4d-3cb5-4d9c-8f0a-a0d44af0636e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-40c9be4d-3cb5-4d9c-8f0a-a0d44af0636e.d5f21196-3094-49f6-8702-0e827cb34220 1G" returned: 0 in 0.574s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:02 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-afa2bd38-9bb5-44fd-ab2a-0fff04e7d5b6 tempest-CinderUnicodeTest-297054767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40c9be4d-3cb5-4d9c-8f0a-a0d44af0636e -F qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-40c9be4d-3cb5-4d9c-8f0a-a0d44af0636e.d5f21196-3094-49f6-8702-0e827cb34220 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:02 devstack sudo[88845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40c9be4d-3cb5-4d9c-8f0a-a0d44af0636e -F qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-40c9be4d-3cb5-4d9c-8f0a-a0d44af0636e.d5f21196-3094-49f6-8702-0e827cb34220 Apr 16 15:11:02 devstack sudo[88845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:02 devstack sudo[88842]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:02 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-2eb2b465-dac9-4663-bf65-ae1fd08a8dfb tempest-GroupSnapshotsTest-180858973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.406s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:02 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-2eb2b465-dac9-4663-bf65-ae1fd08a8dfb tempest-GroupSnapshotsTest-180858973 None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:11:02 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-2eb2b465-dac9-4663-bf65-ae1fd08a8dfb tempest-GroupSnapshotsTest-180858973 None] Delete group completed successfully. Apr 16 15:11:03 devstack sudo[88845]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:03 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-afa2bd38-9bb5-44fd-ab2a-0fff04e7d5b6 tempest-CinderUnicodeTest-297054767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40c9be4d-3cb5-4d9c-8f0a-a0d44af0636e -F qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-40c9be4d-3cb5-4d9c-8f0a-a0d44af0636e.d5f21196-3094-49f6-8702-0e827cb34220" returned: 0 in 0.521s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:03 devstack cinder-volume[82756]: WARNING cinder.volume.drivers.remotefs [None req-afa2bd38-9bb5-44fd-ab2a-0fff04e7d5b6 tempest-CinderUnicodeTest-297054767 None] /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-40c9be4d-3cb5-4d9c-8f0a-a0d44af0636e.d5f21196-3094-49f6-8702-0e827cb34220 is being set with open permissions: ugo+rw Apr 16 15:11:03 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-afa2bd38-9bb5-44fd-ab2a-0fff04e7d5b6 tempest-CinderUnicodeTest-297054767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-40c9be4d-3cb5-4d9c-8f0a-a0d44af0636e.d5f21196-3094-49f6-8702-0e827cb34220 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:03 devstack sudo[88851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-40c9be4d-3cb5-4d9c-8f0a-a0d44af0636e.d5f21196-3094-49f6-8702-0e827cb34220 Apr 16 15:11:03 devstack sudo[88851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:03 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-f8e94566-0a02-4036-9229-a0fe988ef7db tempest-GroupSnapshotsTest-180858973 None] Group tempest-GroupSnapshotsTest-Group-1429345221: creating Apr 16 15:11:03 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-f8e94566-0a02-4036-9229-a0fe988ef7db tempest-GroupSnapshotsTest-180858973 None] Group tempest-GroupSnapshotsTest-Group-1429345221: created successfully Apr 16 15:11:03 devstack sudo[88851]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:03 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-f8e94566-0a02-4036-9229-a0fe988ef7db tempest-GroupSnapshotsTest-180858973 None] Create group completed successfully. Apr 16 15:11:03 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-afa2bd38-9bb5-44fd-ab2a-0fff04e7d5b6 tempest-CinderUnicodeTest-297054767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-40c9be4d-3cb5-4d9c-8f0a-a0d44af0636e.d5f21196-3094-49f6-8702-0e827cb34220" returned: 0 in 0.442s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:03 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-afa2bd38-9bb5-44fd-ab2a-0fff04e7d5b6 tempest-CinderUnicodeTest-297054767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-40c9be4d-3cb5-4d9c-8f0a-a0d44af0636e.info {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:03 devstack sudo[88855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-40c9be4d-3cb5-4d9c-8f0a-a0d44af0636e.info Apr 16 15:11:03 devstack sudo[88855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:04 devstack sudo[88855]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:04 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-afa2bd38-9bb5-44fd-ab2a-0fff04e7d5b6 tempest-CinderUnicodeTest-297054767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-40c9be4d-3cb5-4d9c-8f0a-a0d44af0636e.info" returned: 0 in 0.424s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:04 devstack cinder-volume[82756]: WARNING cinder.volume.drivers.remotefs [None req-afa2bd38-9bb5-44fd-ab2a-0fff04e7d5b6 tempest-CinderUnicodeTest-297054767 None] /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-40c9be4d-3cb5-4d9c-8f0a-a0d44af0636e.info is being set with open permissions: ugo+rw Apr 16 15:11:04 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-afa2bd38-9bb5-44fd-ab2a-0fff04e7d5b6 tempest-CinderUnicodeTest-297054767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-40c9be4d-3cb5-4d9c-8f0a-a0d44af0636e.info {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:04 devstack sudo[88858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-40c9be4d-3cb5-4d9c-8f0a-a0d44af0636e.info Apr 16 15:11:04 devstack sudo[88858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:04 devstack sudo[88858]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:04 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-afa2bd38-9bb5-44fd-ab2a-0fff04e7d5b6 tempest-CinderUnicodeTest-297054767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-40c9be4d-3cb5-4d9c-8f0a-a0d44af0636e.info" returned: 0 in 0.453s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:04 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-afa2bd38-9bb5-44fd-ab2a-0fff04e7d5b6 tempest-CinderUnicodeTest-297054767 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.099s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:11:04 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-60888370-409e-4f3f-b2c3-063a1d971f65 tempest-CreateVolumesFromSnapshotTest-324767205 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.888s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:11:04 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-60888370-409e-4f3f-b2c3-063a1d971f65 tempest-CreateVolumesFromSnapshotTest-324767205 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:11:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1791055355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9507fe66-6de6-40f6-98e7-0177919afd91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='564d54bad3b94a7c8d1015cb4cf057f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:11:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:11:02Z,use_quota=True,user_id='ac1176cc820a478ca417e47931613417',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)}" {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 15:11:04 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-60888370-409e-4f3f-b2c3-063a1d971f65 tempest-CreateVolumesFromSnapshotTest-324767205 None] Creating volume 9507fe66-6de6-40f6-98e7-0177919afd91 {{(pid=82756) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 15:11:04 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-60888370-409e-4f3f-b2c3-063a1d971f65 tempest-CreateVolumesFromSnapshotTest-324767205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:11:04 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-60888370-409e-4f3f-b2c3-063a1d971f65 tempest-CreateVolumesFromSnapshotTest-324767205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:11:04 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-60888370-409e-4f3f-b2c3-063a1d971f65 tempest-CreateVolumesFromSnapshotTest-324767205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:11:04 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-60888370-409e-4f3f-b2c3-063a1d971f65 tempest-CreateVolumesFromSnapshotTest-324767205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:11:04 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-60888370-409e-4f3f-b2c3-063a1d971f65 tempest-CreateVolumesFromSnapshotTest-324767205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:11:04 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-60888370-409e-4f3f-b2c3-063a1d971f65 tempest-CreateVolumesFromSnapshotTest-324767205 None] Selected osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 as target Quobyte volume. {{(pid=82756) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 15:11:04 devstack cinder-volume[82756]: INFO cinder.volume.drivers.remotefs [None req-60888370-409e-4f3f-b2c3-063a1d971f65 tempest-CreateVolumesFromSnapshotTest-324767205 None] casted to osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 Apr 16 15:11:04 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-60888370-409e-4f3f-b2c3-063a1d971f65 tempest-CreateVolumesFromSnapshotTest-324767205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-9507fe66-6de6-40f6-98e7-0177919afd91 1073741824 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:04 devstack sudo[88861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-9507fe66-6de6-40f6-98e7-0177919afd91 1073741824 Apr 16 15:11:04 devstack sudo[88861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:04 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-afa2bd38-9bb5-44fd-ab2a-0fff04e7d5b6 tempest-CinderUnicodeTest-297054767 None] Create snapshot completed successfully Apr 16 15:11:04 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c3720c0-7f2f-4658-9207-38d8eafb9c10 tempest-GroupSnapshotsTest-180858973 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82756) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 15:11:04 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-6c3720c0-7f2f-4658-9207-38d8eafb9c10 tempest-GroupSnapshotsTest-180858973 None] Flow 'volume_create_manager' (362f9478-71ae-424c-a4f7-bbac44585758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:11:04 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-6c3720c0-7f2f-4658-9207-38d8eafb9c10 tempest-GroupSnapshotsTest-180858973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74db153b-9717-4a99-aaa4-dd765202d0e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:11:04 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-6c3720c0-7f2f-4658-9207-38d8eafb9c10 tempest-GroupSnapshotsTest-180858973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74db153b-9717-4a99-aaa4-dd765202d0e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:11:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1671182765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a171cb0b-d8fd-433d-a506-de0fd4eb6435,host='devstack@QuobyteHD#QuobyteHD',id=6fec6821-164d-4d5f-9c74-5cb15a972243,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe52d01decbe4a18a804934f56346c39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:11:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:11:05Z,use_quota=True,user_id='8c3648f05e984f90b1939e843f0cea32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54e7390b-9a8a-4806-b43d-2b99d43125b8),volume_type_id=54e7390b-9a8a-4806-b43d-2b99d43125b8)' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:11:04 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-6c3720c0-7f2f-4658-9207-38d8eafb9c10 tempest-GroupSnapshotsTest-180858973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e94e03be-2bc0-43b8-9da9-7379707cf835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:11:04 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-6c3720c0-7f2f-4658-9207-38d8eafb9c10 tempest-GroupSnapshotsTest-180858973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e94e03be-2bc0-43b8-9da9-7379707cf835) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:11:04 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-6c3720c0-7f2f-4658-9207-38d8eafb9c10 tempest-GroupSnapshotsTest-180858973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f897a94f-f9c0-4ed1-ba6b-dd851bd57da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:11:04 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-6c3720c0-7f2f-4658-9207-38d8eafb9c10 tempest-GroupSnapshotsTest-180858973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f897a94f-f9c0-4ed1-ba6b-dd851bd57da6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6fec6821-164d-4d5f-9c74-5cb15a972243', 'volume_name': 'volume-6fec6821-164d-4d5f-9c74-5cb15a972243', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:11:04 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-6c3720c0-7f2f-4658-9207-38d8eafb9c10 tempest-GroupSnapshotsTest-180858973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d40f4bb-1086-4e11-aa21-cf90e896a19b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:11:04 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-6c3720c0-7f2f-4658-9207-38d8eafb9c10 tempest-GroupSnapshotsTest-180858973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d40f4bb-1086-4e11-aa21-cf90e896a19b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:11:04 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-6c3720c0-7f2f-4658-9207-38d8eafb9c10 tempest-GroupSnapshotsTest-180858973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85e503e9-5902-40e8-a2c7-80aa2eb17fd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:11:04 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-6c3720c0-7f2f-4658-9207-38d8eafb9c10 tempest-GroupSnapshotsTest-180858973 None] Volume 6fec6821-164d-4d5f-9c74-5cb15a972243: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6fec6821-164d-4d5f-9c74-5cb15a972243', 'volume_size': 1} Apr 16 15:11:04 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-6c3720c0-7f2f-4658-9207-38d8eafb9c10 tempest-GroupSnapshotsTest-180858973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:11:05 devstack sudo[88861]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:05 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-60888370-409e-4f3f-b2c3-063a1d971f65 tempest-CreateVolumesFromSnapshotTest-324767205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-9507fe66-6de6-40f6-98e7-0177919afd91 1073741824" returned: 0 in 0.553s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:05 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-60888370-409e-4f3f-b2c3-063a1d971f65 tempest-CreateVolumesFromSnapshotTest-324767205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-9507fe66-6de6-40f6-98e7-0177919afd91 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:05 devstack sudo[88866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-9507fe66-6de6-40f6-98e7-0177919afd91 Apr 16 15:11:05 devstack sudo[88866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:05 devstack sudo[88866]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:05 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-60888370-409e-4f3f-b2c3-063a1d971f65 tempest-CreateVolumesFromSnapshotTest-324767205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-9507fe66-6de6-40f6-98e7-0177919afd91" returned: 0 in 0.418s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:05 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-60888370-409e-4f3f-b2c3-063a1d971f65 tempest-CreateVolumesFromSnapshotTest-324767205 None] <== create_volume: return (1001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'} {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 15:11:05 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-60888370-409e-4f3f-b2c3-063a1d971f65 tempest-CreateVolumesFromSnapshotTest-324767205 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:11:05 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-6c3720c0-7f2f-4658-9207-38d8eafb9c10 tempest-GroupSnapshotsTest-180858973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.518s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:11:05 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-6c3720c0-7f2f-4658-9207-38d8eafb9c10 tempest-GroupSnapshotsTest-180858973 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a171cb0b-d8fd-433d-a506-de0fd4eb6435,created_at=2026-04-16T13:11:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1671182765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a171cb0b-d8fd-433d-a506-de0fd4eb6435,host='devstack@QuobyteHD#QuobyteHD',id=6fec6821-164d-4d5f-9c74-5cb15a972243,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe52d01decbe4a18a804934f56346c39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:11:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:11:05Z,use_quota=True,user_id='8c3648f05e984f90b1939e843f0cea32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54e7390b-9a8a-4806-b43d-2b99d43125b8),volume_type_id=54e7390b-9a8a-4806-b43d-2b99d43125b8)}" {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 15:11:05 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-6c3720c0-7f2f-4658-9207-38d8eafb9c10 tempest-GroupSnapshotsTest-180858973 None] Creating volume 6fec6821-164d-4d5f-9c74-5cb15a972243 {{(pid=82756) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 15:11:05 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-6c3720c0-7f2f-4658-9207-38d8eafb9c10 tempest-GroupSnapshotsTest-180858973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:11:05 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-6c3720c0-7f2f-4658-9207-38d8eafb9c10 tempest-GroupSnapshotsTest-180858973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:11:05 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-6c3720c0-7f2f-4658-9207-38d8eafb9c10 tempest-GroupSnapshotsTest-180858973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:11:05 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-6c3720c0-7f2f-4658-9207-38d8eafb9c10 tempest-GroupSnapshotsTest-180858973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:11:05 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-6c3720c0-7f2f-4658-9207-38d8eafb9c10 tempest-GroupSnapshotsTest-180858973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:11:05 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-6c3720c0-7f2f-4658-9207-38d8eafb9c10 tempest-GroupSnapshotsTest-180858973 None] Selected osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 as target Quobyte volume. {{(pid=82756) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 15:11:05 devstack cinder-volume[82756]: INFO cinder.volume.drivers.remotefs [None req-6c3720c0-7f2f-4658-9207-38d8eafb9c10 tempest-GroupSnapshotsTest-180858973 None] casted to osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 Apr 16 15:11:05 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-6c3720c0-7f2f-4658-9207-38d8eafb9c10 tempest-GroupSnapshotsTest-180858973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6fec6821-164d-4d5f-9c74-5cb15a972243 1073741824 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:05 devstack sudo[88869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6fec6821-164d-4d5f-9c74-5cb15a972243 1073741824 Apr 16 15:11:05 devstack sudo[88869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:05 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-60888370-409e-4f3f-b2c3-063a1d971f65 tempest-CreateVolumesFromSnapshotTest-324767205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9025cc2f-0dc5-4c40-b35b-0390fdf849a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9507fe66-6de6-40f6-98e7-0177919afd91', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:11:05 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-60888370-409e-4f3f-b2c3-063a1d971f65 tempest-CreateVolumesFromSnapshotTest-324767205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (624585f3-0612-41e9-aa0e-6b865f78df13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:11:05 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-60888370-409e-4f3f-b2c3-063a1d971f65 tempest-CreateVolumesFromSnapshotTest-324767205 None] Volume volume-9507fe66-6de6-40f6-98e7-0177919afd91 (9507fe66-6de6-40f6-98e7-0177919afd91): created successfully Apr 16 15:11:05 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-60888370-409e-4f3f-b2c3-063a1d971f65 tempest-CreateVolumesFromSnapshotTest-324767205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (624585f3-0612-41e9-aa0e-6b865f78df13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:11:05 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-60888370-409e-4f3f-b2c3-063a1d971f65 tempest-CreateVolumesFromSnapshotTest-324767205 None] Flow 'volume_create_manager' (8f36dc72-63d8-4e4b-8cad-f6c2344f5049) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:11:05 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-6072d569-8d30-445e-a88c-a042f4d026dc tempest-CinderUnicodeTest-297054767 None] Acquiring lock "cinder-d5f21196-3094-49f6-8702-0e827cb34220-delete_snapshot" by "delete_snapshot" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:11:05 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-60888370-409e-4f3f-b2c3-063a1d971f65 tempest-CreateVolumesFromSnapshotTest-324767205 None] Created volume successfully. Apr 16 15:11:05 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-6072d569-8d30-445e-a88c-a042f4d026dc tempest-CinderUnicodeTest-297054767 None] Lock "cinder-d5f21196-3094-49f6-8702-0e827cb34220-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:11:05 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-6072d569-8d30-445e-a88c-a042f4d026dc tempest-CinderUnicodeTest-297054767 None] Acquiring lock "cinder-quobyte-40c9be4d-3cb5-4d9c-8f0a-a0d44af0636e" by "delete_snapshot" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:11:05 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-6072d569-8d30-445e-a88c-a042f4d026dc tempest-CinderUnicodeTest-297054767 None] Lock "cinder-quobyte-40c9be4d-3cb5-4d9c-8f0a-a0d44af0636e" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:11:05 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-6072d569-8d30-445e-a88c-a042f4d026dc tempest-CinderUnicodeTest-297054767 None] Acquiring lock "cinder-quobyte-d5f21196-3094-49f6-8702-0e827cb34220" by "_delete_snapshot" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:11:05 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-6072d569-8d30-445e-a88c-a042f4d026dc tempest-CinderUnicodeTest-297054767 None] Lock "cinder-quobyte-d5f21196-3094-49f6-8702-0e827cb34220" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:11:05 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-6072d569-8d30-445e-a88c-a042f4d026dc tempest-CinderUnicodeTest-297054767 None] Deleting offline snapshot d5f21196-3094-49f6-8702-0e827cb34220 of volume 40c9be4d-3cb5-4d9c-8f0a-a0d44af0636e {{(pid=82756) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 15:11:05 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-6072d569-8d30-445e-a88c-a042f4d026dc tempest-CinderUnicodeTest-297054767 None] snapshot_file for this snap is: volume-40c9be4d-3cb5-4d9c-8f0a-a0d44af0636e.d5f21196-3094-49f6-8702-0e827cb34220 {{(pid=82756) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 15:11:05 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[f67c5ff1-bc42-4549-a4c1-e958df261178]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:11:05 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-6072d569-8d30-445e-a88c-a042f4d026dc tempest-CinderUnicodeTest-297054767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-40c9be4d-3cb5-4d9c-8f0a-a0d44af0636e.d5f21196-3094-49f6-8702-0e827cb34220 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:05 devstack sudo[88871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-40c9be4d-3cb5-4d9c-8f0a-a0d44af0636e.d5f21196-3094-49f6-8702-0e827cb34220 Apr 16 15:11:05 devstack sudo[88871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:05 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-87c144ef-96f4-47a7-b5c0-efd081ad63ab tempest-CreateVolumesFromSnapshotTest-324767205 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:11:06 devstack sudo[88869]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:06 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-6c3720c0-7f2f-4658-9207-38d8eafb9c10 tempest-GroupSnapshotsTest-180858973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6fec6821-164d-4d5f-9c74-5cb15a972243 1073741824" returned: 0 in 0.598s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:06 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-6c3720c0-7f2f-4658-9207-38d8eafb9c10 tempest-GroupSnapshotsTest-180858973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6fec6821-164d-4d5f-9c74-5cb15a972243 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:06 devstack sudo[88879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6fec6821-164d-4d5f-9c74-5cb15a972243 Apr 16 15:11:06 devstack sudo[88879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:06 devstack sudo[88871]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:06 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-6072d569-8d30-445e-a88c-a042f4d026dc tempest-CinderUnicodeTest-297054767 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-40c9be4d-3cb5-4d9c-8f0a-a0d44af0636e.d5f21196-3094-49f6-8702-0e827cb34220" returned: 0 in 0.554s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:06 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-6072d569-8d30-445e-a88c-a042f4d026dc tempest-CinderUnicodeTest-297054767 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-40c9be4d-3cb5-4d9c-8f0a-a0d44af0636e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82756) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 15:11:06 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fd2d4b8-8026-426e-b4b8-5713c37c868a]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:11:06 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-6072d569-8d30-445e-a88c-a042f4d026dc tempest-CinderUnicodeTest-297054767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-40c9be4d-3cb5-4d9c-8f0a-a0d44af0636e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:06 devstack sudo[88881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-40c9be4d-3cb5-4d9c-8f0a-a0d44af0636e Apr 16 15:11:06 devstack sudo[88881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:06 devstack sudo[88879]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:06 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-6c3720c0-7f2f-4658-9207-38d8eafb9c10 tempest-GroupSnapshotsTest-180858973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6fec6821-164d-4d5f-9c74-5cb15a972243" returned: 0 in 0.400s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:06 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-6c3720c0-7f2f-4658-9207-38d8eafb9c10 tempest-GroupSnapshotsTest-180858973 None] <== create_volume: return (1032ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'} {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 15:11:06 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-6c3720c0-7f2f-4658-9207-38d8eafb9c10 tempest-GroupSnapshotsTest-180858973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.035s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:11:06 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-87c144ef-96f4-47a7-b5c0-efd081ad63ab tempest-CreateVolumesFromSnapshotTest-324767205 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.750s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:11:06 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-6c3720c0-7f2f-4658-9207-38d8eafb9c10 tempest-GroupSnapshotsTest-180858973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85e503e9-5902-40e8-a2c7-80aa2eb17fd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fec6821-164d-4d5f-9c74-5cb15a972243', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:11:06 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-6c3720c0-7f2f-4658-9207-38d8eafb9c10 tempest-GroupSnapshotsTest-180858973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8efa40f2-6608-4028-9981-a8ef6d92a1d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:11:06 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-87c144ef-96f4-47a7-b5c0-efd081ad63ab tempest-CreateVolumesFromSnapshotTest-324767205 None] Creating offline snapshot 3c9d39f4-e67e-414b-8ed8-64095d99133d of volume 9507fe66-6de6-40f6-98e7-0177919afd91 {{(pid=82756) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 16 15:11:06 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-6c3720c0-7f2f-4658-9207-38d8eafb9c10 tempest-GroupSnapshotsTest-180858973 None] Volume volume-6fec6821-164d-4d5f-9c74-5cb15a972243 (6fec6821-164d-4d5f-9c74-5cb15a972243): created successfully Apr 16 15:11:06 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-6c3720c0-7f2f-4658-9207-38d8eafb9c10 tempest-GroupSnapshotsTest-180858973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8efa40f2-6608-4028-9981-a8ef6d92a1d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:11:06 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-6c3720c0-7f2f-4658-9207-38d8eafb9c10 tempest-GroupSnapshotsTest-180858973 None] Flow 'volume_create_manager' (362f9478-71ae-424c-a4f7-bbac44585758) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:11:06 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff8f9b92-22b1-4bac-832f-f657bf62f24e]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:11:06 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-87c144ef-96f4-47a7-b5c0-efd081ad63ab tempest-CreateVolumesFromSnapshotTest-324767205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-9507fe66-6de6-40f6-98e7-0177919afd91 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:06 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-6c3720c0-7f2f-4658-9207-38d8eafb9c10 tempest-GroupSnapshotsTest-180858973 None] Created volume successfully. Apr 16 15:11:06 devstack sudo[88885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-9507fe66-6de6-40f6-98e7-0177919afd91 Apr 16 15:11:06 devstack sudo[88885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:06 devstack sudo[88881]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:06 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-6072d569-8d30-445e-a88c-a042f4d026dc tempest-CinderUnicodeTest-297054767 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-40c9be4d-3cb5-4d9c-8f0a-a0d44af0636e" returned: 0 in 0.495s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:06 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-6072d569-8d30-445e-a88c-a042f4d026dc tempest-CinderUnicodeTest-297054767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-40c9be4d-3cb5-4d9c-8f0a-a0d44af0636e.d5f21196-3094-49f6-8702-0e827cb34220 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:06 devstack sudo[88889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-40c9be4d-3cb5-4d9c-8f0a-a0d44af0636e.d5f21196-3094-49f6-8702-0e827cb34220 Apr 16 15:11:06 devstack sudo[88889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:07 devstack sudo[88885]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:07 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-87c144ef-96f4-47a7-b5c0-efd081ad63ab tempest-CreateVolumesFromSnapshotTest-324767205 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-9507fe66-6de6-40f6-98e7-0177919afd91" returned: 0 in 0.536s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:07 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-87c144ef-96f4-47a7-b5c0-efd081ad63ab tempest-CreateVolumesFromSnapshotTest-324767205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-9507fe66-6de6-40f6-98e7-0177919afd91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-9507fe66-6de6-40f6-98e7-0177919afd91.3c9d39f4-e67e-414b-8ed8-64095d99133d 1G {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:07 devstack sudo[88897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-9507fe66-6de6-40f6-98e7-0177919afd91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-9507fe66-6de6-40f6-98e7-0177919afd91.3c9d39f4-e67e-414b-8ed8-64095d99133d 1G Apr 16 15:11:07 devstack sudo[88897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:07 devstack sudo[88889]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:07 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-6072d569-8d30-445e-a88c-a042f4d026dc tempest-CinderUnicodeTest-297054767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-40c9be4d-3cb5-4d9c-8f0a-a0d44af0636e.d5f21196-3094-49f6-8702-0e827cb34220" returned: 0 in 0.518s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:07 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-6072d569-8d30-445e-a88c-a042f4d026dc tempest-CinderUnicodeTest-297054767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-40c9be4d-3cb5-4d9c-8f0a-a0d44af0636e.d5f21196-3094-49f6-8702-0e827cb34220 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:07 devstack sudo[88899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-40c9be4d-3cb5-4d9c-8f0a-a0d44af0636e.d5f21196-3094-49f6-8702-0e827cb34220 Apr 16 15:11:07 devstack sudo[88899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:07 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab0feb1f-c76d-4071-9c76-084a376bb079 tempest-GroupSnapshotsTest-180858973 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82756) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 15:11:07 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-ab0feb1f-c76d-4071-9c76-084a376bb079 tempest-GroupSnapshotsTest-180858973 None] Flow 'volume_create_manager' (e2de06f6-fce8-4831-8fc1-139fcc05c2f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:11:07 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-ab0feb1f-c76d-4071-9c76-084a376bb079 tempest-GroupSnapshotsTest-180858973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a6f2a82-72e9-4def-bcf3-051238ba7a16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:11:07 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-ab0feb1f-c76d-4071-9c76-084a376bb079 tempest-GroupSnapshotsTest-180858973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a6f2a82-72e9-4def-bcf3-051238ba7a16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:11:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-615206445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a171cb0b-d8fd-433d-a506-de0fd4eb6435,host='devstack@QuobyteHD#QuobyteHD',id=097860ec-09ae-490a-9944-34c8c468483c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe52d01decbe4a18a804934f56346c39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:11:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:11:07Z,use_quota=True,user_id='8c3648f05e984f90b1939e843f0cea32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54e7390b-9a8a-4806-b43d-2b99d43125b8),volume_type_id=54e7390b-9a8a-4806-b43d-2b99d43125b8)' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:11:07 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-ab0feb1f-c76d-4071-9c76-084a376bb079 tempest-GroupSnapshotsTest-180858973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c38674b2-d1e7-4467-a2f8-ad7ddea1d88b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:11:07 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-ab0feb1f-c76d-4071-9c76-084a376bb079 tempest-GroupSnapshotsTest-180858973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c38674b2-d1e7-4467-a2f8-ad7ddea1d88b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:11:07 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-ab0feb1f-c76d-4071-9c76-084a376bb079 tempest-GroupSnapshotsTest-180858973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e59156d8-4f1a-4c18-92b9-11d661abf264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:11:07 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-ab0feb1f-c76d-4071-9c76-084a376bb079 tempest-GroupSnapshotsTest-180858973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e59156d8-4f1a-4c18-92b9-11d661abf264) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '097860ec-09ae-490a-9944-34c8c468483c', 'volume_name': 'volume-097860ec-09ae-490a-9944-34c8c468483c', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:11:07 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-ab0feb1f-c76d-4071-9c76-084a376bb079 tempest-GroupSnapshotsTest-180858973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0312f332-1489-44fd-ac66-2bd533c9c7b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:11:07 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-ab0feb1f-c76d-4071-9c76-084a376bb079 tempest-GroupSnapshotsTest-180858973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0312f332-1489-44fd-ac66-2bd533c9c7b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:11:07 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-ab0feb1f-c76d-4071-9c76-084a376bb079 tempest-GroupSnapshotsTest-180858973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db8d54bc-2525-4ef0-8180-6fb71916fdfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:11:07 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-ab0feb1f-c76d-4071-9c76-084a376bb079 tempest-GroupSnapshotsTest-180858973 None] Volume 097860ec-09ae-490a-9944-34c8c468483c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-097860ec-09ae-490a-9944-34c8c468483c', 'volume_size': 1} Apr 16 15:11:07 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-ab0feb1f-c76d-4071-9c76-084a376bb079 tempest-GroupSnapshotsTest-180858973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:11:07 devstack sudo[88899]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:07 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-6072d569-8d30-445e-a88c-a042f4d026dc tempest-CinderUnicodeTest-297054767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-40c9be4d-3cb5-4d9c-8f0a-a0d44af0636e.d5f21196-3094-49f6-8702-0e827cb34220" returned: 0 in 0.457s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:07 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-6072d569-8d30-445e-a88c-a042f4d026dc tempest-CinderUnicodeTest-297054767 None] Lock "cinder-quobyte-d5f21196-3094-49f6-8702-0e827cb34220" released by "_delete_snapshot" :: held 2.087s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:11:07 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-6072d569-8d30-445e-a88c-a042f4d026dc tempest-CinderUnicodeTest-297054767 None] Lock "cinder-quobyte-40c9be4d-3cb5-4d9c-8f0a-a0d44af0636e" released by "delete_snapshot" :: held 2.106s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:11:07 devstack sudo[88897]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:07 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-87c144ef-96f4-47a7-b5c0-efd081ad63ab tempest-CreateVolumesFromSnapshotTest-324767205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-9507fe66-6de6-40f6-98e7-0177919afd91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-9507fe66-6de6-40f6-98e7-0177919afd91.3c9d39f4-e67e-414b-8ed8-64095d99133d 1G" returned: 0 in 0.585s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:07 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-87c144ef-96f4-47a7-b5c0-efd081ad63ab tempest-CreateVolumesFromSnapshotTest-324767205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9507fe66-6de6-40f6-98e7-0177919afd91 -F qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-9507fe66-6de6-40f6-98e7-0177919afd91.3c9d39f4-e67e-414b-8ed8-64095d99133d {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:07 devstack sudo[88905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9507fe66-6de6-40f6-98e7-0177919afd91 -F qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-9507fe66-6de6-40f6-98e7-0177919afd91.3c9d39f4-e67e-414b-8ed8-64095d99133d Apr 16 15:11:07 devstack sudo[88905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:07 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-6072d569-8d30-445e-a88c-a042f4d026dc tempest-CinderUnicodeTest-297054767 None] Created reservations ['4fe032a5-55ed-4447-8dc8-4d0250065832', 'b3620321-abc1-4797-a948-0970cad86ddd', '0d169a33-9413-4bee-9154-f1f3619bca8c', '2cd573d0-3bdf-47f5-a770-d46bd6dad6ac'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:11:07 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-6072d569-8d30-445e-a88c-a042f4d026dc tempest-CinderUnicodeTest-297054767 None] Delete snapshot completed successfully. Apr 16 15:11:07 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-6072d569-8d30-445e-a88c-a042f4d026dc tempest-CinderUnicodeTest-297054767 None] Lock "cinder-d5f21196-3094-49f6-8702-0e827cb34220-delete_snapshot" released by "delete_snapshot" :: held 2.214s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:11:08 devstack sudo[88905]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:08 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-87c144ef-96f4-47a7-b5c0-efd081ad63ab tempest-CreateVolumesFromSnapshotTest-324767205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9507fe66-6de6-40f6-98e7-0177919afd91 -F qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-9507fe66-6de6-40f6-98e7-0177919afd91.3c9d39f4-e67e-414b-8ed8-64095d99133d" returned: 0 in 0.448s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:08 devstack cinder-volume[82756]: WARNING cinder.volume.drivers.remotefs [None req-87c144ef-96f4-47a7-b5c0-efd081ad63ab tempest-CreateVolumesFromSnapshotTest-324767205 None] /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-9507fe66-6de6-40f6-98e7-0177919afd91.3c9d39f4-e67e-414b-8ed8-64095d99133d is being set with open permissions: ugo+rw Apr 16 15:11:08 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-87c144ef-96f4-47a7-b5c0-efd081ad63ab tempest-CreateVolumesFromSnapshotTest-324767205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-9507fe66-6de6-40f6-98e7-0177919afd91.3c9d39f4-e67e-414b-8ed8-64095d99133d {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:08 devstack sudo[88910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-9507fe66-6de6-40f6-98e7-0177919afd91.3c9d39f4-e67e-414b-8ed8-64095d99133d Apr 16 15:11:08 devstack sudo[88910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:08 devstack sudo[88910]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:08 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-87c144ef-96f4-47a7-b5c0-efd081ad63ab tempest-CreateVolumesFromSnapshotTest-324767205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-9507fe66-6de6-40f6-98e7-0177919afd91.3c9d39f4-e67e-414b-8ed8-64095d99133d" returned: 0 in 0.417s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:08 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-87c144ef-96f4-47a7-b5c0-efd081ad63ab tempest-CreateVolumesFromSnapshotTest-324767205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-9507fe66-6de6-40f6-98e7-0177919afd91.info {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:08 devstack sudo[88913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-9507fe66-6de6-40f6-98e7-0177919afd91.info Apr 16 15:11:08 devstack sudo[88913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:08 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-77c3d0d8-cb2a-4ed8-ae18-444461337c14 tempest-CinderUnicodeTest-297054767 None] Acquiring lock "cinder-40c9be4d-3cb5-4d9c-8f0a-a0d44af0636e-delete_volume" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:11:08 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-77c3d0d8-cb2a-4ed8-ae18-444461337c14 tempest-CinderUnicodeTest-297054767 None] Lock "cinder-40c9be4d-3cb5-4d9c-8f0a-a0d44af0636e-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:11:08 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-77c3d0d8-cb2a-4ed8-ae18-444461337c14 tempest-CinderUnicodeTest-297054767 None] Acquiring lock "cinder-quobyte-40c9be4d-3cb5-4d9c-8f0a-a0d44af0636e" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:11:08 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-77c3d0d8-cb2a-4ed8-ae18-444461337c14 tempest-CinderUnicodeTest-297054767 None] Lock "cinder-quobyte-40c9be4d-3cb5-4d9c-8f0a-a0d44af0636e" acquired by "delete_volume" :: waited 0.010s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:11:08 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[b623e629-c9b7-469f-a2fb-00b4ad4088e2]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:11:08 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-77c3d0d8-cb2a-4ed8-ae18-444461337c14 tempest-CinderUnicodeTest-297054767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-40c9be4d-3cb5-4d9c-8f0a-a0d44af0636e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:08 devstack sudo[88915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-40c9be4d-3cb5-4d9c-8f0a-a0d44af0636e Apr 16 15:11:08 devstack sudo[88915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:09 devstack sudo[88913]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:09 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-87c144ef-96f4-47a7-b5c0-efd081ad63ab tempest-CreateVolumesFromSnapshotTest-324767205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-9507fe66-6de6-40f6-98e7-0177919afd91.info" returned: 0 in 0.477s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:09 devstack cinder-volume[82756]: WARNING cinder.volume.drivers.remotefs [None req-87c144ef-96f4-47a7-b5c0-efd081ad63ab tempest-CreateVolumesFromSnapshotTest-324767205 None] /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-9507fe66-6de6-40f6-98e7-0177919afd91.info is being set with open permissions: ugo+rw Apr 16 15:11:09 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-87c144ef-96f4-47a7-b5c0-efd081ad63ab tempest-CreateVolumesFromSnapshotTest-324767205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-9507fe66-6de6-40f6-98e7-0177919afd91.info {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:09 devstack sudo[88918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-9507fe66-6de6-40f6-98e7-0177919afd91.info Apr 16 15:11:09 devstack sudo[88918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:09 devstack sudo[88915]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:09 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-77c3d0d8-cb2a-4ed8-ae18-444461337c14 tempest-CinderUnicodeTest-297054767 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-40c9be4d-3cb5-4d9c-8f0a-a0d44af0636e" returned: 0 in 0.476s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:09 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-77c3d0d8-cb2a-4ed8-ae18-444461337c14 tempest-CinderUnicodeTest-297054767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-40c9be4d-3cb5-4d9c-8f0a-a0d44af0636e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:09 devstack sudo[88923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-40c9be4d-3cb5-4d9c-8f0a-a0d44af0636e Apr 16 15:11:09 devstack sudo[88923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:09 devstack sudo[88918]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:09 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-87c144ef-96f4-47a7-b5c0-efd081ad63ab tempest-CreateVolumesFromSnapshotTest-324767205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-9507fe66-6de6-40f6-98e7-0177919afd91.info" returned: 0 in 0.394s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:09 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-87c144ef-96f4-47a7-b5c0-efd081ad63ab tempest-CreateVolumesFromSnapshotTest-324767205 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.944s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:11:09 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-ab0feb1f-c76d-4071-9c76-084a376bb079 tempest-GroupSnapshotsTest-180858973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.059s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:11:09 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-ab0feb1f-c76d-4071-9c76-084a376bb079 tempest-GroupSnapshotsTest-180858973 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a171cb0b-d8fd-433d-a506-de0fd4eb6435,created_at=2026-04-16T13:11:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-615206445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a171cb0b-d8fd-433d-a506-de0fd4eb6435,host='devstack@QuobyteHD#QuobyteHD',id=097860ec-09ae-490a-9944-34c8c468483c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe52d01decbe4a18a804934f56346c39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:11:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:11:07Z,use_quota=True,user_id='8c3648f05e984f90b1939e843f0cea32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54e7390b-9a8a-4806-b43d-2b99d43125b8),volume_type_id=54e7390b-9a8a-4806-b43d-2b99d43125b8)}" {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 15:11:09 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-ab0feb1f-c76d-4071-9c76-084a376bb079 tempest-GroupSnapshotsTest-180858973 None] Creating volume 097860ec-09ae-490a-9944-34c8c468483c {{(pid=82756) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 15:11:09 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-ab0feb1f-c76d-4071-9c76-084a376bb079 tempest-GroupSnapshotsTest-180858973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:11:09 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-ab0feb1f-c76d-4071-9c76-084a376bb079 tempest-GroupSnapshotsTest-180858973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:11:09 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-ab0feb1f-c76d-4071-9c76-084a376bb079 tempest-GroupSnapshotsTest-180858973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:11:09 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-ab0feb1f-c76d-4071-9c76-084a376bb079 tempest-GroupSnapshotsTest-180858973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:11:09 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-ab0feb1f-c76d-4071-9c76-084a376bb079 tempest-GroupSnapshotsTest-180858973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:11:09 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-ab0feb1f-c76d-4071-9c76-084a376bb079 tempest-GroupSnapshotsTest-180858973 None] Selected osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 as target Quobyte volume. {{(pid=82756) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 15:11:09 devstack cinder-volume[82756]: INFO cinder.volume.drivers.remotefs [None req-ab0feb1f-c76d-4071-9c76-084a376bb079 tempest-GroupSnapshotsTest-180858973 None] casted to osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 Apr 16 15:11:09 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-ab0feb1f-c76d-4071-9c76-084a376bb079 tempest-GroupSnapshotsTest-180858973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-097860ec-09ae-490a-9944-34c8c468483c 1073741824 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:09 devstack sudo[88926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-097860ec-09ae-490a-9944-34c8c468483c 1073741824 Apr 16 15:11:09 devstack sudo[88926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:09 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-87c144ef-96f4-47a7-b5c0-efd081ad63ab tempest-CreateVolumesFromSnapshotTest-324767205 None] Create snapshot completed successfully Apr 16 15:11:09 devstack sudo[88923]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:09 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-77c3d0d8-cb2a-4ed8-ae18-444461337c14 tempest-CinderUnicodeTest-297054767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-40c9be4d-3cb5-4d9c-8f0a-a0d44af0636e" returned: 0 in 0.458s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:09 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-77c3d0d8-cb2a-4ed8-ae18-444461337c14 tempest-CinderUnicodeTest-297054767 None] Lock "cinder-quobyte-40c9be4d-3cb5-4d9c-8f0a-a0d44af0636e" released by "delete_volume" :: held 0.963s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:11:09 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-77c3d0d8-cb2a-4ed8-ae18-444461337c14 tempest-CinderUnicodeTest-297054767 None] Created reservations ['4ac79cce-ebe1-412d-9110-c812f0603196', 'af300a8b-2597-4ca6-b4dc-a7086beae789', '5ee00c9a-e792-421a-9cca-f6e5cf47f1c5', 'fc78f620-571f-4dfe-851d-2388e19e4e44'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:11:09 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-77c3d0d8-cb2a-4ed8-ae18-444461337c14 tempest-CinderUnicodeTest-297054767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:11:09 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-77c3d0d8-cb2a-4ed8-ae18-444461337c14 tempest-CinderUnicodeTest-297054767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:11:09 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-77c3d0d8-cb2a-4ed8-ae18-444461337c14 tempest-CinderUnicodeTest-297054767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:11:09 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-77c3d0d8-cb2a-4ed8-ae18-444461337c14 tempest-CinderUnicodeTest-297054767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:11:09 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-77c3d0d8-cb2a-4ed8-ae18-444461337c14 tempest-CinderUnicodeTest-297054767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:11:09 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-77c3d0d8-cb2a-4ed8-ae18-444461337c14 tempest-CinderUnicodeTest-297054767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:09 devstack sudo[88929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:11:09 devstack sudo[88929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:09 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-f0999171-c273-44f5-9bb8-3f33e7902a87 tempest-CinderUnicodeTest-297054767 None] Acquiring lock "cinder-8668dbdd-bcb4-4725-87ba-9d9a4b5a3655-delete_volume" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:11:09 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-f0999171-c273-44f5-9bb8-3f33e7902a87 tempest-CinderUnicodeTest-297054767 None] Lock "cinder-8668dbdd-bcb4-4725-87ba-9d9a4b5a3655-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:11:09 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-f0999171-c273-44f5-9bb8-3f33e7902a87 tempest-CinderUnicodeTest-297054767 None] Acquiring lock "cinder-quobyte-8668dbdd-bcb4-4725-87ba-9d9a4b5a3655" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:11:09 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-f0999171-c273-44f5-9bb8-3f33e7902a87 tempest-CinderUnicodeTest-297054767 None] Lock "cinder-quobyte-8668dbdd-bcb4-4725-87ba-9d9a4b5a3655" acquired by "delete_volume" :: waited 0.009s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:11:09 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[48f68782-b06c-4a75-a18c-7d54447811c2]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:11:09 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-f0999171-c273-44f5-9bb8-3f33e7902a87 tempest-CinderUnicodeTest-297054767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-8668dbdd-bcb4-4725-87ba-9d9a4b5a3655 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:09 devstack sudo[88933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-8668dbdd-bcb4-4725-87ba-9d9a4b5a3655 Apr 16 15:11:09 devstack sudo[88933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:10 devstack sudo[88926]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:10 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-ab0feb1f-c76d-4071-9c76-084a376bb079 tempest-GroupSnapshotsTest-180858973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-097860ec-09ae-490a-9944-34c8c468483c 1073741824" returned: 0 in 0.584s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:10 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-ab0feb1f-c76d-4071-9c76-084a376bb079 tempest-GroupSnapshotsTest-180858973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-097860ec-09ae-490a-9944-34c8c468483c {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:10 devstack sudo[88936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-097860ec-09ae-490a-9944-34c8c468483c Apr 16 15:11:10 devstack sudo[88936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:10 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd6a066b-1844-4fd0-a3d9-cb3154649863 tempest-CreateVolumesFromSnapshotTest-324767205 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82756) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 15:11:10 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-bd6a066b-1844-4fd0-a3d9-cb3154649863 tempest-CreateVolumesFromSnapshotTest-324767205 None] Flow 'volume_create_manager' (1be6bf9d-6102-4b55-a372-548e686fb32e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:11:10 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-bd6a066b-1844-4fd0-a3d9-cb3154649863 tempest-CreateVolumesFromSnapshotTest-324767205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be759ccc-8080-44ea-a148-5e00c3184477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:11:10 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-bd6a066b-1844-4fd0-a3d9-cb3154649863 tempest-CreateVolumesFromSnapshotTest-324767205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be759ccc-8080-44ea-a148-5e00c3184477) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:11:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-927930805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=663b8f52-385a-4cc0-a902-c329ea8bea1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='564d54bad3b94a7c8d1015cb4cf057f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:11:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:11:10Z,use_quota=True,user_id='ac1176cc820a478ca417e47931613417',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:11:10 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-bd6a066b-1844-4fd0-a3d9-cb3154649863 tempest-CreateVolumesFromSnapshotTest-324767205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (514d24b9-965f-4a06-9add-9b20ec1dd2f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:11:10 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-bd6a066b-1844-4fd0-a3d9-cb3154649863 tempest-CreateVolumesFromSnapshotTest-324767205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (514d24b9-965f-4a06-9add-9b20ec1dd2f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:11:10 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-bd6a066b-1844-4fd0-a3d9-cb3154649863 tempest-CreateVolumesFromSnapshotTest-324767205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (254c7f5c-35ca-45bd-a2dd-61beeaa3096e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:11:10 devstack sudo[88929]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:10 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-bd6a066b-1844-4fd0-a3d9-cb3154649863 tempest-CreateVolumesFromSnapshotTest-324767205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (254c7f5c-35ca-45bd-a2dd-61beeaa3096e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '663b8f52-385a-4cc0-a902-c329ea8bea1c', 'volume_name': 'volume-663b8f52-385a-4cc0-a902-c329ea8bea1c', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:11:10 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-bd6a066b-1844-4fd0-a3d9-cb3154649863 tempest-CreateVolumesFromSnapshotTest-324767205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7c1d4a4-d807-4b26-a610-8609cd937824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:11:10 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-bd6a066b-1844-4fd0-a3d9-cb3154649863 tempest-CreateVolumesFromSnapshotTest-324767205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7c1d4a4-d807-4b26-a610-8609cd937824) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:11:10 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-bd6a066b-1844-4fd0-a3d9-cb3154649863 tempest-CreateVolumesFromSnapshotTest-324767205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87bbdedf-5a13-43e0-8c74-e4ec2dd0ffab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:11:10 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-bd6a066b-1844-4fd0-a3d9-cb3154649863 tempest-CreateVolumesFromSnapshotTest-324767205 None] Volume 663b8f52-385a-4cc0-a902-c329ea8bea1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-663b8f52-385a-4cc0-a902-c329ea8bea1c', 'volume_size': 1} Apr 16 15:11:10 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-bd6a066b-1844-4fd0-a3d9-cb3154649863 tempest-CreateVolumesFromSnapshotTest-324767205 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:11:10 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-77c3d0d8-cb2a-4ed8-ae18-444461337c14 tempest-CinderUnicodeTest-297054767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.564s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:10 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-77c3d0d8-cb2a-4ed8-ae18-444461337c14 tempest-CinderUnicodeTest-297054767 None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:11:10 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-77c3d0d8-cb2a-4ed8-ae18-444461337c14 tempest-CinderUnicodeTest-297054767 None] Deleted volume successfully. Apr 16 15:11:10 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-77c3d0d8-cb2a-4ed8-ae18-444461337c14 tempest-CinderUnicodeTest-297054767 None] Lock "cinder-40c9be4d-3cb5-4d9c-8f0a-a0d44af0636e-delete_volume" released by "delete_volume" :: held 1.661s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:11:10 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c9ebe18-e36a-4770-9bf6-9f8c5123b5da tempest-CreateVolumesFromSnapshotTest-324767205 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82756) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 15:11:10 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-8c9ebe18-e36a-4770-9bf6-9f8c5123b5da tempest-CreateVolumesFromSnapshotTest-324767205 None] Flow 'volume_create_manager' (4eb51382-c747-43f4-bbe2-7b958db284f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:11:10 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-8c9ebe18-e36a-4770-9bf6-9f8c5123b5da tempest-CreateVolumesFromSnapshotTest-324767205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91de0a5a-bd99-40a0-815d-9c4344597fed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:11:10 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-8c9ebe18-e36a-4770-9bf6-9f8c5123b5da tempest-CreateVolumesFromSnapshotTest-324767205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91de0a5a-bd99-40a0-815d-9c4344597fed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:11:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1833935028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=369807d2-e48e-42e5-840a-1cb5e791de84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='564d54bad3b94a7c8d1015cb4cf057f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:11:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:11:10Z,use_quota=True,user_id='ac1176cc820a478ca417e47931613417',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:11:10 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-8c9ebe18-e36a-4770-9bf6-9f8c5123b5da tempest-CreateVolumesFromSnapshotTest-324767205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8239836-a19b-4421-b4bb-506684ad2258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:11:10 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-8c9ebe18-e36a-4770-9bf6-9f8c5123b5da tempest-CreateVolumesFromSnapshotTest-324767205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8239836-a19b-4421-b4bb-506684ad2258) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:11:10 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-8c9ebe18-e36a-4770-9bf6-9f8c5123b5da tempest-CreateVolumesFromSnapshotTest-324767205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f523b4ef-8a7f-40dc-87e8-7a7cf149ae53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:11:10 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-8c9ebe18-e36a-4770-9bf6-9f8c5123b5da tempest-CreateVolumesFromSnapshotTest-324767205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f523b4ef-8a7f-40dc-87e8-7a7cf149ae53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '369807d2-e48e-42e5-840a-1cb5e791de84', 'volume_name': 'volume-369807d2-e48e-42e5-840a-1cb5e791de84', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:11:10 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-8c9ebe18-e36a-4770-9bf6-9f8c5123b5da tempest-CreateVolumesFromSnapshotTest-324767205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be11c47a-771c-43b8-bbf8-1d4712bb3b21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:11:10 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-8c9ebe18-e36a-4770-9bf6-9f8c5123b5da tempest-CreateVolumesFromSnapshotTest-324767205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be11c47a-771c-43b8-bbf8-1d4712bb3b21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:11:10 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-8c9ebe18-e36a-4770-9bf6-9f8c5123b5da tempest-CreateVolumesFromSnapshotTest-324767205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6980682-7ca5-402e-b371-1f1d84dab042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:11:10 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-8c9ebe18-e36a-4770-9bf6-9f8c5123b5da tempest-CreateVolumesFromSnapshotTest-324767205 None] Volume 369807d2-e48e-42e5-840a-1cb5e791de84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-369807d2-e48e-42e5-840a-1cb5e791de84', 'volume_size': 1} Apr 16 15:11:10 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-8c9ebe18-e36a-4770-9bf6-9f8c5123b5da tempest-CreateVolumesFromSnapshotTest-324767205 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:11:10 devstack sudo[88933]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:10 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-f0999171-c273-44f5-9bb8-3f33e7902a87 tempest-CinderUnicodeTest-297054767 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-8668dbdd-bcb4-4725-87ba-9d9a4b5a3655" returned: 0 in 0.685s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:10 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-f0999171-c273-44f5-9bb8-3f33e7902a87 tempest-CinderUnicodeTest-297054767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-8668dbdd-bcb4-4725-87ba-9d9a4b5a3655 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:10 devstack sudo[88942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-8668dbdd-bcb4-4725-87ba-9d9a4b5a3655 Apr 16 15:11:10 devstack sudo[88942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:10 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [None req-474d2e89-5fd3-4b8e-99e6-81cda38324e7 tempest-CreateVolumesFromSnapshotTest-324767205 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82756) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 15:11:10 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-474d2e89-5fd3-4b8e-99e6-81cda38324e7 tempest-CreateVolumesFromSnapshotTest-324767205 None] Flow 'volume_create_manager' (ae378d10-5a97-4436-a0e3-b4bc6894c796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:11:10 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-474d2e89-5fd3-4b8e-99e6-81cda38324e7 tempest-CreateVolumesFromSnapshotTest-324767205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02a4fa73-1dfb-4e95-b235-6b9110c3d984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:11:10 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-474d2e89-5fd3-4b8e-99e6-81cda38324e7 tempest-CreateVolumesFromSnapshotTest-324767205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02a4fa73-1dfb-4e95-b235-6b9110c3d984) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:11:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1432453764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f1fef4a-d0e1-422e-b2f0-c53a1c3eb484,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='564d54bad3b94a7c8d1015cb4cf057f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:11:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:11:11Z,use_quota=True,user_id='ac1176cc820a478ca417e47931613417',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:11:10 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-474d2e89-5fd3-4b8e-99e6-81cda38324e7 tempest-CreateVolumesFromSnapshotTest-324767205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97567e9c-0463-432b-a178-d94903c808ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:11:10 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-474d2e89-5fd3-4b8e-99e6-81cda38324e7 tempest-CreateVolumesFromSnapshotTest-324767205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97567e9c-0463-432b-a178-d94903c808ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:11:10 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-474d2e89-5fd3-4b8e-99e6-81cda38324e7 tempest-CreateVolumesFromSnapshotTest-324767205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (141525b7-d7df-4aa0-9796-545a02d17b5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:11:10 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-474d2e89-5fd3-4b8e-99e6-81cda38324e7 tempest-CreateVolumesFromSnapshotTest-324767205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (141525b7-d7df-4aa0-9796-545a02d17b5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f1fef4a-d0e1-422e-b2f0-c53a1c3eb484', 'volume_name': 'volume-1f1fef4a-d0e1-422e-b2f0-c53a1c3eb484', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:11:10 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-474d2e89-5fd3-4b8e-99e6-81cda38324e7 tempest-CreateVolumesFromSnapshotTest-324767205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a1f78c7-47ee-4662-8f9e-f3729c2a3694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:11:10 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-474d2e89-5fd3-4b8e-99e6-81cda38324e7 tempest-CreateVolumesFromSnapshotTest-324767205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a1f78c7-47ee-4662-8f9e-f3729c2a3694) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:11:10 devstack sudo[88936]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:10 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-474d2e89-5fd3-4b8e-99e6-81cda38324e7 tempest-CreateVolumesFromSnapshotTest-324767205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (954dac38-33ce-481f-a107-a816c456078f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:11:10 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-474d2e89-5fd3-4b8e-99e6-81cda38324e7 tempest-CreateVolumesFromSnapshotTest-324767205 None] Volume 1f1fef4a-d0e1-422e-b2f0-c53a1c3eb484: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f1fef4a-d0e1-422e-b2f0-c53a1c3eb484', 'volume_size': 1} Apr 16 15:11:10 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-474d2e89-5fd3-4b8e-99e6-81cda38324e7 tempest-CreateVolumesFromSnapshotTest-324767205 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:11:10 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-ab0feb1f-c76d-4071-9c76-084a376bb079 tempest-GroupSnapshotsTest-180858973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-097860ec-09ae-490a-9944-34c8c468483c" returned: 0 in 0.569s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:10 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-ab0feb1f-c76d-4071-9c76-084a376bb079 tempest-GroupSnapshotsTest-180858973 None] <== create_volume: return (1185ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'} {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 15:11:10 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-ab0feb1f-c76d-4071-9c76-084a376bb079 tempest-GroupSnapshotsTest-180858973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.188s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:11:10 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-bd6a066b-1844-4fd0-a3d9-cb3154649863 tempest-CreateVolumesFromSnapshotTest-324767205 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.332s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:11:10 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-bd6a066b-1844-4fd0-a3d9-cb3154649863 tempest-CreateVolumesFromSnapshotTest-324767205 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:11:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-927930805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=663b8f52-385a-4cc0-a902-c329ea8bea1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='564d54bad3b94a7c8d1015cb4cf057f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:11:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:11:10Z,use_quota=True,user_id='ac1176cc820a478ca417e47931613417',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)}" {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 15:11:10 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-bd6a066b-1844-4fd0-a3d9-cb3154649863 tempest-CreateVolumesFromSnapshotTest-324767205 None] Creating volume 663b8f52-385a-4cc0-a902-c329ea8bea1c {{(pid=82756) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 15:11:10 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-bd6a066b-1844-4fd0-a3d9-cb3154649863 tempest-CreateVolumesFromSnapshotTest-324767205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:11:10 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-bd6a066b-1844-4fd0-a3d9-cb3154649863 tempest-CreateVolumesFromSnapshotTest-324767205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:11:10 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-bd6a066b-1844-4fd0-a3d9-cb3154649863 tempest-CreateVolumesFromSnapshotTest-324767205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:11:10 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-bd6a066b-1844-4fd0-a3d9-cb3154649863 tempest-CreateVolumesFromSnapshotTest-324767205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:11:10 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-bd6a066b-1844-4fd0-a3d9-cb3154649863 tempest-CreateVolumesFromSnapshotTest-324767205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:11:10 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-bd6a066b-1844-4fd0-a3d9-cb3154649863 tempest-CreateVolumesFromSnapshotTest-324767205 None] Selected osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 as target Quobyte volume. {{(pid=82756) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 15:11:10 devstack cinder-volume[82756]: INFO cinder.volume.drivers.remotefs [None req-bd6a066b-1844-4fd0-a3d9-cb3154649863 tempest-CreateVolumesFromSnapshotTest-324767205 None] casted to osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 Apr 16 15:11:10 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-bd6a066b-1844-4fd0-a3d9-cb3154649863 tempest-CreateVolumesFromSnapshotTest-324767205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-663b8f52-385a-4cc0-a902-c329ea8bea1c 1073741824 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:10 devstack cinder-volume[82756]: DEBUG dbcounter [-] [82756] Writing DB stats cinder:UPDATE=253,cinder:SELECT=211,cinder:INSERT=64,cinder:DELETE=14 {{(pid=82756) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 15:11:10 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-ab0feb1f-c76d-4071-9c76-084a376bb079 tempest-GroupSnapshotsTest-180858973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db8d54bc-2525-4ef0-8180-6fb71916fdfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-097860ec-09ae-490a-9944-34c8c468483c', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:11:10 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-ab0feb1f-c76d-4071-9c76-084a376bb079 tempest-GroupSnapshotsTest-180858973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6934916b-a6c0-4eef-8b75-e6b86d2ba33b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:11:10 devstack sudo[88945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-663b8f52-385a-4cc0-a902-c329ea8bea1c 1073741824 Apr 16 15:11:10 devstack sudo[88945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:10 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-ab0feb1f-c76d-4071-9c76-084a376bb079 tempest-GroupSnapshotsTest-180858973 None] Volume volume-097860ec-09ae-490a-9944-34c8c468483c (097860ec-09ae-490a-9944-34c8c468483c): created successfully Apr 16 15:11:10 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-ab0feb1f-c76d-4071-9c76-084a376bb079 tempest-GroupSnapshotsTest-180858973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6934916b-a6c0-4eef-8b75-e6b86d2ba33b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:11:10 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-ab0feb1f-c76d-4071-9c76-084a376bb079 tempest-GroupSnapshotsTest-180858973 None] Flow 'volume_create_manager' (e2de06f6-fce8-4831-8fc1-139fcc05c2f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:11:10 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-ab0feb1f-c76d-4071-9c76-084a376bb079 tempest-GroupSnapshotsTest-180858973 None] Created volume successfully. Apr 16 15:11:10 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4f9e3dc-c695-41e8-a8c2-12caf612ecb4 tempest-CreateVolumesFromSnapshotTest-324767205 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82756) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 15:11:10 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-e4f9e3dc-c695-41e8-a8c2-12caf612ecb4 tempest-CreateVolumesFromSnapshotTest-324767205 None] Flow 'volume_create_manager' (87084330-1ca5-4b4d-936f-4ada4f724e37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:11:10 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-e4f9e3dc-c695-41e8-a8c2-12caf612ecb4 tempest-CreateVolumesFromSnapshotTest-324767205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (386410d8-7e1f-4eb8-9bfb-2a4cf0e63761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:11:10 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-e4f9e3dc-c695-41e8-a8c2-12caf612ecb4 tempest-CreateVolumesFromSnapshotTest-324767205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (386410d8-7e1f-4eb8-9bfb-2a4cf0e63761) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:11:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-989753319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6413ddc0-c1c6-475e-a69f-04676062c6ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='564d54bad3b94a7c8d1015cb4cf057f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:11:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:11:11Z,use_quota=True,user_id='ac1176cc820a478ca417e47931613417',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:11:10 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-e4f9e3dc-c695-41e8-a8c2-12caf612ecb4 tempest-CreateVolumesFromSnapshotTest-324767205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bf04480-46d3-444d-bf54-45a169790adf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:11:10 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-e4f9e3dc-c695-41e8-a8c2-12caf612ecb4 tempest-CreateVolumesFromSnapshotTest-324767205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bf04480-46d3-444d-bf54-45a169790adf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:11:10 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-e4f9e3dc-c695-41e8-a8c2-12caf612ecb4 tempest-CreateVolumesFromSnapshotTest-324767205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8df65485-fb09-4007-8d69-ef2ab3db5c35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:11:10 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-e4f9e3dc-c695-41e8-a8c2-12caf612ecb4 tempest-CreateVolumesFromSnapshotTest-324767205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8df65485-fb09-4007-8d69-ef2ab3db5c35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6413ddc0-c1c6-475e-a69f-04676062c6ea', 'volume_name': 'volume-6413ddc0-c1c6-475e-a69f-04676062c6ea', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:11:10 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-e4f9e3dc-c695-41e8-a8c2-12caf612ecb4 tempest-CreateVolumesFromSnapshotTest-324767205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b073b759-5309-41a4-95ec-1a77b7f19d45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:11:10 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-e4f9e3dc-c695-41e8-a8c2-12caf612ecb4 tempest-CreateVolumesFromSnapshotTest-324767205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b073b759-5309-41a4-95ec-1a77b7f19d45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:11:10 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-e4f9e3dc-c695-41e8-a8c2-12caf612ecb4 tempest-CreateVolumesFromSnapshotTest-324767205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b62b4b2c-efa2-40c6-9ab0-b698fb8f34b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:11:10 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-e4f9e3dc-c695-41e8-a8c2-12caf612ecb4 tempest-CreateVolumesFromSnapshotTest-324767205 None] Volume 6413ddc0-c1c6-475e-a69f-04676062c6ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6413ddc0-c1c6-475e-a69f-04676062c6ea', 'volume_size': 1} Apr 16 15:11:10 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-e4f9e3dc-c695-41e8-a8c2-12caf612ecb4 tempest-CreateVolumesFromSnapshotTest-324767205 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:11:11 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [None req-24bac10e-d0de-4db7-adf0-32538c684112 tempest-CreateVolumesFromSnapshotTest-324767205 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82756) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 15:11:11 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-24bac10e-d0de-4db7-adf0-32538c684112 tempest-CreateVolumesFromSnapshotTest-324767205 None] Flow 'volume_create_manager' (642dfbc5-0136-484a-bfde-4bef731b616a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:11:11 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-24bac10e-d0de-4db7-adf0-32538c684112 tempest-CreateVolumesFromSnapshotTest-324767205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20076a39-c049-49d3-8d03-3c8815b21cba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:11:11 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-24bac10e-d0de-4db7-adf0-32538c684112 tempest-CreateVolumesFromSnapshotTest-324767205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20076a39-c049-49d3-8d03-3c8815b21cba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:11:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-491169388',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c39343eb-f282-483b-9b29-bd44069537e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='564d54bad3b94a7c8d1015cb4cf057f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:11:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:11:11Z,use_quota=True,user_id='ac1176cc820a478ca417e47931613417',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:11:11 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-24bac10e-d0de-4db7-adf0-32538c684112 tempest-CreateVolumesFromSnapshotTest-324767205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35f12d78-ecb4-4ff2-84e5-4be7c18878f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:11:11 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-24bac10e-d0de-4db7-adf0-32538c684112 tempest-CreateVolumesFromSnapshotTest-324767205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35f12d78-ecb4-4ff2-84e5-4be7c18878f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:11:11 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-24bac10e-d0de-4db7-adf0-32538c684112 tempest-CreateVolumesFromSnapshotTest-324767205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0665702c-c082-4b39-a67f-beb42292ee28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:11:11 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-24bac10e-d0de-4db7-adf0-32538c684112 tempest-CreateVolumesFromSnapshotTest-324767205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0665702c-c082-4b39-a67f-beb42292ee28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c39343eb-f282-483b-9b29-bd44069537e3', 'volume_name': 'volume-c39343eb-f282-483b-9b29-bd44069537e3', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:11:11 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-24bac10e-d0de-4db7-adf0-32538c684112 tempest-CreateVolumesFromSnapshotTest-324767205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e827f70-1ebe-49f9-9147-adcad16a40cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:11:11 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-24bac10e-d0de-4db7-adf0-32538c684112 tempest-CreateVolumesFromSnapshotTest-324767205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e827f70-1ebe-49f9-9147-adcad16a40cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:11:11 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-24bac10e-d0de-4db7-adf0-32538c684112 tempest-CreateVolumesFromSnapshotTest-324767205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5db69b73-a0aa-470f-a411-a03f75594916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:11:11 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-24bac10e-d0de-4db7-adf0-32538c684112 tempest-CreateVolumesFromSnapshotTest-324767205 None] Volume c39343eb-f282-483b-9b29-bd44069537e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c39343eb-f282-483b-9b29-bd44069537e3', 'volume_size': 1} Apr 16 15:11:11 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-24bac10e-d0de-4db7-adf0-32538c684112 tempest-CreateVolumesFromSnapshotTest-324767205 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:11:11 devstack sudo[88942]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:11 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-f0999171-c273-44f5-9bb8-3f33e7902a87 tempest-CinderUnicodeTest-297054767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-8668dbdd-bcb4-4725-87ba-9d9a4b5a3655" returned: 0 in 0.574s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:11 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-f0999171-c273-44f5-9bb8-3f33e7902a87 tempest-CinderUnicodeTest-297054767 None] Lock "cinder-quobyte-8668dbdd-bcb4-4725-87ba-9d9a4b5a3655" released by "delete_volume" :: held 1.284s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:11:11 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-f0999171-c273-44f5-9bb8-3f33e7902a87 tempest-CinderUnicodeTest-297054767 None] Created reservations ['0f9012cf-f667-4fd4-aed6-65b59db357e6', 'a439d15d-ab78-436f-9eb5-b50d9e02e1f8', 'cfce7315-7d0e-4193-aef7-0730ebcb1506', '9e97b9fc-20d2-4848-8bd6-8aa24220bdf7'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:11:11 devstack cinder-volume[82756]: DEBUG dbcounter [-] [82756] Writing DB stats cinder:SELECT=193,cinder:UPDATE=247,cinder:INSERT=56,cinder:DELETE=26 {{(pid=82756) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 15:11:11 devstack sudo[88945]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:11 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-f0999171-c273-44f5-9bb8-3f33e7902a87 tempest-CinderUnicodeTest-297054767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:11:11 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-f0999171-c273-44f5-9bb8-3f33e7902a87 tempest-CinderUnicodeTest-297054767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:11:11 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-f0999171-c273-44f5-9bb8-3f33e7902a87 tempest-CinderUnicodeTest-297054767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:11:11 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-f0999171-c273-44f5-9bb8-3f33e7902a87 tempest-CinderUnicodeTest-297054767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:11:11 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-f0999171-c273-44f5-9bb8-3f33e7902a87 tempest-CinderUnicodeTest-297054767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:11:11 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-f0999171-c273-44f5-9bb8-3f33e7902a87 tempest-CinderUnicodeTest-297054767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:11 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-bd6a066b-1844-4fd0-a3d9-cb3154649863 tempest-CreateVolumesFromSnapshotTest-324767205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-663b8f52-385a-4cc0-a902-c329ea8bea1c 1073741824" returned: 0 in 0.553s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:11 devstack sudo[88951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:11:11 devstack sudo[88951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:11 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-bd6a066b-1844-4fd0-a3d9-cb3154649863 tempest-CreateVolumesFromSnapshotTest-324767205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-663b8f52-385a-4cc0-a902-c329ea8bea1c {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:11 devstack sudo[88953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-663b8f52-385a-4cc0-a902-c329ea8bea1c Apr 16 15:11:11 devstack sudo[88953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:11 devstack sudo[88951]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:11 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-f0999171-c273-44f5-9bb8-3f33e7902a87 tempest-CinderUnicodeTest-297054767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.401s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:11 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-f0999171-c273-44f5-9bb8-3f33e7902a87 tempest-CinderUnicodeTest-297054767 None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:11:11 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-f0999171-c273-44f5-9bb8-3f33e7902a87 tempest-CinderUnicodeTest-297054767 None] Deleted volume successfully. Apr 16 15:11:11 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-f0999171-c273-44f5-9bb8-3f33e7902a87 tempest-CinderUnicodeTest-297054767 None] Lock "cinder-8668dbdd-bcb4-4725-87ba-9d9a4b5a3655-delete_volume" released by "delete_volume" :: held 1.823s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:11:11 devstack sudo[88953]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:11 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-bd6a066b-1844-4fd0-a3d9-cb3154649863 tempest-CreateVolumesFromSnapshotTest-324767205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-663b8f52-385a-4cc0-a902-c329ea8bea1c" returned: 0 in 0.412s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:11 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-bd6a066b-1844-4fd0-a3d9-cb3154649863 tempest-CreateVolumesFromSnapshotTest-324767205 None] <== create_volume: return (991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'} {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 15:11:11 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-bd6a066b-1844-4fd0-a3d9-cb3154649863 tempest-CreateVolumesFromSnapshotTest-324767205 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.993s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:11:11 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-8c9ebe18-e36a-4770-9bf6-9f8c5123b5da tempest-CreateVolumesFromSnapshotTest-324767205 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.161s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:11:11 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-8c9ebe18-e36a-4770-9bf6-9f8c5123b5da tempest-CreateVolumesFromSnapshotTest-324767205 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:11:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1833935028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=369807d2-e48e-42e5-840a-1cb5e791de84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='564d54bad3b94a7c8d1015cb4cf057f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:11:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:11:10Z,use_quota=True,user_id='ac1176cc820a478ca417e47931613417',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)}" {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 15:11:11 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-8c9ebe18-e36a-4770-9bf6-9f8c5123b5da tempest-CreateVolumesFromSnapshotTest-324767205 None] Creating volume 369807d2-e48e-42e5-840a-1cb5e791de84 {{(pid=82756) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 15:11:11 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-8c9ebe18-e36a-4770-9bf6-9f8c5123b5da tempest-CreateVolumesFromSnapshotTest-324767205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:11:11 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-8c9ebe18-e36a-4770-9bf6-9f8c5123b5da tempest-CreateVolumesFromSnapshotTest-324767205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:11:11 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-8c9ebe18-e36a-4770-9bf6-9f8c5123b5da tempest-CreateVolumesFromSnapshotTest-324767205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:11:11 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-8c9ebe18-e36a-4770-9bf6-9f8c5123b5da tempest-CreateVolumesFromSnapshotTest-324767205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:11:11 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-8c9ebe18-e36a-4770-9bf6-9f8c5123b5da tempest-CreateVolumesFromSnapshotTest-324767205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:11:11 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-8c9ebe18-e36a-4770-9bf6-9f8c5123b5da tempest-CreateVolumesFromSnapshotTest-324767205 None] Selected osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 as target Quobyte volume. {{(pid=82756) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 15:11:11 devstack cinder-volume[82756]: INFO cinder.volume.drivers.remotefs [None req-8c9ebe18-e36a-4770-9bf6-9f8c5123b5da tempest-CreateVolumesFromSnapshotTest-324767205 None] casted to osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 Apr 16 15:11:11 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-8c9ebe18-e36a-4770-9bf6-9f8c5123b5da tempest-CreateVolumesFromSnapshotTest-324767205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-369807d2-e48e-42e5-840a-1cb5e791de84 1073741824 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:11 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-bd6a066b-1844-4fd0-a3d9-cb3154649863 tempest-CreateVolumesFromSnapshotTest-324767205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87bbdedf-5a13-43e0-8c74-e4ec2dd0ffab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-663b8f52-385a-4cc0-a902-c329ea8bea1c', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:11:11 devstack sudo[88957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-369807d2-e48e-42e5-840a-1cb5e791de84 1073741824 Apr 16 15:11:11 devstack sudo[88957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:11 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-bd6a066b-1844-4fd0-a3d9-cb3154649863 tempest-CreateVolumesFromSnapshotTest-324767205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdfeff5f-5b1b-4e02-89fd-81ec23f5e96f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:11:11 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-bd6a066b-1844-4fd0-a3d9-cb3154649863 tempest-CreateVolumesFromSnapshotTest-324767205 None] Volume volume-663b8f52-385a-4cc0-a902-c329ea8bea1c (663b8f52-385a-4cc0-a902-c329ea8bea1c): created successfully Apr 16 15:11:11 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-bd6a066b-1844-4fd0-a3d9-cb3154649863 tempest-CreateVolumesFromSnapshotTest-324767205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdfeff5f-5b1b-4e02-89fd-81ec23f5e96f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:11:11 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-bd6a066b-1844-4fd0-a3d9-cb3154649863 tempest-CreateVolumesFromSnapshotTest-324767205 None] Flow 'volume_create_manager' (1be6bf9d-6102-4b55-a372-548e686fb32e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:11:11 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-bd6a066b-1844-4fd0-a3d9-cb3154649863 tempest-CreateVolumesFromSnapshotTest-324767205 None] Created volume successfully. Apr 16 15:11:11 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-321f47dd-3051-4771-aee4-b007de18054b tempest-GroupSnapshotsTest-180858973 None] Update group completed successfully. Apr 16 15:11:12 devstack sudo[88957]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:12 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-8c9ebe18-e36a-4770-9bf6-9f8c5123b5da tempest-CreateVolumesFromSnapshotTest-324767205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-369807d2-e48e-42e5-840a-1cb5e791de84 1073741824" returned: 0 in 0.556s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:12 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-8c9ebe18-e36a-4770-9bf6-9f8c5123b5da tempest-CreateVolumesFromSnapshotTest-324767205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-369807d2-e48e-42e5-840a-1cb5e791de84 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:12 devstack sudo[88962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-369807d2-e48e-42e5-840a-1cb5e791de84 Apr 16 15:11:12 devstack sudo[88962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:12 devstack sudo[88962]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:12 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-8c9ebe18-e36a-4770-9bf6-9f8c5123b5da tempest-CreateVolumesFromSnapshotTest-324767205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-369807d2-e48e-42e5-840a-1cb5e791de84" returned: 0 in 0.477s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:12 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-8c9ebe18-e36a-4770-9bf6-9f8c5123b5da tempest-CreateVolumesFromSnapshotTest-324767205 None] <== create_volume: return (1057ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'} {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 15:11:12 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-8c9ebe18-e36a-4770-9bf6-9f8c5123b5da tempest-CreateVolumesFromSnapshotTest-324767205 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.060s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:11:12 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-474d2e89-5fd3-4b8e-99e6-81cda38324e7 tempest-CreateVolumesFromSnapshotTest-324767205 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.066s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:11:12 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-474d2e89-5fd3-4b8e-99e6-81cda38324e7 tempest-CreateVolumesFromSnapshotTest-324767205 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:11:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1432453764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f1fef4a-d0e1-422e-b2f0-c53a1c3eb484,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='564d54bad3b94a7c8d1015cb4cf057f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:11:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:11:11Z,use_quota=True,user_id='ac1176cc820a478ca417e47931613417',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)}" {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 15:11:12 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-474d2e89-5fd3-4b8e-99e6-81cda38324e7 tempest-CreateVolumesFromSnapshotTest-324767205 None] Creating volume 1f1fef4a-d0e1-422e-b2f0-c53a1c3eb484 {{(pid=82756) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 15:11:12 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-474d2e89-5fd3-4b8e-99e6-81cda38324e7 tempest-CreateVolumesFromSnapshotTest-324767205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:11:12 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-474d2e89-5fd3-4b8e-99e6-81cda38324e7 tempest-CreateVolumesFromSnapshotTest-324767205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:11:12 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-474d2e89-5fd3-4b8e-99e6-81cda38324e7 tempest-CreateVolumesFromSnapshotTest-324767205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:11:12 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-474d2e89-5fd3-4b8e-99e6-81cda38324e7 tempest-CreateVolumesFromSnapshotTest-324767205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:11:12 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-474d2e89-5fd3-4b8e-99e6-81cda38324e7 tempest-CreateVolumesFromSnapshotTest-324767205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:11:12 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-474d2e89-5fd3-4b8e-99e6-81cda38324e7 tempest-CreateVolumesFromSnapshotTest-324767205 None] Selected osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 as target Quobyte volume. {{(pid=82756) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 15:11:12 devstack cinder-volume[82756]: INFO cinder.volume.drivers.remotefs [None req-474d2e89-5fd3-4b8e-99e6-81cda38324e7 tempest-CreateVolumesFromSnapshotTest-324767205 None] casted to osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 Apr 16 15:11:12 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-474d2e89-5fd3-4b8e-99e6-81cda38324e7 tempest-CreateVolumesFromSnapshotTest-324767205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-1f1fef4a-d0e1-422e-b2f0-c53a1c3eb484 1073741824 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:12 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-8c9ebe18-e36a-4770-9bf6-9f8c5123b5da tempest-CreateVolumesFromSnapshotTest-324767205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6980682-7ca5-402e-b371-1f1d84dab042) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-369807d2-e48e-42e5-840a-1cb5e791de84', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:11:12 devstack sudo[88965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-1f1fef4a-d0e1-422e-b2f0-c53a1c3eb484 1073741824 Apr 16 15:11:12 devstack sudo[88965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:12 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-8c9ebe18-e36a-4770-9bf6-9f8c5123b5da tempest-CreateVolumesFromSnapshotTest-324767205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f6b6b06-ce5e-4d3f-b059-a9934d1fcb27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:11:12 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-8c9ebe18-e36a-4770-9bf6-9f8c5123b5da tempest-CreateVolumesFromSnapshotTest-324767205 None] Volume volume-369807d2-e48e-42e5-840a-1cb5e791de84 (369807d2-e48e-42e5-840a-1cb5e791de84): created successfully Apr 16 15:11:12 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-8c9ebe18-e36a-4770-9bf6-9f8c5123b5da tempest-CreateVolumesFromSnapshotTest-324767205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f6b6b06-ce5e-4d3f-b059-a9934d1fcb27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:11:12 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-8c9ebe18-e36a-4770-9bf6-9f8c5123b5da tempest-CreateVolumesFromSnapshotTest-324767205 None] Flow 'volume_create_manager' (4eb51382-c747-43f4-bbe2-7b958db284f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:11:12 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-8c9ebe18-e36a-4770-9bf6-9f8c5123b5da tempest-CreateVolumesFromSnapshotTest-324767205 None] Created volume successfully. Apr 16 15:11:12 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-c1eaaa95-5a90-40ff-b2f3-54cb06f299cc tempest-GroupSnapshotsTest-180858973 None] Update group completed successfully. Apr 16 15:11:13 devstack sudo[88965]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:13 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-474d2e89-5fd3-4b8e-99e6-81cda38324e7 tempest-CreateVolumesFromSnapshotTest-324767205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-1f1fef4a-d0e1-422e-b2f0-c53a1c3eb484 1073741824" returned: 0 in 0.539s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:13 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-474d2e89-5fd3-4b8e-99e6-81cda38324e7 tempest-CreateVolumesFromSnapshotTest-324767205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-1f1fef4a-d0e1-422e-b2f0-c53a1c3eb484 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:13 devstack sudo[88970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-1f1fef4a-d0e1-422e-b2f0-c53a1c3eb484 Apr 16 15:11:13 devstack sudo[88970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:13 devstack sudo[88970]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:13 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-474d2e89-5fd3-4b8e-99e6-81cda38324e7 tempest-CreateVolumesFromSnapshotTest-324767205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-1f1fef4a-d0e1-422e-b2f0-c53a1c3eb484" returned: 0 in 0.419s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:13 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-474d2e89-5fd3-4b8e-99e6-81cda38324e7 tempest-CreateVolumesFromSnapshotTest-324767205 None] <== create_volume: return (980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'} {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 15:11:13 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-474d2e89-5fd3-4b8e-99e6-81cda38324e7 tempest-CreateVolumesFromSnapshotTest-324767205 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.983s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:11:13 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-e4f9e3dc-c695-41e8-a8c2-12caf612ecb4 tempest-CreateVolumesFromSnapshotTest-324767205 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.839s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:11:13 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-e4f9e3dc-c695-41e8-a8c2-12caf612ecb4 tempest-CreateVolumesFromSnapshotTest-324767205 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:11:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-989753319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6413ddc0-c1c6-475e-a69f-04676062c6ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='564d54bad3b94a7c8d1015cb4cf057f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:11:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:11:11Z,use_quota=True,user_id='ac1176cc820a478ca417e47931613417',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)}" {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 15:11:13 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-e4f9e3dc-c695-41e8-a8c2-12caf612ecb4 tempest-CreateVolumesFromSnapshotTest-324767205 None] Creating volume 6413ddc0-c1c6-475e-a69f-04676062c6ea {{(pid=82756) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 15:11:13 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-e4f9e3dc-c695-41e8-a8c2-12caf612ecb4 tempest-CreateVolumesFromSnapshotTest-324767205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:11:13 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-e4f9e3dc-c695-41e8-a8c2-12caf612ecb4 tempest-CreateVolumesFromSnapshotTest-324767205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:11:13 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-e4f9e3dc-c695-41e8-a8c2-12caf612ecb4 tempest-CreateVolumesFromSnapshotTest-324767205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:11:13 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-e4f9e3dc-c695-41e8-a8c2-12caf612ecb4 tempest-CreateVolumesFromSnapshotTest-324767205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:11:13 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-e4f9e3dc-c695-41e8-a8c2-12caf612ecb4 tempest-CreateVolumesFromSnapshotTest-324767205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:11:13 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-e4f9e3dc-c695-41e8-a8c2-12caf612ecb4 tempest-CreateVolumesFromSnapshotTest-324767205 None] Selected osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 as target Quobyte volume. {{(pid=82756) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 15:11:13 devstack cinder-volume[82756]: INFO cinder.volume.drivers.remotefs [None req-e4f9e3dc-c695-41e8-a8c2-12caf612ecb4 tempest-CreateVolumesFromSnapshotTest-324767205 None] casted to osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 Apr 16 15:11:13 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-e4f9e3dc-c695-41e8-a8c2-12caf612ecb4 tempest-CreateVolumesFromSnapshotTest-324767205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6413ddc0-c1c6-475e-a69f-04676062c6ea 1073741824 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:13 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-474d2e89-5fd3-4b8e-99e6-81cda38324e7 tempest-CreateVolumesFromSnapshotTest-324767205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (954dac38-33ce-481f-a107-a816c456078f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f1fef4a-d0e1-422e-b2f0-c53a1c3eb484', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:11:13 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-474d2e89-5fd3-4b8e-99e6-81cda38324e7 tempest-CreateVolumesFromSnapshotTest-324767205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e06f0626-1280-448a-94d2-8749fc85fa20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:11:13 devstack sudo[88974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6413ddc0-c1c6-475e-a69f-04676062c6ea 1073741824 Apr 16 15:11:13 devstack sudo[88974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:13 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-474d2e89-5fd3-4b8e-99e6-81cda38324e7 tempest-CreateVolumesFromSnapshotTest-324767205 None] Volume volume-1f1fef4a-d0e1-422e-b2f0-c53a1c3eb484 (1f1fef4a-d0e1-422e-b2f0-c53a1c3eb484): created successfully Apr 16 15:11:13 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-474d2e89-5fd3-4b8e-99e6-81cda38324e7 tempest-CreateVolumesFromSnapshotTest-324767205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e06f0626-1280-448a-94d2-8749fc85fa20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:11:13 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-474d2e89-5fd3-4b8e-99e6-81cda38324e7 tempest-CreateVolumesFromSnapshotTest-324767205 None] Flow 'volume_create_manager' (ae378d10-5a97-4436-a0e3-b4bc6894c796) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:11:13 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-474d2e89-5fd3-4b8e-99e6-81cda38324e7 tempest-CreateVolumesFromSnapshotTest-324767205 None] Created volume successfully. Apr 16 15:11:14 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-26061721-e1f6-4f3e-bbcc-3318ad8dd3cf tempest-GroupSnapshotsTest-180858973 None] Update group completed successfully. Apr 16 15:11:14 devstack sudo[88974]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:14 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-e4f9e3dc-c695-41e8-a8c2-12caf612ecb4 tempest-CreateVolumesFromSnapshotTest-324767205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6413ddc0-c1c6-475e-a69f-04676062c6ea 1073741824" returned: 0 in 0.526s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:14 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-e4f9e3dc-c695-41e8-a8c2-12caf612ecb4 tempest-CreateVolumesFromSnapshotTest-324767205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6413ddc0-c1c6-475e-a69f-04676062c6ea {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:14 devstack sudo[88979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6413ddc0-c1c6-475e-a69f-04676062c6ea Apr 16 15:11:14 devstack sudo[88979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:14 devstack sudo[88979]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:14 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-e4f9e3dc-c695-41e8-a8c2-12caf612ecb4 tempest-CreateVolumesFromSnapshotTest-324767205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6413ddc0-c1c6-475e-a69f-04676062c6ea" returned: 0 in 0.410s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:14 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-e4f9e3dc-c695-41e8-a8c2-12caf612ecb4 tempest-CreateVolumesFromSnapshotTest-324767205 None] <== create_volume: return (963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'} {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 15:11:14 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-e4f9e3dc-c695-41e8-a8c2-12caf612ecb4 tempest-CreateVolumesFromSnapshotTest-324767205 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.966s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:11:14 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-24bac10e-d0de-4db7-adf0-32538c684112 tempest-CreateVolumesFromSnapshotTest-324767205 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.615s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:11:14 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-24bac10e-d0de-4db7-adf0-32538c684112 tempest-CreateVolumesFromSnapshotTest-324767205 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:11:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-491169388',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c39343eb-f282-483b-9b29-bd44069537e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='564d54bad3b94a7c8d1015cb4cf057f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:11:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:11:11Z,use_quota=True,user_id='ac1176cc820a478ca417e47931613417',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)}" {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 15:11:14 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-24bac10e-d0de-4db7-adf0-32538c684112 tempest-CreateVolumesFromSnapshotTest-324767205 None] Creating volume c39343eb-f282-483b-9b29-bd44069537e3 {{(pid=82756) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 15:11:14 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-24bac10e-d0de-4db7-adf0-32538c684112 tempest-CreateVolumesFromSnapshotTest-324767205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:11:14 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-24bac10e-d0de-4db7-adf0-32538c684112 tempest-CreateVolumesFromSnapshotTest-324767205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:11:14 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-24bac10e-d0de-4db7-adf0-32538c684112 tempest-CreateVolumesFromSnapshotTest-324767205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:11:14 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-24bac10e-d0de-4db7-adf0-32538c684112 tempest-CreateVolumesFromSnapshotTest-324767205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:11:14 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-24bac10e-d0de-4db7-adf0-32538c684112 tempest-CreateVolumesFromSnapshotTest-324767205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:11:14 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-24bac10e-d0de-4db7-adf0-32538c684112 tempest-CreateVolumesFromSnapshotTest-324767205 None] Selected osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 as target Quobyte volume. {{(pid=82756) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 15:11:14 devstack cinder-volume[82756]: INFO cinder.volume.drivers.remotefs [None req-24bac10e-d0de-4db7-adf0-32538c684112 tempest-CreateVolumesFromSnapshotTest-324767205 None] casted to osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 Apr 16 15:11:14 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-24bac10e-d0de-4db7-adf0-32538c684112 tempest-CreateVolumesFromSnapshotTest-324767205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c39343eb-f282-483b-9b29-bd44069537e3 1073741824 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:14 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-e4f9e3dc-c695-41e8-a8c2-12caf612ecb4 tempest-CreateVolumesFromSnapshotTest-324767205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b62b4b2c-efa2-40c6-9ab0-b698fb8f34b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6413ddc0-c1c6-475e-a69f-04676062c6ea', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:11:14 devstack sudo[88982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c39343eb-f282-483b-9b29-bd44069537e3 1073741824 Apr 16 15:11:14 devstack sudo[88982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:14 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-e4f9e3dc-c695-41e8-a8c2-12caf612ecb4 tempest-CreateVolumesFromSnapshotTest-324767205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfb1bed3-bc61-4a99-99b6-2ad809cca569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:11:14 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-e4f9e3dc-c695-41e8-a8c2-12caf612ecb4 tempest-CreateVolumesFromSnapshotTest-324767205 None] Volume volume-6413ddc0-c1c6-475e-a69f-04676062c6ea (6413ddc0-c1c6-475e-a69f-04676062c6ea): created successfully Apr 16 15:11:14 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-e4f9e3dc-c695-41e8-a8c2-12caf612ecb4 tempest-CreateVolumesFromSnapshotTest-324767205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfb1bed3-bc61-4a99-99b6-2ad809cca569) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:11:14 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-e4f9e3dc-c695-41e8-a8c2-12caf612ecb4 tempest-CreateVolumesFromSnapshotTest-324767205 None] Flow 'volume_create_manager' (87084330-1ca5-4b4d-936f-4ada4f724e37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:11:14 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-e4f9e3dc-c695-41e8-a8c2-12caf612ecb4 tempest-CreateVolumesFromSnapshotTest-324767205 None] Created volume successfully. Apr 16 15:11:15 devstack sudo[88982]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:15 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-9c5477b3-9fad-4a4b-a8c7-7009cfb9c4ee tempest-GroupSnapshotsTest-180858973 None] Update group completed successfully. Apr 16 15:11:15 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-24bac10e-d0de-4db7-adf0-32538c684112 tempest-CreateVolumesFromSnapshotTest-324767205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c39343eb-f282-483b-9b29-bd44069537e3 1073741824" returned: 0 in 0.518s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:15 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-24bac10e-d0de-4db7-adf0-32538c684112 tempest-CreateVolumesFromSnapshotTest-324767205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c39343eb-f282-483b-9b29-bd44069537e3 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:15 devstack sudo[88987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c39343eb-f282-483b-9b29-bd44069537e3 Apr 16 15:11:15 devstack sudo[88987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:15 devstack sudo[88987]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:15 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-24bac10e-d0de-4db7-adf0-32538c684112 tempest-CreateVolumesFromSnapshotTest-324767205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c39343eb-f282-483b-9b29-bd44069537e3" returned: 0 in 0.422s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:15 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-24bac10e-d0de-4db7-adf0-32538c684112 tempest-CreateVolumesFromSnapshotTest-324767205 None] <== create_volume: return (961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'} {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 15:11:15 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-24bac10e-d0de-4db7-adf0-32538c684112 tempest-CreateVolumesFromSnapshotTest-324767205 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.964s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:11:15 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-24bac10e-d0de-4db7-adf0-32538c684112 tempest-CreateVolumesFromSnapshotTest-324767205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5db69b73-a0aa-470f-a411-a03f75594916) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c39343eb-f282-483b-9b29-bd44069537e3', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:11:15 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-24bac10e-d0de-4db7-adf0-32538c684112 tempest-CreateVolumesFromSnapshotTest-324767205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3462745b-8181-4d91-be46-71add4c5d66b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:11:15 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-24bac10e-d0de-4db7-adf0-32538c684112 tempest-CreateVolumesFromSnapshotTest-324767205 None] Volume volume-c39343eb-f282-483b-9b29-bd44069537e3 (c39343eb-f282-483b-9b29-bd44069537e3): created successfully Apr 16 15:11:15 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-24bac10e-d0de-4db7-adf0-32538c684112 tempest-CreateVolumesFromSnapshotTest-324767205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3462745b-8181-4d91-be46-71add4c5d66b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:11:15 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-24bac10e-d0de-4db7-adf0-32538c684112 tempest-CreateVolumesFromSnapshotTest-324767205 None] Flow 'volume_create_manager' (642dfbc5-0136-484a-bfde-4bef731b616a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:11:15 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-24bac10e-d0de-4db7-adf0-32538c684112 tempest-CreateVolumesFromSnapshotTest-324767205 None] Created volume successfully. Apr 16 15:11:16 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-e58081c4-bb8a-4549-9bb0-9c8e040a8136 tempest-GroupSnapshotsTest-180858973 None] GroupSnapshot a88f525f-35be-4383-aae4-b4a2f9fda656: creating. Apr 16 15:11:16 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-e58081c4-bb8a-4549-9bb0-9c8e040a8136 tempest-GroupSnapshotsTest-180858973 None] Group snapshot a88f525f-35be-4383-aae4-b4a2f9fda656: creating. {{(pid=82756) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 16 15:11:16 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-e58081c4-bb8a-4549-9bb0-9c8e040a8136 tempest-GroupSnapshotsTest-180858973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:11:16 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-e58081c4-bb8a-4549-9bb0-9c8e040a8136 tempest-GroupSnapshotsTest-180858973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:11:16 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-e58081c4-bb8a-4549-9bb0-9c8e040a8136 tempest-GroupSnapshotsTest-180858973 None] Creating offline snapshot 9c802c6d-5503-4bea-a63e-dbeac0cca171 of volume 097860ec-09ae-490a-9944-34c8c468483c {{(pid=82756) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 16 15:11:16 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6327be6-4ae3-40f4-81a6-6f8c770b4453]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:11:16 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-e58081c4-bb8a-4549-9bb0-9c8e040a8136 tempest-GroupSnapshotsTest-180858973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-097860ec-09ae-490a-9944-34c8c468483c {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:16 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-2f3b2936-9829-4475-a98d-9b2172208a34 tempest-CreateVolumesFromSnapshotTest-324767205 None] Acquiring lock "cinder-c39343eb-f282-483b-9b29-bd44069537e3-delete_volume" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:11:16 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-2f3b2936-9829-4475-a98d-9b2172208a34 tempest-CreateVolumesFromSnapshotTest-324767205 None] Lock "cinder-c39343eb-f282-483b-9b29-bd44069537e3-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:11:16 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-2f3b2936-9829-4475-a98d-9b2172208a34 tempest-CreateVolumesFromSnapshotTest-324767205 None] Acquiring lock "cinder-quobyte-c39343eb-f282-483b-9b29-bd44069537e3" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:11:16 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-2f3b2936-9829-4475-a98d-9b2172208a34 tempest-CreateVolumesFromSnapshotTest-324767205 None] Lock "cinder-quobyte-c39343eb-f282-483b-9b29-bd44069537e3" acquired by "delete_volume" :: waited 0.007s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:11:16 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[96896394-e709-406d-8973-34a10602965d]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:11:16 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-2f3b2936-9829-4475-a98d-9b2172208a34 tempest-CreateVolumesFromSnapshotTest-324767205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c39343eb-f282-483b-9b29-bd44069537e3 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:16 devstack sudo[88990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-097860ec-09ae-490a-9944-34c8c468483c Apr 16 15:11:16 devstack sudo[88990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:16 devstack sudo[88991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c39343eb-f282-483b-9b29-bd44069537e3 Apr 16 15:11:16 devstack sudo[88991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:17 devstack sudo[88990]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:17 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-e58081c4-bb8a-4549-9bb0-9c8e040a8136 tempest-GroupSnapshotsTest-180858973 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-097860ec-09ae-490a-9944-34c8c468483c" returned: 0 in 0.540s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:17 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-e58081c4-bb8a-4549-9bb0-9c8e040a8136 tempest-GroupSnapshotsTest-180858973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-097860ec-09ae-490a-9944-34c8c468483c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-097860ec-09ae-490a-9944-34c8c468483c.9c802c6d-5503-4bea-a63e-dbeac0cca171 1G {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:17 devstack sudo[88991]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:17 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-2f3b2936-9829-4475-a98d-9b2172208a34 tempest-CreateVolumesFromSnapshotTest-324767205 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c39343eb-f282-483b-9b29-bd44069537e3" returned: 0 in 0.491s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:17 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-2f3b2936-9829-4475-a98d-9b2172208a34 tempest-CreateVolumesFromSnapshotTest-324767205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c39343eb-f282-483b-9b29-bd44069537e3 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:17 devstack sudo[89000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-097860ec-09ae-490a-9944-34c8c468483c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-097860ec-09ae-490a-9944-34c8c468483c.9c802c6d-5503-4bea-a63e-dbeac0cca171 1G Apr 16 15:11:17 devstack sudo[89000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:17 devstack sudo[89002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c39343eb-f282-483b-9b29-bd44069537e3 Apr 16 15:11:17 devstack sudo[89002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:17 devstack sudo[89002]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:17 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-2f3b2936-9829-4475-a98d-9b2172208a34 tempest-CreateVolumesFromSnapshotTest-324767205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c39343eb-f282-483b-9b29-bd44069537e3" returned: 0 in 0.429s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:17 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-2f3b2936-9829-4475-a98d-9b2172208a34 tempest-CreateVolumesFromSnapshotTest-324767205 None] Lock "cinder-quobyte-c39343eb-f282-483b-9b29-bd44069537e3" released by "delete_volume" :: held 0.940s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:11:17 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-2f3b2936-9829-4475-a98d-9b2172208a34 tempest-CreateVolumesFromSnapshotTest-324767205 None] Created reservations ['46d75f50-4ffb-4172-aef9-82608d3cae74', '7ef04977-2edd-41d1-b503-118ebc5a452c', '8e35d6c3-2231-4617-b029-bd74363554d7', 'ef081f96-244f-4936-8d29-7663d49862b4'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:11:17 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-2f3b2936-9829-4475-a98d-9b2172208a34 tempest-CreateVolumesFromSnapshotTest-324767205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:11:17 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-2f3b2936-9829-4475-a98d-9b2172208a34 tempest-CreateVolumesFromSnapshotTest-324767205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:11:17 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-2f3b2936-9829-4475-a98d-9b2172208a34 tempest-CreateVolumesFromSnapshotTest-324767205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:11:17 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-2f3b2936-9829-4475-a98d-9b2172208a34 tempest-CreateVolumesFromSnapshotTest-324767205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:11:17 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-2f3b2936-9829-4475-a98d-9b2172208a34 tempest-CreateVolumesFromSnapshotTest-324767205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:11:17 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-2f3b2936-9829-4475-a98d-9b2172208a34 tempest-CreateVolumesFromSnapshotTest-324767205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:17 devstack sudo[89008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:11:17 devstack sudo[89008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:17 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-03b38f4f-45df-4828-a521-b4ee2e3ef297 tempest-CreateVolumesFromSnapshotTest-324767205 None] Acquiring lock "cinder-6413ddc0-c1c6-475e-a69f-04676062c6ea-delete_volume" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:11:17 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-03b38f4f-45df-4828-a521-b4ee2e3ef297 tempest-CreateVolumesFromSnapshotTest-324767205 None] Lock "cinder-6413ddc0-c1c6-475e-a69f-04676062c6ea-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:11:17 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-03b38f4f-45df-4828-a521-b4ee2e3ef297 tempest-CreateVolumesFromSnapshotTest-324767205 None] Acquiring lock "cinder-quobyte-6413ddc0-c1c6-475e-a69f-04676062c6ea" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:11:17 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-03b38f4f-45df-4828-a521-b4ee2e3ef297 tempest-CreateVolumesFromSnapshotTest-324767205 None] Lock "cinder-quobyte-6413ddc0-c1c6-475e-a69f-04676062c6ea" acquired by "delete_volume" :: waited 0.007s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:11:17 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c1899dd-8770-4e67-a0fa-6281bdacec1b]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:11:17 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-03b38f4f-45df-4828-a521-b4ee2e3ef297 tempest-CreateVolumesFromSnapshotTest-324767205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6413ddc0-c1c6-475e-a69f-04676062c6ea {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:17 devstack sudo[89000]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:17 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-e58081c4-bb8a-4549-9bb0-9c8e040a8136 tempest-GroupSnapshotsTest-180858973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-097860ec-09ae-490a-9944-34c8c468483c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-097860ec-09ae-490a-9944-34c8c468483c.9c802c6d-5503-4bea-a63e-dbeac0cca171 1G" returned: 0 in 0.650s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:17 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-e58081c4-bb8a-4549-9bb0-9c8e040a8136 tempest-GroupSnapshotsTest-180858973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-097860ec-09ae-490a-9944-34c8c468483c -F qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-097860ec-09ae-490a-9944-34c8c468483c.9c802c6d-5503-4bea-a63e-dbeac0cca171 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:17 devstack sudo[89011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-097860ec-09ae-490a-9944-34c8c468483c -F qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-097860ec-09ae-490a-9944-34c8c468483c.9c802c6d-5503-4bea-a63e-dbeac0cca171 Apr 16 15:11:17 devstack sudo[89011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:17 devstack sudo[89010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6413ddc0-c1c6-475e-a69f-04676062c6ea Apr 16 15:11:17 devstack sudo[89010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:18 devstack sudo[89008]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:18 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-2f3b2936-9829-4475-a98d-9b2172208a34 tempest-CreateVolumesFromSnapshotTest-324767205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.489s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:18 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-2f3b2936-9829-4475-a98d-9b2172208a34 tempest-CreateVolumesFromSnapshotTest-324767205 None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:11:18 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-2f3b2936-9829-4475-a98d-9b2172208a34 tempest-CreateVolumesFromSnapshotTest-324767205 None] Deleted volume successfully. Apr 16 15:11:18 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-2f3b2936-9829-4475-a98d-9b2172208a34 tempest-CreateVolumesFromSnapshotTest-324767205 None] Lock "cinder-c39343eb-f282-483b-9b29-bd44069537e3-delete_volume" released by "delete_volume" :: held 1.565s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:11:18 devstack sudo[89011]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:18 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-e58081c4-bb8a-4549-9bb0-9c8e040a8136 tempest-GroupSnapshotsTest-180858973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-097860ec-09ae-490a-9944-34c8c468483c -F qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-097860ec-09ae-490a-9944-34c8c468483c.9c802c6d-5503-4bea-a63e-dbeac0cca171" returned: 0 in 0.467s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:18 devstack cinder-volume[82756]: WARNING cinder.volume.drivers.remotefs [None req-e58081c4-bb8a-4549-9bb0-9c8e040a8136 tempest-GroupSnapshotsTest-180858973 None] /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-097860ec-09ae-490a-9944-34c8c468483c.9c802c6d-5503-4bea-a63e-dbeac0cca171 is being set with open permissions: ugo+rw: NotImplementedError Apr 16 15:11:18 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-e58081c4-bb8a-4549-9bb0-9c8e040a8136 tempest-GroupSnapshotsTest-180858973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-097860ec-09ae-490a-9944-34c8c468483c.9c802c6d-5503-4bea-a63e-dbeac0cca171 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:18 devstack sudo[89010]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:18 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-03b38f4f-45df-4828-a521-b4ee2e3ef297 tempest-CreateVolumesFromSnapshotTest-324767205 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6413ddc0-c1c6-475e-a69f-04676062c6ea" returned: 0 in 0.495s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:18 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-03b38f4f-45df-4828-a521-b4ee2e3ef297 tempest-CreateVolumesFromSnapshotTest-324767205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6413ddc0-c1c6-475e-a69f-04676062c6ea {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:18 devstack sudo[89021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-097860ec-09ae-490a-9944-34c8c468483c.9c802c6d-5503-4bea-a63e-dbeac0cca171 Apr 16 15:11:18 devstack sudo[89021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:18 devstack sudo[89022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6413ddc0-c1c6-475e-a69f-04676062c6ea Apr 16 15:11:18 devstack sudo[89022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:18 devstack sudo[89022]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:18 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-03b38f4f-45df-4828-a521-b4ee2e3ef297 tempest-CreateVolumesFromSnapshotTest-324767205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6413ddc0-c1c6-475e-a69f-04676062c6ea" returned: 0 in 0.404s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:18 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-03b38f4f-45df-4828-a521-b4ee2e3ef297 tempest-CreateVolumesFromSnapshotTest-324767205 None] Lock "cinder-quobyte-6413ddc0-c1c6-475e-a69f-04676062c6ea" released by "delete_volume" :: held 0.925s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:11:18 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-03b38f4f-45df-4828-a521-b4ee2e3ef297 tempest-CreateVolumesFromSnapshotTest-324767205 None] Created reservations ['8b88db2c-259e-400a-965b-ecc8533b15f1', '3e46bd2a-d32d-4b7f-93ed-d9be21ea44d2', 'dbb859df-ca43-49fa-b1dd-61bad6b00fbb', 'f2ff6cc4-4bc4-4fed-aaa1-155a2f154470'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:11:18 devstack sudo[89021]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:18 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-e58081c4-bb8a-4549-9bb0-9c8e040a8136 tempest-GroupSnapshotsTest-180858973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-097860ec-09ae-490a-9944-34c8c468483c.9c802c6d-5503-4bea-a63e-dbeac0cca171" returned: 0 in 0.475s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:18 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-e58081c4-bb8a-4549-9bb0-9c8e040a8136 tempest-GroupSnapshotsTest-180858973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-097860ec-09ae-490a-9944-34c8c468483c.info {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:18 devstack sudo[89027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-097860ec-09ae-490a-9944-34c8c468483c.info Apr 16 15:11:18 devstack sudo[89027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:18 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-03b38f4f-45df-4828-a521-b4ee2e3ef297 tempest-CreateVolumesFromSnapshotTest-324767205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:11:18 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-03b38f4f-45df-4828-a521-b4ee2e3ef297 tempest-CreateVolumesFromSnapshotTest-324767205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:11:18 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-03b38f4f-45df-4828-a521-b4ee2e3ef297 tempest-CreateVolumesFromSnapshotTest-324767205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:11:18 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-03b38f4f-45df-4828-a521-b4ee2e3ef297 tempest-CreateVolumesFromSnapshotTest-324767205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:11:18 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-03b38f4f-45df-4828-a521-b4ee2e3ef297 tempest-CreateVolumesFromSnapshotTest-324767205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:11:18 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-03b38f4f-45df-4828-a521-b4ee2e3ef297 tempest-CreateVolumesFromSnapshotTest-324767205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:18 devstack sudo[89029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:11:18 devstack sudo[89029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:18 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-8e62c3e1-2ca8-476c-8ff0-32561dc45063 tempest-CreateVolumesFromSnapshotTest-324767205 None] Acquiring lock "cinder-1f1fef4a-d0e1-422e-b2f0-c53a1c3eb484-delete_volume" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:11:18 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-8e62c3e1-2ca8-476c-8ff0-32561dc45063 tempest-CreateVolumesFromSnapshotTest-324767205 None] Lock "cinder-1f1fef4a-d0e1-422e-b2f0-c53a1c3eb484-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:11:18 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-8e62c3e1-2ca8-476c-8ff0-32561dc45063 tempest-CreateVolumesFromSnapshotTest-324767205 None] Acquiring lock "cinder-quobyte-1f1fef4a-d0e1-422e-b2f0-c53a1c3eb484" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:11:18 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-8e62c3e1-2ca8-476c-8ff0-32561dc45063 tempest-CreateVolumesFromSnapshotTest-324767205 None] Lock "cinder-quobyte-1f1fef4a-d0e1-422e-b2f0-c53a1c3eb484" acquired by "delete_volume" :: waited 0.014s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:11:18 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1ee8fd0-d9db-4658-867d-748739a2c7eb]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:11:18 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-8e62c3e1-2ca8-476c-8ff0-32561dc45063 tempest-CreateVolumesFromSnapshotTest-324767205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-1f1fef4a-d0e1-422e-b2f0-c53a1c3eb484 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:18 devstack sudo[89031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-1f1fef4a-d0e1-422e-b2f0-c53a1c3eb484 Apr 16 15:11:18 devstack sudo[89031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:19 devstack sudo[89027]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:19 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-e58081c4-bb8a-4549-9bb0-9c8e040a8136 tempest-GroupSnapshotsTest-180858973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-097860ec-09ae-490a-9944-34c8c468483c.info" returned: 0 in 0.452s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:19 devstack cinder-volume[82756]: WARNING cinder.volume.drivers.remotefs [None req-e58081c4-bb8a-4549-9bb0-9c8e040a8136 tempest-GroupSnapshotsTest-180858973 None] /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-097860ec-09ae-490a-9944-34c8c468483c.info is being set with open permissions: ugo+rw: NotImplementedError Apr 16 15:11:19 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-e58081c4-bb8a-4549-9bb0-9c8e040a8136 tempest-GroupSnapshotsTest-180858973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-097860ec-09ae-490a-9944-34c8c468483c.info {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:19 devstack sudo[89029]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:19 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-03b38f4f-45df-4828-a521-b4ee2e3ef297 tempest-CreateVolumesFromSnapshotTest-324767205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.436s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:19 devstack sudo[89035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-097860ec-09ae-490a-9944-34c8c468483c.info Apr 16 15:11:19 devstack sudo[89035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:19 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-03b38f4f-45df-4828-a521-b4ee2e3ef297 tempest-CreateVolumesFromSnapshotTest-324767205 None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:11:19 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-03b38f4f-45df-4828-a521-b4ee2e3ef297 tempest-CreateVolumesFromSnapshotTest-324767205 None] Deleted volume successfully. Apr 16 15:11:19 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-03b38f4f-45df-4828-a521-b4ee2e3ef297 tempest-CreateVolumesFromSnapshotTest-324767205 None] Lock "cinder-6413ddc0-c1c6-475e-a69f-04676062c6ea-delete_volume" released by "delete_volume" :: held 1.519s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:11:19 devstack sudo[89031]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:19 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-8e62c3e1-2ca8-476c-8ff0-32561dc45063 tempest-CreateVolumesFromSnapshotTest-324767205 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-1f1fef4a-d0e1-422e-b2f0-c53a1c3eb484" returned: 0 in 0.495s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:19 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-8e62c3e1-2ca8-476c-8ff0-32561dc45063 tempest-CreateVolumesFromSnapshotTest-324767205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-1f1fef4a-d0e1-422e-b2f0-c53a1c3eb484 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:19 devstack sudo[89040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-1f1fef4a-d0e1-422e-b2f0-c53a1c3eb484 Apr 16 15:11:19 devstack sudo[89040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:19 devstack sudo[89035]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:19 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-e58081c4-bb8a-4549-9bb0-9c8e040a8136 tempest-GroupSnapshotsTest-180858973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-097860ec-09ae-490a-9944-34c8c468483c.info" returned: 0 in 0.423s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:19 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-e58081c4-bb8a-4549-9bb0-9c8e040a8136 tempest-GroupSnapshotsTest-180858973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.074s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:11:19 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-e58081c4-bb8a-4549-9bb0-9c8e040a8136 tempest-GroupSnapshotsTest-180858973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:11:19 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-e58081c4-bb8a-4549-9bb0-9c8e040a8136 tempest-GroupSnapshotsTest-180858973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:11:19 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-e58081c4-bb8a-4549-9bb0-9c8e040a8136 tempest-GroupSnapshotsTest-180858973 None] Creating offline snapshot cf1b51df-811b-4d70-be69-de91ecbba630 of volume 6fec6821-164d-4d5f-9c74-5cb15a972243 {{(pid=82756) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 16 15:11:19 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdd6373a-8907-4707-9269-cd196fee1eb2]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:11:19 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-e58081c4-bb8a-4549-9bb0-9c8e040a8136 tempest-GroupSnapshotsTest-180858973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6fec6821-164d-4d5f-9c74-5cb15a972243 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:19 devstack sudo[89043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6fec6821-164d-4d5f-9c74-5cb15a972243 Apr 16 15:11:19 devstack sudo[89043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:19 devstack sudo[89040]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:19 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-8e62c3e1-2ca8-476c-8ff0-32561dc45063 tempest-CreateVolumesFromSnapshotTest-324767205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-1f1fef4a-d0e1-422e-b2f0-c53a1c3eb484" returned: 0 in 0.442s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:19 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-8e62c3e1-2ca8-476c-8ff0-32561dc45063 tempest-CreateVolumesFromSnapshotTest-324767205 None] Lock "cinder-quobyte-1f1fef4a-d0e1-422e-b2f0-c53a1c3eb484" released by "delete_volume" :: held 0.961s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:11:19 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-8e62c3e1-2ca8-476c-8ff0-32561dc45063 tempest-CreateVolumesFromSnapshotTest-324767205 None] Created reservations ['23da73f4-08ed-4639-93c7-1778cd99cd95', '7dd76264-7b85-475d-88bb-ce4a9b6e013c', 'd8931b14-3842-46a9-add1-9f9dca049a26', 'f120d776-060b-4044-8616-3337214dbd30'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:11:19 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-8e62c3e1-2ca8-476c-8ff0-32561dc45063 tempest-CreateVolumesFromSnapshotTest-324767205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:11:19 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-8e62c3e1-2ca8-476c-8ff0-32561dc45063 tempest-CreateVolumesFromSnapshotTest-324767205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:11:19 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-8e62c3e1-2ca8-476c-8ff0-32561dc45063 tempest-CreateVolumesFromSnapshotTest-324767205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:11:19 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-8e62c3e1-2ca8-476c-8ff0-32561dc45063 tempest-CreateVolumesFromSnapshotTest-324767205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:11:19 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-8e62c3e1-2ca8-476c-8ff0-32561dc45063 tempest-CreateVolumesFromSnapshotTest-324767205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:11:19 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-8e62c3e1-2ca8-476c-8ff0-32561dc45063 tempest-CreateVolumesFromSnapshotTest-324767205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:19 devstack sudo[89046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:11:19 devstack sudo[89046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:20 devstack sudo[89043]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:20 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-e58081c4-bb8a-4549-9bb0-9c8e040a8136 tempest-GroupSnapshotsTest-180858973 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6fec6821-164d-4d5f-9c74-5cb15a972243" returned: 0 in 0.532s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:20 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-e58081c4-bb8a-4549-9bb0-9c8e040a8136 tempest-GroupSnapshotsTest-180858973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6fec6821-164d-4d5f-9c74-5cb15a972243,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6fec6821-164d-4d5f-9c74-5cb15a972243.cf1b51df-811b-4d70-be69-de91ecbba630 1G {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:20 devstack sudo[89051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6fec6821-164d-4d5f-9c74-5cb15a972243,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6fec6821-164d-4d5f-9c74-5cb15a972243.cf1b51df-811b-4d70-be69-de91ecbba630 1G Apr 16 15:11:20 devstack sudo[89051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:20 devstack sudo[89046]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:20 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-8e62c3e1-2ca8-476c-8ff0-32561dc45063 tempest-CreateVolumesFromSnapshotTest-324767205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.427s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:20 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-8e62c3e1-2ca8-476c-8ff0-32561dc45063 tempest-CreateVolumesFromSnapshotTest-324767205 None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:11:20 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-8e62c3e1-2ca8-476c-8ff0-32561dc45063 tempest-CreateVolumesFromSnapshotTest-324767205 None] Deleted volume successfully. Apr 16 15:11:20 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-8e62c3e1-2ca8-476c-8ff0-32561dc45063 tempest-CreateVolumesFromSnapshotTest-324767205 None] Lock "cinder-1f1fef4a-d0e1-422e-b2f0-c53a1c3eb484-delete_volume" released by "delete_volume" :: held 1.553s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:11:20 devstack sudo[89051]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:20 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-e58081c4-bb8a-4549-9bb0-9c8e040a8136 tempest-GroupSnapshotsTest-180858973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6fec6821-164d-4d5f-9c74-5cb15a972243,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6fec6821-164d-4d5f-9c74-5cb15a972243.cf1b51df-811b-4d70-be69-de91ecbba630 1G" returned: 0 in 0.552s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:20 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-e58081c4-bb8a-4549-9bb0-9c8e040a8136 tempest-GroupSnapshotsTest-180858973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6fec6821-164d-4d5f-9c74-5cb15a972243 -F qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6fec6821-164d-4d5f-9c74-5cb15a972243.cf1b51df-811b-4d70-be69-de91ecbba630 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:20 devstack sudo[89057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6fec6821-164d-4d5f-9c74-5cb15a972243 -F qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6fec6821-164d-4d5f-9c74-5cb15a972243.cf1b51df-811b-4d70-be69-de91ecbba630 Apr 16 15:11:20 devstack sudo[89057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:20 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-6273a397-e9eb-422b-a346-a43baab9a0f8 tempest-CreateVolumesFromSnapshotTest-324767205 None] Acquiring lock "cinder-369807d2-e48e-42e5-840a-1cb5e791de84-delete_volume" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:11:20 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-6273a397-e9eb-422b-a346-a43baab9a0f8 tempest-CreateVolumesFromSnapshotTest-324767205 None] Lock "cinder-369807d2-e48e-42e5-840a-1cb5e791de84-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:11:20 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-6273a397-e9eb-422b-a346-a43baab9a0f8 tempest-CreateVolumesFromSnapshotTest-324767205 None] Acquiring lock "cinder-quobyte-369807d2-e48e-42e5-840a-1cb5e791de84" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:11:20 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-6273a397-e9eb-422b-a346-a43baab9a0f8 tempest-CreateVolumesFromSnapshotTest-324767205 None] Lock "cinder-quobyte-369807d2-e48e-42e5-840a-1cb5e791de84" acquired by "delete_volume" :: waited 0.010s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:11:21 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5d4d806-f13e-4286-a456-a752f0e950ea]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:11:21 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-6273a397-e9eb-422b-a346-a43baab9a0f8 tempest-CreateVolumesFromSnapshotTest-324767205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-369807d2-e48e-42e5-840a-1cb5e791de84 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:21 devstack sudo[89059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-369807d2-e48e-42e5-840a-1cb5e791de84 Apr 16 15:11:21 devstack sudo[89059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:21 devstack sudo[89057]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:21 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-e58081c4-bb8a-4549-9bb0-9c8e040a8136 tempest-GroupSnapshotsTest-180858973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6fec6821-164d-4d5f-9c74-5cb15a972243 -F qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6fec6821-164d-4d5f-9c74-5cb15a972243.cf1b51df-811b-4d70-be69-de91ecbba630" returned: 0 in 0.478s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:21 devstack cinder-volume[82756]: WARNING cinder.volume.drivers.remotefs [None req-e58081c4-bb8a-4549-9bb0-9c8e040a8136 tempest-GroupSnapshotsTest-180858973 None] /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6fec6821-164d-4d5f-9c74-5cb15a972243.cf1b51df-811b-4d70-be69-de91ecbba630 is being set with open permissions: ugo+rw: NotImplementedError Apr 16 15:11:21 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-e58081c4-bb8a-4549-9bb0-9c8e040a8136 tempest-GroupSnapshotsTest-180858973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6fec6821-164d-4d5f-9c74-5cb15a972243.cf1b51df-811b-4d70-be69-de91ecbba630 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:21 devstack sudo[89064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6fec6821-164d-4d5f-9c74-5cb15a972243.cf1b51df-811b-4d70-be69-de91ecbba630 Apr 16 15:11:21 devstack sudo[89064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:21 devstack sudo[89059]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:21 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-6273a397-e9eb-422b-a346-a43baab9a0f8 tempest-CreateVolumesFromSnapshotTest-324767205 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-369807d2-e48e-42e5-840a-1cb5e791de84" returned: 0 in 0.464s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:21 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-6273a397-e9eb-422b-a346-a43baab9a0f8 tempest-CreateVolumesFromSnapshotTest-324767205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-369807d2-e48e-42e5-840a-1cb5e791de84 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:21 devstack sudo[89069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-369807d2-e48e-42e5-840a-1cb5e791de84 Apr 16 15:11:21 devstack sudo[89069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:21 devstack sudo[89064]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:21 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-e58081c4-bb8a-4549-9bb0-9c8e040a8136 tempest-GroupSnapshotsTest-180858973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6fec6821-164d-4d5f-9c74-5cb15a972243.cf1b51df-811b-4d70-be69-de91ecbba630" returned: 0 in 0.437s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:21 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-e58081c4-bb8a-4549-9bb0-9c8e040a8136 tempest-GroupSnapshotsTest-180858973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6fec6821-164d-4d5f-9c74-5cb15a972243.info {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:21 devstack sudo[89072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6fec6821-164d-4d5f-9c74-5cb15a972243.info Apr 16 15:11:21 devstack sudo[89072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:21 devstack sudo[89069]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:21 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-6273a397-e9eb-422b-a346-a43baab9a0f8 tempest-CreateVolumesFromSnapshotTest-324767205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-369807d2-e48e-42e5-840a-1cb5e791de84" returned: 0 in 0.453s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:21 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-6273a397-e9eb-422b-a346-a43baab9a0f8 tempest-CreateVolumesFromSnapshotTest-324767205 None] Lock "cinder-quobyte-369807d2-e48e-42e5-840a-1cb5e791de84" released by "delete_volume" :: held 0.942s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:11:21 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-6273a397-e9eb-422b-a346-a43baab9a0f8 tempest-CreateVolumesFromSnapshotTest-324767205 None] Created reservations ['482d1d9a-19c8-4c58-9636-a9200501187e', 'e12f0981-75dd-4546-9275-778ad3006324', 'cc826bef-b324-4710-a7e7-db0c70b7afd7', 'd2cc09c6-a0d2-4e0c-b370-caa6f46ed391'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:11:22 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-6273a397-e9eb-422b-a346-a43baab9a0f8 tempest-CreateVolumesFromSnapshotTest-324767205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:11:22 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-6273a397-e9eb-422b-a346-a43baab9a0f8 tempest-CreateVolumesFromSnapshotTest-324767205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:11:22 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-6273a397-e9eb-422b-a346-a43baab9a0f8 tempest-CreateVolumesFromSnapshotTest-324767205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:11:22 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-6273a397-e9eb-422b-a346-a43baab9a0f8 tempest-CreateVolumesFromSnapshotTest-324767205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:11:22 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-6273a397-e9eb-422b-a346-a43baab9a0f8 tempest-CreateVolumesFromSnapshotTest-324767205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:11:22 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-6273a397-e9eb-422b-a346-a43baab9a0f8 tempest-CreateVolumesFromSnapshotTest-324767205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:22 devstack sudo[89076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:11:22 devstack sudo[89076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:22 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-811cdd79-ea3e-42f5-9cdc-a1884dbbd639 tempest-CreateVolumesFromSnapshotTest-324767205 None] Acquiring lock "cinder-663b8f52-385a-4cc0-a902-c329ea8bea1c-delete_volume" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:11:22 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-811cdd79-ea3e-42f5-9cdc-a1884dbbd639 tempest-CreateVolumesFromSnapshotTest-324767205 None] Lock "cinder-663b8f52-385a-4cc0-a902-c329ea8bea1c-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:11:22 devstack sudo[89072]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:22 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-e58081c4-bb8a-4549-9bb0-9c8e040a8136 tempest-GroupSnapshotsTest-180858973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6fec6821-164d-4d5f-9c74-5cb15a972243.info" returned: 0 in 0.462s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:22 devstack cinder-volume[82756]: WARNING cinder.volume.drivers.remotefs [None req-e58081c4-bb8a-4549-9bb0-9c8e040a8136 tempest-GroupSnapshotsTest-180858973 None] /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6fec6821-164d-4d5f-9c74-5cb15a972243.info is being set with open permissions: ugo+rw: NotImplementedError Apr 16 15:11:22 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-e58081c4-bb8a-4549-9bb0-9c8e040a8136 tempest-GroupSnapshotsTest-180858973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6fec6821-164d-4d5f-9c74-5cb15a972243.info {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:22 devstack sudo[89078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6fec6821-164d-4d5f-9c74-5cb15a972243.info Apr 16 15:11:22 devstack sudo[89078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:22 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-811cdd79-ea3e-42f5-9cdc-a1884dbbd639 tempest-CreateVolumesFromSnapshotTest-324767205 None] Acquiring lock "cinder-quobyte-663b8f52-385a-4cc0-a902-c329ea8bea1c" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:11:22 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-811cdd79-ea3e-42f5-9cdc-a1884dbbd639 tempest-CreateVolumesFromSnapshotTest-324767205 None] Lock "cinder-quobyte-663b8f52-385a-4cc0-a902-c329ea8bea1c" acquired by "delete_volume" :: waited 0.008s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:11:22 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfc4c77c-ebbb-4fd7-a4f4-ffdf64a6e55c]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:11:22 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-811cdd79-ea3e-42f5-9cdc-a1884dbbd639 tempest-CreateVolumesFromSnapshotTest-324767205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-663b8f52-385a-4cc0-a902-c329ea8bea1c {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:22 devstack sudo[89080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-663b8f52-385a-4cc0-a902-c329ea8bea1c Apr 16 15:11:22 devstack sudo[89080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:22 devstack sudo[89078]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:22 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-e58081c4-bb8a-4549-9bb0-9c8e040a8136 tempest-GroupSnapshotsTest-180858973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6fec6821-164d-4d5f-9c74-5cb15a972243.info" returned: 0 in 0.424s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:22 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-e58081c4-bb8a-4549-9bb0-9c8e040a8136 tempest-GroupSnapshotsTest-180858973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.973s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:11:22 devstack sudo[89076]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:22 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-6273a397-e9eb-422b-a346-a43baab9a0f8 tempest-CreateVolumesFromSnapshotTest-324767205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.528s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:22 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-6273a397-e9eb-422b-a346-a43baab9a0f8 tempest-CreateVolumesFromSnapshotTest-324767205 None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:11:22 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-6273a397-e9eb-422b-a346-a43baab9a0f8 tempest-CreateVolumesFromSnapshotTest-324767205 None] Deleted volume successfully. Apr 16 15:11:22 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-6273a397-e9eb-422b-a346-a43baab9a0f8 tempest-CreateVolumesFromSnapshotTest-324767205 None] Lock "cinder-369807d2-e48e-42e5-840a-1cb5e791de84-delete_volume" released by "delete_volume" :: held 1.637s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:11:22 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-e58081c4-bb8a-4549-9bb0-9c8e040a8136 tempest-GroupSnapshotsTest-180858973 None] group_snapshot a88f525f-35be-4383-aae4-b4a2f9fda656: created successfully Apr 16 15:11:22 devstack sudo[89080]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:22 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-811cdd79-ea3e-42f5-9cdc-a1884dbbd639 tempest-CreateVolumesFromSnapshotTest-324767205 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-663b8f52-385a-4cc0-a902-c329ea8bea1c" returned: 0 in 0.546s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:22 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-811cdd79-ea3e-42f5-9cdc-a1884dbbd639 tempest-CreateVolumesFromSnapshotTest-324767205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-663b8f52-385a-4cc0-a902-c329ea8bea1c {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:22 devstack sudo[89087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-663b8f52-385a-4cc0-a902-c329ea8bea1c Apr 16 15:11:22 devstack sudo[89087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:22 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-b6af655b-e005-4ef6-90b5-500ef6ea573b tempest-GroupSnapshotsTest-180858973 None] group_snapshot a88f525f-35be-4383-aae4-b4a2f9fda656: deleting Apr 16 15:11:22 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-b6af655b-e005-4ef6-90b5-500ef6ea573b tempest-GroupSnapshotsTest-180858973 None] group_snapshot a88f525f-35be-4383-aae4-b4a2f9fda656: deleting {{(pid=82756) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 16 15:11:22 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-b6af655b-e005-4ef6-90b5-500ef6ea573b tempest-GroupSnapshotsTest-180858973 None] Acquiring lock "cinder-quobyte-097860ec-09ae-490a-9944-34c8c468483c" by "delete_snapshot" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:11:22 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-b6af655b-e005-4ef6-90b5-500ef6ea573b tempest-GroupSnapshotsTest-180858973 None] Lock "cinder-quobyte-097860ec-09ae-490a-9944-34c8c468483c" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:11:22 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-b6af655b-e005-4ef6-90b5-500ef6ea573b tempest-GroupSnapshotsTest-180858973 None] Acquiring lock "cinder-quobyte-9c802c6d-5503-4bea-a63e-dbeac0cca171" by "_delete_snapshot" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:11:22 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-b6af655b-e005-4ef6-90b5-500ef6ea573b tempest-GroupSnapshotsTest-180858973 None] Lock "cinder-quobyte-9c802c6d-5503-4bea-a63e-dbeac0cca171" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:11:22 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-b6af655b-e005-4ef6-90b5-500ef6ea573b tempest-GroupSnapshotsTest-180858973 None] Deleting offline snapshot 9c802c6d-5503-4bea-a63e-dbeac0cca171 of volume 097860ec-09ae-490a-9944-34c8c468483c {{(pid=82756) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 15:11:22 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-b6af655b-e005-4ef6-90b5-500ef6ea573b tempest-GroupSnapshotsTest-180858973 None] snapshot_file for this snap is: volume-097860ec-09ae-490a-9944-34c8c468483c.9c802c6d-5503-4bea-a63e-dbeac0cca171 {{(pid=82756) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 15:11:22 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a51bcf9-9aec-4dd2-a611-24bb3cb26f15]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:11:22 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-b6af655b-e005-4ef6-90b5-500ef6ea573b tempest-GroupSnapshotsTest-180858973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-097860ec-09ae-490a-9944-34c8c468483c.9c802c6d-5503-4bea-a63e-dbeac0cca171 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:23 devstack sudo[89089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-097860ec-09ae-490a-9944-34c8c468483c.9c802c6d-5503-4bea-a63e-dbeac0cca171 Apr 16 15:11:23 devstack sudo[89089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:23 devstack sudo[89087]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:23 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-811cdd79-ea3e-42f5-9cdc-a1884dbbd639 tempest-CreateVolumesFromSnapshotTest-324767205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-663b8f52-385a-4cc0-a902-c329ea8bea1c" returned: 0 in 0.501s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:23 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-811cdd79-ea3e-42f5-9cdc-a1884dbbd639 tempest-CreateVolumesFromSnapshotTest-324767205 None] Lock "cinder-quobyte-663b8f52-385a-4cc0-a902-c329ea8bea1c" released by "delete_volume" :: held 1.071s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:11:23 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-811cdd79-ea3e-42f5-9cdc-a1884dbbd639 tempest-CreateVolumesFromSnapshotTest-324767205 None] Created reservations ['c1ed935f-9a11-4104-b65a-646ecd36950a', '00292eec-7b83-4b15-9c3f-d53cb894b83f', 'a651ed59-e3c5-4064-b321-1818843d27a2', '62f53a31-e0c6-42aa-b741-1b5d70945b5b'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:11:23 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-811cdd79-ea3e-42f5-9cdc-a1884dbbd639 tempest-CreateVolumesFromSnapshotTest-324767205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:11:23 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-811cdd79-ea3e-42f5-9cdc-a1884dbbd639 tempest-CreateVolumesFromSnapshotTest-324767205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:11:23 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-811cdd79-ea3e-42f5-9cdc-a1884dbbd639 tempest-CreateVolumesFromSnapshotTest-324767205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:11:23 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-811cdd79-ea3e-42f5-9cdc-a1884dbbd639 tempest-CreateVolumesFromSnapshotTest-324767205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:11:23 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-811cdd79-ea3e-42f5-9cdc-a1884dbbd639 tempest-CreateVolumesFromSnapshotTest-324767205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:11:23 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-811cdd79-ea3e-42f5-9cdc-a1884dbbd639 tempest-CreateVolumesFromSnapshotTest-324767205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:23 devstack sudo[89092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:11:23 devstack sudo[89092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:23 devstack sudo[89089]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:23 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-b6af655b-e005-4ef6-90b5-500ef6ea573b tempest-GroupSnapshotsTest-180858973 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-097860ec-09ae-490a-9944-34c8c468483c.9c802c6d-5503-4bea-a63e-dbeac0cca171" returned: 0 in 0.564s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:23 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-b6af655b-e005-4ef6-90b5-500ef6ea573b tempest-GroupSnapshotsTest-180858973 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-097860ec-09ae-490a-9944-34c8c468483c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82756) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 15:11:23 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[66183e4a-952c-416f-bd68-84d5805ce8fa]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:11:23 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-b6af655b-e005-4ef6-90b5-500ef6ea573b tempest-GroupSnapshotsTest-180858973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-097860ec-09ae-490a-9944-34c8c468483c {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:23 devstack sudo[89098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-097860ec-09ae-490a-9944-34c8c468483c Apr 16 15:11:23 devstack sudo[89098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:23 devstack sudo[89092]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:23 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-811cdd79-ea3e-42f5-9cdc-a1884dbbd639 tempest-CreateVolumesFromSnapshotTest-324767205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.427s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:23 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-811cdd79-ea3e-42f5-9cdc-a1884dbbd639 tempest-CreateVolumesFromSnapshotTest-324767205 None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:11:23 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-811cdd79-ea3e-42f5-9cdc-a1884dbbd639 tempest-CreateVolumesFromSnapshotTest-324767205 None] Deleted volume successfully. Apr 16 15:11:23 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-811cdd79-ea3e-42f5-9cdc-a1884dbbd639 tempest-CreateVolumesFromSnapshotTest-324767205 None] Lock "cinder-663b8f52-385a-4cc0-a902-c329ea8bea1c-delete_volume" released by "delete_volume" :: held 1.676s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:11:24 devstack sudo[89098]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:24 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-b6af655b-e005-4ef6-90b5-500ef6ea573b tempest-GroupSnapshotsTest-180858973 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-097860ec-09ae-490a-9944-34c8c468483c" returned: 0 in 0.500s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:24 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-b6af655b-e005-4ef6-90b5-500ef6ea573b tempest-GroupSnapshotsTest-180858973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-097860ec-09ae-490a-9944-34c8c468483c.9c802c6d-5503-4bea-a63e-dbeac0cca171 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:24 devstack sudo[89104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-097860ec-09ae-490a-9944-34c8c468483c.9c802c6d-5503-4bea-a63e-dbeac0cca171 Apr 16 15:11:24 devstack sudo[89104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:24 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-1b25fc99-af16-4cf9-86d9-f7910a612397 tempest-CreateVolumesFromSnapshotTest-324767205 None] Acquiring lock "cinder-3c9d39f4-e67e-414b-8ed8-64095d99133d-delete_snapshot" by "delete_snapshot" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:11:24 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-1b25fc99-af16-4cf9-86d9-f7910a612397 tempest-CreateVolumesFromSnapshotTest-324767205 None] Lock "cinder-3c9d39f4-e67e-414b-8ed8-64095d99133d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:11:24 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-1b25fc99-af16-4cf9-86d9-f7910a612397 tempest-CreateVolumesFromSnapshotTest-324767205 None] Acquiring lock "cinder-quobyte-9507fe66-6de6-40f6-98e7-0177919afd91" by "delete_snapshot" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:11:24 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-1b25fc99-af16-4cf9-86d9-f7910a612397 tempest-CreateVolumesFromSnapshotTest-324767205 None] Lock "cinder-quobyte-9507fe66-6de6-40f6-98e7-0177919afd91" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:11:24 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-1b25fc99-af16-4cf9-86d9-f7910a612397 tempest-CreateVolumesFromSnapshotTest-324767205 None] Acquiring lock "cinder-quobyte-3c9d39f4-e67e-414b-8ed8-64095d99133d" by "_delete_snapshot" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:11:24 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-1b25fc99-af16-4cf9-86d9-f7910a612397 tempest-CreateVolumesFromSnapshotTest-324767205 None] Lock "cinder-quobyte-3c9d39f4-e67e-414b-8ed8-64095d99133d" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:11:24 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-1b25fc99-af16-4cf9-86d9-f7910a612397 tempest-CreateVolumesFromSnapshotTest-324767205 None] Deleting offline snapshot 3c9d39f4-e67e-414b-8ed8-64095d99133d of volume 9507fe66-6de6-40f6-98e7-0177919afd91 {{(pid=82756) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 15:11:24 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-1b25fc99-af16-4cf9-86d9-f7910a612397 tempest-CreateVolumesFromSnapshotTest-324767205 None] snapshot_file for this snap is: volume-9507fe66-6de6-40f6-98e7-0177919afd91.3c9d39f4-e67e-414b-8ed8-64095d99133d {{(pid=82756) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 15:11:24 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[37c5c12e-95e3-40d7-9c28-ac55f8ee8597]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:11:24 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-1b25fc99-af16-4cf9-86d9-f7910a612397 tempest-CreateVolumesFromSnapshotTest-324767205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-9507fe66-6de6-40f6-98e7-0177919afd91.3c9d39f4-e67e-414b-8ed8-64095d99133d {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:24 devstack sudo[89106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-9507fe66-6de6-40f6-98e7-0177919afd91.3c9d39f4-e67e-414b-8ed8-64095d99133d Apr 16 15:11:24 devstack sudo[89106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:24 devstack sudo[89104]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:24 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-b6af655b-e005-4ef6-90b5-500ef6ea573b tempest-GroupSnapshotsTest-180858973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-097860ec-09ae-490a-9944-34c8c468483c.9c802c6d-5503-4bea-a63e-dbeac0cca171" returned: 0 in 0.535s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:24 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-b6af655b-e005-4ef6-90b5-500ef6ea573b tempest-GroupSnapshotsTest-180858973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-097860ec-09ae-490a-9944-34c8c468483c.9c802c6d-5503-4bea-a63e-dbeac0cca171 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:24 devstack sudo[89111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-097860ec-09ae-490a-9944-34c8c468483c.9c802c6d-5503-4bea-a63e-dbeac0cca171 Apr 16 15:11:24 devstack sudo[89111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:24 devstack sudo[89106]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:24 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-1b25fc99-af16-4cf9-86d9-f7910a612397 tempest-CreateVolumesFromSnapshotTest-324767205 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-9507fe66-6de6-40f6-98e7-0177919afd91.3c9d39f4-e67e-414b-8ed8-64095d99133d" returned: 0 in 0.568s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:24 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-1b25fc99-af16-4cf9-86d9-f7910a612397 tempest-CreateVolumesFromSnapshotTest-324767205 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9507fe66-6de6-40f6-98e7-0177919afd91(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82756) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 15:11:24 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[126e8c8c-a3da-4baf-b091-c0a7a226249d]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:11:24 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-1b25fc99-af16-4cf9-86d9-f7910a612397 tempest-CreateVolumesFromSnapshotTest-324767205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-9507fe66-6de6-40f6-98e7-0177919afd91 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:24 devstack sudo[89116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-9507fe66-6de6-40f6-98e7-0177919afd91 Apr 16 15:11:24 devstack sudo[89116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:25 devstack sudo[89111]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:25 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-b6af655b-e005-4ef6-90b5-500ef6ea573b tempest-GroupSnapshotsTest-180858973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-097860ec-09ae-490a-9944-34c8c468483c.9c802c6d-5503-4bea-a63e-dbeac0cca171" returned: 0 in 0.460s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:25 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-b6af655b-e005-4ef6-90b5-500ef6ea573b tempest-GroupSnapshotsTest-180858973 None] Lock "cinder-quobyte-9c802c6d-5503-4bea-a63e-dbeac0cca171" released by "_delete_snapshot" :: held 2.117s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:11:25 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-b6af655b-e005-4ef6-90b5-500ef6ea573b tempest-GroupSnapshotsTest-180858973 None] Lock "cinder-quobyte-097860ec-09ae-490a-9944-34c8c468483c" released by "delete_snapshot" :: held 2.132s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:11:25 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-b6af655b-e005-4ef6-90b5-500ef6ea573b tempest-GroupSnapshotsTest-180858973 None] Acquiring lock "cinder-quobyte-6fec6821-164d-4d5f-9c74-5cb15a972243" by "delete_snapshot" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:11:25 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-b6af655b-e005-4ef6-90b5-500ef6ea573b tempest-GroupSnapshotsTest-180858973 None] Lock "cinder-quobyte-6fec6821-164d-4d5f-9c74-5cb15a972243" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:11:25 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-b6af655b-e005-4ef6-90b5-500ef6ea573b tempest-GroupSnapshotsTest-180858973 None] Acquiring lock "cinder-quobyte-cf1b51df-811b-4d70-be69-de91ecbba630" by "_delete_snapshot" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:11:25 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-b6af655b-e005-4ef6-90b5-500ef6ea573b tempest-GroupSnapshotsTest-180858973 None] Lock "cinder-quobyte-cf1b51df-811b-4d70-be69-de91ecbba630" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:11:25 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-b6af655b-e005-4ef6-90b5-500ef6ea573b tempest-GroupSnapshotsTest-180858973 None] Deleting offline snapshot cf1b51df-811b-4d70-be69-de91ecbba630 of volume 6fec6821-164d-4d5f-9c74-5cb15a972243 {{(pid=82756) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 15:11:25 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-b6af655b-e005-4ef6-90b5-500ef6ea573b tempest-GroupSnapshotsTest-180858973 None] snapshot_file for this snap is: volume-6fec6821-164d-4d5f-9c74-5cb15a972243.cf1b51df-811b-4d70-be69-de91ecbba630 {{(pid=82756) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 15:11:25 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ce01fc2-a077-4070-9573-832aa324f78b]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:11:25 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-b6af655b-e005-4ef6-90b5-500ef6ea573b tempest-GroupSnapshotsTest-180858973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6fec6821-164d-4d5f-9c74-5cb15a972243.cf1b51df-811b-4d70-be69-de91ecbba630 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:25 devstack sudo[89119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6fec6821-164d-4d5f-9c74-5cb15a972243.cf1b51df-811b-4d70-be69-de91ecbba630 Apr 16 15:11:25 devstack sudo[89119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:25 devstack sudo[89116]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:25 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-1b25fc99-af16-4cf9-86d9-f7910a612397 tempest-CreateVolumesFromSnapshotTest-324767205 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-9507fe66-6de6-40f6-98e7-0177919afd91" returned: 0 in 0.481s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:25 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-1b25fc99-af16-4cf9-86d9-f7910a612397 tempest-CreateVolumesFromSnapshotTest-324767205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-9507fe66-6de6-40f6-98e7-0177919afd91.3c9d39f4-e67e-414b-8ed8-64095d99133d {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:25 devstack sudo[89124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-9507fe66-6de6-40f6-98e7-0177919afd91.3c9d39f4-e67e-414b-8ed8-64095d99133d Apr 16 15:11:25 devstack sudo[89124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:25 devstack sudo[89119]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:25 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-b6af655b-e005-4ef6-90b5-500ef6ea573b tempest-GroupSnapshotsTest-180858973 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6fec6821-164d-4d5f-9c74-5cb15a972243.cf1b51df-811b-4d70-be69-de91ecbba630" returned: 0 in 0.507s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:25 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-b6af655b-e005-4ef6-90b5-500ef6ea573b tempest-GroupSnapshotsTest-180858973 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6fec6821-164d-4d5f-9c74-5cb15a972243(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82756) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 15:11:25 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab0bf44b-d15d-4fcf-85a9-0aeb4c7581ba]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:11:25 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-b6af655b-e005-4ef6-90b5-500ef6ea573b tempest-GroupSnapshotsTest-180858973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6fec6821-164d-4d5f-9c74-5cb15a972243 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:25 devstack sudo[89129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6fec6821-164d-4d5f-9c74-5cb15a972243 Apr 16 15:11:25 devstack sudo[89129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:25 devstack sudo[89124]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:25 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-1b25fc99-af16-4cf9-86d9-f7910a612397 tempest-CreateVolumesFromSnapshotTest-324767205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-9507fe66-6de6-40f6-98e7-0177919afd91.3c9d39f4-e67e-414b-8ed8-64095d99133d" returned: 0 in 0.445s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:25 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-1b25fc99-af16-4cf9-86d9-f7910a612397 tempest-CreateVolumesFromSnapshotTest-324767205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-9507fe66-6de6-40f6-98e7-0177919afd91.3c9d39f4-e67e-414b-8ed8-64095d99133d {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:25 devstack sudo[89134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-9507fe66-6de6-40f6-98e7-0177919afd91.3c9d39f4-e67e-414b-8ed8-64095d99133d Apr 16 15:11:25 devstack sudo[89134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:26 devstack sudo[89129]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:26 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-b6af655b-e005-4ef6-90b5-500ef6ea573b tempest-GroupSnapshotsTest-180858973 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6fec6821-164d-4d5f-9c74-5cb15a972243" returned: 0 in 0.491s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:26 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-b6af655b-e005-4ef6-90b5-500ef6ea573b tempest-GroupSnapshotsTest-180858973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6fec6821-164d-4d5f-9c74-5cb15a972243.cf1b51df-811b-4d70-be69-de91ecbba630 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:26 devstack sudo[89140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6fec6821-164d-4d5f-9c74-5cb15a972243.cf1b51df-811b-4d70-be69-de91ecbba630 Apr 16 15:11:26 devstack sudo[89140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:26 devstack sudo[89134]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:26 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-1b25fc99-af16-4cf9-86d9-f7910a612397 tempest-CreateVolumesFromSnapshotTest-324767205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-9507fe66-6de6-40f6-98e7-0177919afd91.3c9d39f4-e67e-414b-8ed8-64095d99133d" returned: 0 in 0.446s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:26 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-1b25fc99-af16-4cf9-86d9-f7910a612397 tempest-CreateVolumesFromSnapshotTest-324767205 None] Lock "cinder-quobyte-3c9d39f4-e67e-414b-8ed8-64095d99133d" released by "_delete_snapshot" :: held 2.005s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:11:26 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-1b25fc99-af16-4cf9-86d9-f7910a612397 tempest-CreateVolumesFromSnapshotTest-324767205 None] Lock "cinder-quobyte-9507fe66-6de6-40f6-98e7-0177919afd91" released by "delete_snapshot" :: held 2.024s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:11:26 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-1b25fc99-af16-4cf9-86d9-f7910a612397 tempest-CreateVolumesFromSnapshotTest-324767205 None] Created reservations ['3a5aa8a4-d647-44cf-a758-ea53debedbac', '2bfa0838-3b0e-4666-bef0-55589fb74e05', 'aac2f08f-d1ff-493a-add5-0e7a15de7548', '809cd7dc-c61c-44be-b99d-996a02451f29'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:11:26 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-1b25fc99-af16-4cf9-86d9-f7910a612397 tempest-CreateVolumesFromSnapshotTest-324767205 None] Delete snapshot completed successfully. Apr 16 15:11:26 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-1b25fc99-af16-4cf9-86d9-f7910a612397 tempest-CreateVolumesFromSnapshotTest-324767205 None] Lock "cinder-3c9d39f4-e67e-414b-8ed8-64095d99133d-delete_snapshot" released by "delete_snapshot" :: held 2.111s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:11:26 devstack sudo[89140]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:26 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-b6af655b-e005-4ef6-90b5-500ef6ea573b tempest-GroupSnapshotsTest-180858973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6fec6821-164d-4d5f-9c74-5cb15a972243.cf1b51df-811b-4d70-be69-de91ecbba630" returned: 0 in 0.469s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:26 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-b6af655b-e005-4ef6-90b5-500ef6ea573b tempest-GroupSnapshotsTest-180858973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6fec6821-164d-4d5f-9c74-5cb15a972243.cf1b51df-811b-4d70-be69-de91ecbba630 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:26 devstack sudo[89146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6fec6821-164d-4d5f-9c74-5cb15a972243.cf1b51df-811b-4d70-be69-de91ecbba630 Apr 16 15:11:26 devstack sudo[89146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:26 devstack sudo[89146]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:26 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-b6af655b-e005-4ef6-90b5-500ef6ea573b tempest-GroupSnapshotsTest-180858973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6fec6821-164d-4d5f-9c74-5cb15a972243.cf1b51df-811b-4d70-be69-de91ecbba630" returned: 0 in 0.413s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:27 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-b6af655b-e005-4ef6-90b5-500ef6ea573b tempest-GroupSnapshotsTest-180858973 None] Lock "cinder-quobyte-cf1b51df-811b-4d70-be69-de91ecbba630" released by "_delete_snapshot" :: held 1.927s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:11:27 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-b6af655b-e005-4ef6-90b5-500ef6ea573b tempest-GroupSnapshotsTest-180858973 None] Lock "cinder-quobyte-6fec6821-164d-4d5f-9c74-5cb15a972243" released by "delete_snapshot" :: held 1.942s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:11:27 devstack cinder-volume[82756]: WARNING cinder.quota [None req-b6af655b-e005-4ef6-90b5-500ef6ea573b tempest-GroupSnapshotsTest-180858973 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-343426821 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-343426821, it is now deprecated. Please use the default quota class for default quota. Apr 16 15:11:27 devstack cinder-volume[82756]: WARNING cinder.quota [None req-b6af655b-e005-4ef6-90b5-500ef6ea573b tempest-GroupSnapshotsTest-180858973 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-343426821 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-343426821, it is now deprecated. Please use the default quota class for default quota. Apr 16 15:11:27 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-b6af655b-e005-4ef6-90b5-500ef6ea573b tempest-GroupSnapshotsTest-180858973 None] Created reservations ['f9755635-1baf-4e16-a56a-7a53148639b9', '75e93baf-63f7-4cb8-895a-cae106e8b32b', 'c909e699-a65b-41c4-99a4-668b32eedf79', '082145a0-1fa0-4567-93ae-85c19009f804'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:11:27 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-b6af655b-e005-4ef6-90b5-500ef6ea573b tempest-GroupSnapshotsTest-180858973 None] Created reservations ['a06ae8a2-900f-4703-aa54-6f0f02f3ffd3', '2a1e66e1-5a7a-468b-832a-dc79a38b9581', '6a06e774-b951-4ea2-9dfb-b190e8dfec1a', 'ee30303e-6701-44c4-8f52-de5468206656'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:11:27 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-b6af655b-e005-4ef6-90b5-500ef6ea573b tempest-GroupSnapshotsTest-180858973 None] group_snapshot a88f525f-35be-4383-aae4-b4a2f9fda656: deleted successfully Apr 16 15:11:27 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-65983aaf-83f6-4082-83bf-b7fa0944147a tempest-CreateVolumesFromSnapshotTest-324767205 None] Acquiring lock "cinder-9507fe66-6de6-40f6-98e7-0177919afd91-delete_volume" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:11:27 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-65983aaf-83f6-4082-83bf-b7fa0944147a tempest-CreateVolumesFromSnapshotTest-324767205 None] Lock "cinder-9507fe66-6de6-40f6-98e7-0177919afd91-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:11:27 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-65983aaf-83f6-4082-83bf-b7fa0944147a tempest-CreateVolumesFromSnapshotTest-324767205 None] Acquiring lock "cinder-quobyte-9507fe66-6de6-40f6-98e7-0177919afd91" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:11:27 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-65983aaf-83f6-4082-83bf-b7fa0944147a tempest-CreateVolumesFromSnapshotTest-324767205 None] Lock "cinder-quobyte-9507fe66-6de6-40f6-98e7-0177919afd91" acquired by "delete_volume" :: waited 0.012s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:11:27 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3591551-6f35-4f5b-ad22-05d4b6c2e64b]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:11:27 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-65983aaf-83f6-4082-83bf-b7fa0944147a tempest-CreateVolumesFromSnapshotTest-324767205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-9507fe66-6de6-40f6-98e7-0177919afd91 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:27 devstack sudo[89149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-9507fe66-6de6-40f6-98e7-0177919afd91 Apr 16 15:11:27 devstack sudo[89149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:27 devstack sudo[89149]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:27 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-65983aaf-83f6-4082-83bf-b7fa0944147a tempest-CreateVolumesFromSnapshotTest-324767205 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-9507fe66-6de6-40f6-98e7-0177919afd91" returned: 0 in 0.463s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:27 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-65983aaf-83f6-4082-83bf-b7fa0944147a tempest-CreateVolumesFromSnapshotTest-324767205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-9507fe66-6de6-40f6-98e7-0177919afd91 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:27 devstack sudo[89154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-9507fe66-6de6-40f6-98e7-0177919afd91 Apr 16 15:11:27 devstack sudo[89154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:28 devstack sudo[89154]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:28 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-65983aaf-83f6-4082-83bf-b7fa0944147a tempest-CreateVolumesFromSnapshotTest-324767205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-9507fe66-6de6-40f6-98e7-0177919afd91" returned: 0 in 0.464s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:28 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-65983aaf-83f6-4082-83bf-b7fa0944147a tempest-CreateVolumesFromSnapshotTest-324767205 None] Lock "cinder-quobyte-9507fe66-6de6-40f6-98e7-0177919afd91" released by "delete_volume" :: held 0.965s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:11:28 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-2d6ca45a-ef9b-400f-a979-a4c0488482bc tempest-GroupSnapshotsTest-180858973 None] Acquiring lock "cinder-quobyte-097860ec-09ae-490a-9944-34c8c468483c" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:11:28 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-2d6ca45a-ef9b-400f-a979-a4c0488482bc tempest-GroupSnapshotsTest-180858973 None] Lock "cinder-quobyte-097860ec-09ae-490a-9944-34c8c468483c" acquired by "delete_volume" :: waited 0.014s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:11:28 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[b84186c0-fd14-4e1f-a3f8-e39e06f6585f]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:11:28 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-2d6ca45a-ef9b-400f-a979-a4c0488482bc tempest-GroupSnapshotsTest-180858973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-097860ec-09ae-490a-9944-34c8c468483c {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:28 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-65983aaf-83f6-4082-83bf-b7fa0944147a tempest-CreateVolumesFromSnapshotTest-324767205 None] Created reservations ['abac0be7-d746-46c3-8101-b3a534318c3d', 'cf66348e-a2da-4f70-be05-436c2aaa5679', 'af01cbb5-edd5-47b4-ad20-8d50dd6f05fb', '507cdcbd-12e9-439a-8cf8-5d0871a45b3a'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:11:28 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-65983aaf-83f6-4082-83bf-b7fa0944147a tempest-CreateVolumesFromSnapshotTest-324767205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:11:28 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-65983aaf-83f6-4082-83bf-b7fa0944147a tempest-CreateVolumesFromSnapshotTest-324767205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:11:28 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-65983aaf-83f6-4082-83bf-b7fa0944147a tempest-CreateVolumesFromSnapshotTest-324767205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:11:28 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-65983aaf-83f6-4082-83bf-b7fa0944147a tempest-CreateVolumesFromSnapshotTest-324767205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:11:28 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-65983aaf-83f6-4082-83bf-b7fa0944147a tempest-CreateVolumesFromSnapshotTest-324767205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:11:28 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-65983aaf-83f6-4082-83bf-b7fa0944147a tempest-CreateVolumesFromSnapshotTest-324767205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:28 devstack sudo[89157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-097860ec-09ae-490a-9944-34c8c468483c Apr 16 15:11:28 devstack sudo[89157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:28 devstack sudo[89159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:11:28 devstack sudo[89159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:28 devstack sudo[89157]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:28 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-2d6ca45a-ef9b-400f-a979-a4c0488482bc tempest-GroupSnapshotsTest-180858973 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-097860ec-09ae-490a-9944-34c8c468483c" returned: 0 in 0.474s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:28 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-2d6ca45a-ef9b-400f-a979-a4c0488482bc tempest-GroupSnapshotsTest-180858973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-097860ec-09ae-490a-9944-34c8c468483c {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:28 devstack sudo[89165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-097860ec-09ae-490a-9944-34c8c468483c Apr 16 15:11:28 devstack sudo[89165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:28 devstack sudo[89159]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:28 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-65983aaf-83f6-4082-83bf-b7fa0944147a tempest-CreateVolumesFromSnapshotTest-324767205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.441s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:28 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-65983aaf-83f6-4082-83bf-b7fa0944147a tempest-CreateVolumesFromSnapshotTest-324767205 None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:11:28 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-65983aaf-83f6-4082-83bf-b7fa0944147a tempest-CreateVolumesFromSnapshotTest-324767205 None] Deleted volume successfully. Apr 16 15:11:29 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-65983aaf-83f6-4082-83bf-b7fa0944147a tempest-CreateVolumesFromSnapshotTest-324767205 None] Lock "cinder-9507fe66-6de6-40f6-98e7-0177919afd91-delete_volume" released by "delete_volume" :: held 1.585s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:11:29 devstack sudo[89165]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:29 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-2d6ca45a-ef9b-400f-a979-a4c0488482bc tempest-GroupSnapshotsTest-180858973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-097860ec-09ae-490a-9944-34c8c468483c" returned: 0 in 0.394s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:29 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-2d6ca45a-ef9b-400f-a979-a4c0488482bc tempest-GroupSnapshotsTest-180858973 None] Lock "cinder-quobyte-097860ec-09ae-490a-9944-34c8c468483c" released by "delete_volume" :: held 0.897s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:11:29 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-2d6ca45a-ef9b-400f-a979-a4c0488482bc tempest-GroupSnapshotsTest-180858973 None] Acquiring lock "cinder-quobyte-6fec6821-164d-4d5f-9c74-5cb15a972243" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:11:29 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-2d6ca45a-ef9b-400f-a979-a4c0488482bc tempest-GroupSnapshotsTest-180858973 None] Lock "cinder-quobyte-6fec6821-164d-4d5f-9c74-5cb15a972243" acquired by "delete_volume" :: waited 0.006s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:11:29 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[44afe00f-11fa-4373-8079-35a23fb1a685]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:11:29 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-2d6ca45a-ef9b-400f-a979-a4c0488482bc tempest-GroupSnapshotsTest-180858973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6fec6821-164d-4d5f-9c74-5cb15a972243 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:29 devstack sudo[89168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6fec6821-164d-4d5f-9c74-5cb15a972243 Apr 16 15:11:29 devstack sudo[89168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:29 devstack sudo[89168]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:29 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-2d6ca45a-ef9b-400f-a979-a4c0488482bc tempest-GroupSnapshotsTest-180858973 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6fec6821-164d-4d5f-9c74-5cb15a972243" returned: 0 in 0.510s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:29 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-2d6ca45a-ef9b-400f-a979-a4c0488482bc tempest-GroupSnapshotsTest-180858973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6fec6821-164d-4d5f-9c74-5cb15a972243 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:29 devstack sudo[89173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6fec6821-164d-4d5f-9c74-5cb15a972243 Apr 16 15:11:29 devstack sudo[89173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:30 devstack sudo[89173]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:30 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-2d6ca45a-ef9b-400f-a979-a4c0488482bc tempest-GroupSnapshotsTest-180858973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6fec6821-164d-4d5f-9c74-5cb15a972243" returned: 0 in 0.479s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:30 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-2d6ca45a-ef9b-400f-a979-a4c0488482bc tempest-GroupSnapshotsTest-180858973 None] Lock "cinder-quobyte-6fec6821-164d-4d5f-9c74-5cb15a972243" released by "delete_volume" :: held 1.017s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:11:30 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-2d6ca45a-ef9b-400f-a979-a4c0488482bc tempest-GroupSnapshotsTest-180858973 None] Created reservations ['411fcae6-8b59-4048-9278-b84c828814f9'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:11:30 devstack cinder-volume[82756]: WARNING cinder.quota [None req-2d6ca45a-ef9b-400f-a979-a4c0488482bc tempest-GroupSnapshotsTest-180858973 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-343426821 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-343426821, it is now deprecated. Please use the default quota class for default quota. Apr 16 15:11:30 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-2d6ca45a-ef9b-400f-a979-a4c0488482bc tempest-GroupSnapshotsTest-180858973 None] Created reservations ['2034fa3b-dd81-4723-8cff-54c575905588', '5f9295f7-8ada-4873-b8b1-370ab9112030', 'cb51e117-4b3f-45e2-a5e0-1199d592a7df', '406c07ea-19e3-4bb9-9bcf-950ca5eeb6a7'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:11:30 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-2d6ca45a-ef9b-400f-a979-a4c0488482bc tempest-GroupSnapshotsTest-180858973 None] Created reservations ['51b2aa37-1311-4a6f-8849-bac85be9b5b6', '22ee4224-8fd3-4fc8-ba34-0bcf87b505fe', 'ef5e1df9-935a-40c3-b42b-f50706adf2bc', '92dc857e-de6a-4713-9f1f-182537575446'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:11:30 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-2d6ca45a-ef9b-400f-a979-a4c0488482bc tempest-GroupSnapshotsTest-180858973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:11:30 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-2d6ca45a-ef9b-400f-a979-a4c0488482bc tempest-GroupSnapshotsTest-180858973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:11:30 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-2d6ca45a-ef9b-400f-a979-a4c0488482bc tempest-GroupSnapshotsTest-180858973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:11:30 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-2d6ca45a-ef9b-400f-a979-a4c0488482bc tempest-GroupSnapshotsTest-180858973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:11:30 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-2d6ca45a-ef9b-400f-a979-a4c0488482bc tempest-GroupSnapshotsTest-180858973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:11:30 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-2d6ca45a-ef9b-400f-a979-a4c0488482bc tempest-GroupSnapshotsTest-180858973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:30 devstack sudo[89176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:11:30 devstack sudo[89176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:31 devstack sudo[89176]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:31 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-2d6ca45a-ef9b-400f-a979-a4c0488482bc tempest-GroupSnapshotsTest-180858973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.453s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:31 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-2d6ca45a-ef9b-400f-a979-a4c0488482bc tempest-GroupSnapshotsTest-180858973 None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:11:31 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-2d6ca45a-ef9b-400f-a979-a4c0488482bc tempest-GroupSnapshotsTest-180858973 None] Delete group completed successfully. Apr 16 15:11:31 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1cf21d4-e762-480f-899e-2defac5f9717 tempest-VolumeDependencyTests-70634728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82756) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 15:11:31 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-e1cf21d4-e762-480f-899e-2defac5f9717 tempest-VolumeDependencyTests-70634728 None] Flow 'volume_create_manager' (a4276527-639b-470a-a5b8-779724cafd8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:11:31 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-e1cf21d4-e762-480f-899e-2defac5f9717 tempest-VolumeDependencyTests-70634728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (061b267f-a22b-499b-a68d-2381e1cddf09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:11:31 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-e1cf21d4-e762-480f-899e-2defac5f9717 tempest-VolumeDependencyTests-70634728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (061b267f-a22b-499b-a68d-2381e1cddf09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:11:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1649784018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9f707d6-2ee2-40dc-9cdc-1d5d82e440d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66327cc4da7e4c94ae71ea059af6e5e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:11:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:11:31Z,use_quota=True,user_id='09d3295b684d4588a231683460edc860',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:11:31 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-e1cf21d4-e762-480f-899e-2defac5f9717 tempest-VolumeDependencyTests-70634728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a92cc9a1-0e0e-4ec8-ba7d-1b04f025c6c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:11:31 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-e1cf21d4-e762-480f-899e-2defac5f9717 tempest-VolumeDependencyTests-70634728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a92cc9a1-0e0e-4ec8-ba7d-1b04f025c6c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:11:31 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-e1cf21d4-e762-480f-899e-2defac5f9717 tempest-VolumeDependencyTests-70634728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f593042d-93bc-4036-8fc5-a02fb400eeda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:11:31 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-e1cf21d4-e762-480f-899e-2defac5f9717 tempest-VolumeDependencyTests-70634728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f593042d-93bc-4036-8fc5-a02fb400eeda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9f707d6-2ee2-40dc-9cdc-1d5d82e440d1', 'volume_name': 'volume-f9f707d6-2ee2-40dc-9cdc-1d5d82e440d1', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:11:31 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-e1cf21d4-e762-480f-899e-2defac5f9717 tempest-VolumeDependencyTests-70634728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab7cf7f7-fcfe-49df-b0db-2c6420e7d492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:11:31 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-e1cf21d4-e762-480f-899e-2defac5f9717 tempest-VolumeDependencyTests-70634728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab7cf7f7-fcfe-49df-b0db-2c6420e7d492) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:11:31 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-e1cf21d4-e762-480f-899e-2defac5f9717 tempest-VolumeDependencyTests-70634728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fa2398d-ba93-43f6-8035-813e78ba5879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:11:31 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-e1cf21d4-e762-480f-899e-2defac5f9717 tempest-VolumeDependencyTests-70634728 None] Volume f9f707d6-2ee2-40dc-9cdc-1d5d82e440d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9f707d6-2ee2-40dc-9cdc-1d5d82e440d1', 'volume_size': 1} Apr 16 15:11:31 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-e1cf21d4-e762-480f-899e-2defac5f9717 tempest-VolumeDependencyTests-70634728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:11:31 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-e1cf21d4-e762-480f-899e-2defac5f9717 tempest-VolumeDependencyTests-70634728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:11:31 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-e1cf21d4-e762-480f-899e-2defac5f9717 tempest-VolumeDependencyTests-70634728 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:11:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1649784018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9f707d6-2ee2-40dc-9cdc-1d5d82e440d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66327cc4da7e4c94ae71ea059af6e5e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:11:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:11:31Z,use_quota=True,user_id='09d3295b684d4588a231683460edc860',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)}" {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 15:11:31 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-e1cf21d4-e762-480f-899e-2defac5f9717 tempest-VolumeDependencyTests-70634728 None] Creating volume f9f707d6-2ee2-40dc-9cdc-1d5d82e440d1 {{(pid=82756) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 15:11:31 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-e1cf21d4-e762-480f-899e-2defac5f9717 tempest-VolumeDependencyTests-70634728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:11:31 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-e1cf21d4-e762-480f-899e-2defac5f9717 tempest-VolumeDependencyTests-70634728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:11:31 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-e1cf21d4-e762-480f-899e-2defac5f9717 tempest-VolumeDependencyTests-70634728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:11:31 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-e1cf21d4-e762-480f-899e-2defac5f9717 tempest-VolumeDependencyTests-70634728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:11:31 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-e1cf21d4-e762-480f-899e-2defac5f9717 tempest-VolumeDependencyTests-70634728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:11:31 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-e1cf21d4-e762-480f-899e-2defac5f9717 tempest-VolumeDependencyTests-70634728 None] Selected osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 as target Quobyte volume. {{(pid=82756) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 15:11:31 devstack cinder-volume[82756]: INFO cinder.volume.drivers.remotefs [None req-e1cf21d4-e762-480f-899e-2defac5f9717 tempest-VolumeDependencyTests-70634728 None] casted to osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 Apr 16 15:11:31 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-e1cf21d4-e762-480f-899e-2defac5f9717 tempest-VolumeDependencyTests-70634728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-f9f707d6-2ee2-40dc-9cdc-1d5d82e440d1 1073741824 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:31 devstack sudo[89179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-f9f707d6-2ee2-40dc-9cdc-1d5d82e440d1 1073741824 Apr 16 15:11:31 devstack sudo[89179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:31 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-9ac98d51-29c9-40cf-9bbe-b981ccbfcccb tempest-GroupSnapshotsTest-180858973 None] Group tempest-GroupSnapshotsTest-Group-1339974250: creating Apr 16 15:11:31 devstack sudo[89179]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:31 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-e1cf21d4-e762-480f-899e-2defac5f9717 tempest-VolumeDependencyTests-70634728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-f9f707d6-2ee2-40dc-9cdc-1d5d82e440d1 1073741824" returned: 0 in 0.602s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:31 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-9ac98d51-29c9-40cf-9bbe-b981ccbfcccb tempest-GroupSnapshotsTest-180858973 None] Group tempest-GroupSnapshotsTest-Group-1339974250: created successfully Apr 16 15:11:31 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-e1cf21d4-e762-480f-899e-2defac5f9717 tempest-VolumeDependencyTests-70634728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-f9f707d6-2ee2-40dc-9cdc-1d5d82e440d1 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:31 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-9ac98d51-29c9-40cf-9bbe-b981ccbfcccb tempest-GroupSnapshotsTest-180858973 None] Create group completed successfully. Apr 16 15:11:31 devstack sudo[89184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-f9f707d6-2ee2-40dc-9cdc-1d5d82e440d1 Apr 16 15:11:31 devstack sudo[89184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:32 devstack sudo[89184]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:32 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-e1cf21d4-e762-480f-899e-2defac5f9717 tempest-VolumeDependencyTests-70634728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-f9f707d6-2ee2-40dc-9cdc-1d5d82e440d1" returned: 0 in 0.430s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:32 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-e1cf21d4-e762-480f-899e-2defac5f9717 tempest-VolumeDependencyTests-70634728 None] <== create_volume: return (1061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'} {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 15:11:32 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-e1cf21d4-e762-480f-899e-2defac5f9717 tempest-VolumeDependencyTests-70634728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.063s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:11:32 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-e1cf21d4-e762-480f-899e-2defac5f9717 tempest-VolumeDependencyTests-70634728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fa2398d-ba93-43f6-8035-813e78ba5879) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9f707d6-2ee2-40dc-9cdc-1d5d82e440d1', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:11:32 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-e1cf21d4-e762-480f-899e-2defac5f9717 tempest-VolumeDependencyTests-70634728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e06b880a-d480-4487-bed1-80052515463c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:11:32 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-e1cf21d4-e762-480f-899e-2defac5f9717 tempest-VolumeDependencyTests-70634728 None] Volume volume-f9f707d6-2ee2-40dc-9cdc-1d5d82e440d1 (f9f707d6-2ee2-40dc-9cdc-1d5d82e440d1): created successfully Apr 16 15:11:32 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-e1cf21d4-e762-480f-899e-2defac5f9717 tempest-VolumeDependencyTests-70634728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e06b880a-d480-4487-bed1-80052515463c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:11:32 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-e1cf21d4-e762-480f-899e-2defac5f9717 tempest-VolumeDependencyTests-70634728 None] Flow 'volume_create_manager' (a4276527-639b-470a-a5b8-779724cafd8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:11:32 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-e1cf21d4-e762-480f-899e-2defac5f9717 tempest-VolumeDependencyTests-70634728 None] Created volume successfully. Apr 16 15:11:33 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [None req-201134e3-fffb-4d13-a9ee-1b1daa96e1d6 tempest-GroupSnapshotsTest-180858973 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82756) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 15:11:33 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-201134e3-fffb-4d13-a9ee-1b1daa96e1d6 tempest-GroupSnapshotsTest-180858973 None] Flow 'volume_create_manager' (429866e8-5c29-4b48-b842-7bd6759dace8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:11:33 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-201134e3-fffb-4d13-a9ee-1b1daa96e1d6 tempest-GroupSnapshotsTest-180858973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65fc3c2a-0701-442c-a348-a69b7486ea87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:11:33 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-201134e3-fffb-4d13-a9ee-1b1daa96e1d6 tempest-GroupSnapshotsTest-180858973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65fc3c2a-0701-442c-a348-a69b7486ea87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:11:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1423494525',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3da15861-6d56-405c-b062-9e0245b820a5,host='devstack@QuobyteHD#QuobyteHD',id=589d43a5-0d32-4405-b18e-6d85bf6e9dfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe52d01decbe4a18a804934f56346c39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:11:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:11:33Z,use_quota=True,user_id='8c3648f05e984f90b1939e843f0cea32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57723d47-a68d-429e-98aa-1ce3e45aa2f6),volume_type_id=57723d47-a68d-429e-98aa-1ce3e45aa2f6)' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:11:33 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-201134e3-fffb-4d13-a9ee-1b1daa96e1d6 tempest-GroupSnapshotsTest-180858973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e75e97b-9b1d-41ed-b35b-5b4895e13656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:11:33 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-201134e3-fffb-4d13-a9ee-1b1daa96e1d6 tempest-GroupSnapshotsTest-180858973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e75e97b-9b1d-41ed-b35b-5b4895e13656) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:11:33 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-201134e3-fffb-4d13-a9ee-1b1daa96e1d6 tempest-GroupSnapshotsTest-180858973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02c1af4b-927e-4798-944c-4d7d9f0aeed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:11:33 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-201134e3-fffb-4d13-a9ee-1b1daa96e1d6 tempest-GroupSnapshotsTest-180858973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02c1af4b-927e-4798-944c-4d7d9f0aeed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '589d43a5-0d32-4405-b18e-6d85bf6e9dfb', 'volume_name': 'volume-589d43a5-0d32-4405-b18e-6d85bf6e9dfb', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:11:33 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-201134e3-fffb-4d13-a9ee-1b1daa96e1d6 tempest-GroupSnapshotsTest-180858973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e6f5490-0888-407d-8ed4-502b13a7943e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:11:33 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-201134e3-fffb-4d13-a9ee-1b1daa96e1d6 tempest-GroupSnapshotsTest-180858973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e6f5490-0888-407d-8ed4-502b13a7943e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:11:33 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-201134e3-fffb-4d13-a9ee-1b1daa96e1d6 tempest-GroupSnapshotsTest-180858973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa06db20-b26d-4fb8-a5b0-ab2af9da0c74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:11:33 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-201134e3-fffb-4d13-a9ee-1b1daa96e1d6 tempest-GroupSnapshotsTest-180858973 None] Volume 589d43a5-0d32-4405-b18e-6d85bf6e9dfb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-589d43a5-0d32-4405-b18e-6d85bf6e9dfb', 'volume_size': 1} Apr 16 15:11:33 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-201134e3-fffb-4d13-a9ee-1b1daa96e1d6 tempest-GroupSnapshotsTest-180858973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:11:33 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-201134e3-fffb-4d13-a9ee-1b1daa96e1d6 tempest-GroupSnapshotsTest-180858973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:11:33 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-201134e3-fffb-4d13-a9ee-1b1daa96e1d6 tempest-GroupSnapshotsTest-180858973 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3da15861-6d56-405c-b062-9e0245b820a5,created_at=2026-04-16T13:11:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1423494525',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3da15861-6d56-405c-b062-9e0245b820a5,host='devstack@QuobyteHD#QuobyteHD',id=589d43a5-0d32-4405-b18e-6d85bf6e9dfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe52d01decbe4a18a804934f56346c39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:11:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:11:33Z,use_quota=True,user_id='8c3648f05e984f90b1939e843f0cea32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57723d47-a68d-429e-98aa-1ce3e45aa2f6),volume_type_id=57723d47-a68d-429e-98aa-1ce3e45aa2f6)}" {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 15:11:33 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-201134e3-fffb-4d13-a9ee-1b1daa96e1d6 tempest-GroupSnapshotsTest-180858973 None] Creating volume 589d43a5-0d32-4405-b18e-6d85bf6e9dfb {{(pid=82756) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 15:11:33 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-201134e3-fffb-4d13-a9ee-1b1daa96e1d6 tempest-GroupSnapshotsTest-180858973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:11:33 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-201134e3-fffb-4d13-a9ee-1b1daa96e1d6 tempest-GroupSnapshotsTest-180858973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:11:33 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-201134e3-fffb-4d13-a9ee-1b1daa96e1d6 tempest-GroupSnapshotsTest-180858973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:11:33 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-201134e3-fffb-4d13-a9ee-1b1daa96e1d6 tempest-GroupSnapshotsTest-180858973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:11:33 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-201134e3-fffb-4d13-a9ee-1b1daa96e1d6 tempest-GroupSnapshotsTest-180858973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:11:33 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-201134e3-fffb-4d13-a9ee-1b1daa96e1d6 tempest-GroupSnapshotsTest-180858973 None] Selected osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 as target Quobyte volume. {{(pid=82756) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 15:11:33 devstack cinder-volume[82756]: INFO cinder.volume.drivers.remotefs [None req-201134e3-fffb-4d13-a9ee-1b1daa96e1d6 tempest-GroupSnapshotsTest-180858973 None] casted to osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 Apr 16 15:11:33 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-201134e3-fffb-4d13-a9ee-1b1daa96e1d6 tempest-GroupSnapshotsTest-180858973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-589d43a5-0d32-4405-b18e-6d85bf6e9dfb 1073741824 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:33 devstack sudo[89187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-589d43a5-0d32-4405-b18e-6d85bf6e9dfb 1073741824 Apr 16 15:11:33 devstack sudo[89187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:33 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-e14f7da4-a2fa-42ec-87b8-cdf930a2b602 tempest-VolumeDependencyTests-70634728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:11:33 devstack sudo[89187]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:33 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-201134e3-fffb-4d13-a9ee-1b1daa96e1d6 tempest-GroupSnapshotsTest-180858973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-589d43a5-0d32-4405-b18e-6d85bf6e9dfb 1073741824" returned: 0 in 0.536s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:33 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-201134e3-fffb-4d13-a9ee-1b1daa96e1d6 tempest-GroupSnapshotsTest-180858973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-589d43a5-0d32-4405-b18e-6d85bf6e9dfb {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:33 devstack sudo[89193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-589d43a5-0d32-4405-b18e-6d85bf6e9dfb Apr 16 15:11:33 devstack sudo[89193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:34 devstack sudo[89193]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:34 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-201134e3-fffb-4d13-a9ee-1b1daa96e1d6 tempest-GroupSnapshotsTest-180858973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-589d43a5-0d32-4405-b18e-6d85bf6e9dfb" returned: 0 in 0.419s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:34 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-201134e3-fffb-4d13-a9ee-1b1daa96e1d6 tempest-GroupSnapshotsTest-180858973 None] <== create_volume: return (978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'} {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 15:11:34 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-201134e3-fffb-4d13-a9ee-1b1daa96e1d6 tempest-GroupSnapshotsTest-180858973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.979s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:11:34 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-e14f7da4-a2fa-42ec-87b8-cdf930a2b602 tempest-VolumeDependencyTests-70634728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.777s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:11:34 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-201134e3-fffb-4d13-a9ee-1b1daa96e1d6 tempest-GroupSnapshotsTest-180858973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa06db20-b26d-4fb8-a5b0-ab2af9da0c74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-589d43a5-0d32-4405-b18e-6d85bf6e9dfb', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:11:34 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-201134e3-fffb-4d13-a9ee-1b1daa96e1d6 tempest-GroupSnapshotsTest-180858973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd5a3c28-58ff-45a0-b3fa-975b756f3568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:11:34 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-201134e3-fffb-4d13-a9ee-1b1daa96e1d6 tempest-GroupSnapshotsTest-180858973 None] Volume volume-589d43a5-0d32-4405-b18e-6d85bf6e9dfb (589d43a5-0d32-4405-b18e-6d85bf6e9dfb): created successfully Apr 16 15:11:34 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-201134e3-fffb-4d13-a9ee-1b1daa96e1d6 tempest-GroupSnapshotsTest-180858973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd5a3c28-58ff-45a0-b3fa-975b756f3568) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:11:34 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-201134e3-fffb-4d13-a9ee-1b1daa96e1d6 tempest-GroupSnapshotsTest-180858973 None] Flow 'volume_create_manager' (429866e8-5c29-4b48-b842-7bd6759dace8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:11:34 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-e14f7da4-a2fa-42ec-87b8-cdf930a2b602 tempest-VolumeDependencyTests-70634728 None] Creating offline snapshot 7265cef4-ace4-4e74-9eb1-8de28d207e7e of volume f9f707d6-2ee2-40dc-9cdc-1d5d82e440d1 {{(pid=82756) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 16 15:11:34 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-201134e3-fffb-4d13-a9ee-1b1daa96e1d6 tempest-GroupSnapshotsTest-180858973 None] Created volume successfully. Apr 16 15:11:34 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeffe7eb-ea3c-4a24-89d7-ff93cbb0e001]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:11:34 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-e14f7da4-a2fa-42ec-87b8-cdf930a2b602 tempest-VolumeDependencyTests-70634728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-f9f707d6-2ee2-40dc-9cdc-1d5d82e440d1 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:34 devstack sudo[89196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-f9f707d6-2ee2-40dc-9cdc-1d5d82e440d1 Apr 16 15:11:34 devstack sudo[89196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:34 devstack sudo[89196]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:34 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-e14f7da4-a2fa-42ec-87b8-cdf930a2b602 tempest-VolumeDependencyTests-70634728 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-f9f707d6-2ee2-40dc-9cdc-1d5d82e440d1" returned: 0 in 0.495s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:34 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-e14f7da4-a2fa-42ec-87b8-cdf930a2b602 tempest-VolumeDependencyTests-70634728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-f9f707d6-2ee2-40dc-9cdc-1d5d82e440d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-f9f707d6-2ee2-40dc-9cdc-1d5d82e440d1.7265cef4-ace4-4e74-9eb1-8de28d207e7e 1G {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:34 devstack sudo[89201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-f9f707d6-2ee2-40dc-9cdc-1d5d82e440d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-f9f707d6-2ee2-40dc-9cdc-1d5d82e440d1.7265cef4-ace4-4e74-9eb1-8de28d207e7e 1G Apr 16 15:11:34 devstack sudo[89201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:35 devstack sudo[89201]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:35 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-e14f7da4-a2fa-42ec-87b8-cdf930a2b602 tempest-VolumeDependencyTests-70634728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-f9f707d6-2ee2-40dc-9cdc-1d5d82e440d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-f9f707d6-2ee2-40dc-9cdc-1d5d82e440d1.7265cef4-ace4-4e74-9eb1-8de28d207e7e 1G" returned: 0 in 0.483s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:35 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-e14f7da4-a2fa-42ec-87b8-cdf930a2b602 tempest-VolumeDependencyTests-70634728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9f707d6-2ee2-40dc-9cdc-1d5d82e440d1 -F qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-f9f707d6-2ee2-40dc-9cdc-1d5d82e440d1.7265cef4-ace4-4e74-9eb1-8de28d207e7e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:35 devstack sudo[89206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9f707d6-2ee2-40dc-9cdc-1d5d82e440d1 -F qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-f9f707d6-2ee2-40dc-9cdc-1d5d82e440d1.7265cef4-ace4-4e74-9eb1-8de28d207e7e Apr 16 15:11:35 devstack sudo[89206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:35 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-86908de0-1ccd-4a82-92bd-8ec1129a2962 tempest-GroupSnapshotsTest-180858973 None] GroupSnapshot ce379dc4-08f7-47fe-962f-e1449bddb6d2: creating. Apr 16 15:11:35 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-86908de0-1ccd-4a82-92bd-8ec1129a2962 tempest-GroupSnapshotsTest-180858973 None] Group snapshot ce379dc4-08f7-47fe-962f-e1449bddb6d2: creating. {{(pid=82756) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 16 15:11:35 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-86908de0-1ccd-4a82-92bd-8ec1129a2962 tempest-GroupSnapshotsTest-180858973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:11:35 devstack sudo[89206]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:35 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-e14f7da4-a2fa-42ec-87b8-cdf930a2b602 tempest-VolumeDependencyTests-70634728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9f707d6-2ee2-40dc-9cdc-1d5d82e440d1 -F qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-f9f707d6-2ee2-40dc-9cdc-1d5d82e440d1.7265cef4-ace4-4e74-9eb1-8de28d207e7e" returned: 0 in 0.485s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:35 devstack cinder-volume[82756]: WARNING cinder.volume.drivers.remotefs [None req-e14f7da4-a2fa-42ec-87b8-cdf930a2b602 tempest-VolumeDependencyTests-70634728 None] /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-f9f707d6-2ee2-40dc-9cdc-1d5d82e440d1.7265cef4-ace4-4e74-9eb1-8de28d207e7e is being set with open permissions: ugo+rw Apr 16 15:11:35 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-e14f7da4-a2fa-42ec-87b8-cdf930a2b602 tempest-VolumeDependencyTests-70634728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-f9f707d6-2ee2-40dc-9cdc-1d5d82e440d1.7265cef4-ace4-4e74-9eb1-8de28d207e7e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:35 devstack sudo[89211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-f9f707d6-2ee2-40dc-9cdc-1d5d82e440d1.7265cef4-ace4-4e74-9eb1-8de28d207e7e Apr 16 15:11:35 devstack sudo[89211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:36 devstack sudo[89211]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:36 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-e14f7da4-a2fa-42ec-87b8-cdf930a2b602 tempest-VolumeDependencyTests-70634728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-f9f707d6-2ee2-40dc-9cdc-1d5d82e440d1.7265cef4-ace4-4e74-9eb1-8de28d207e7e" returned: 0 in 0.404s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:36 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-e14f7da4-a2fa-42ec-87b8-cdf930a2b602 tempest-VolumeDependencyTests-70634728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-f9f707d6-2ee2-40dc-9cdc-1d5d82e440d1.info {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:36 devstack sudo[89214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-f9f707d6-2ee2-40dc-9cdc-1d5d82e440d1.info Apr 16 15:11:36 devstack sudo[89214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:36 devstack sudo[89214]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:36 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-e14f7da4-a2fa-42ec-87b8-cdf930a2b602 tempest-VolumeDependencyTests-70634728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-f9f707d6-2ee2-40dc-9cdc-1d5d82e440d1.info" returned: 0 in 0.412s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:36 devstack cinder-volume[82756]: WARNING cinder.volume.drivers.remotefs [None req-e14f7da4-a2fa-42ec-87b8-cdf930a2b602 tempest-VolumeDependencyTests-70634728 None] /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-f9f707d6-2ee2-40dc-9cdc-1d5d82e440d1.info is being set with open permissions: ugo+rw Apr 16 15:11:36 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-e14f7da4-a2fa-42ec-87b8-cdf930a2b602 tempest-VolumeDependencyTests-70634728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-f9f707d6-2ee2-40dc-9cdc-1d5d82e440d1.info {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:36 devstack sudo[89217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-f9f707d6-2ee2-40dc-9cdc-1d5d82e440d1.info Apr 16 15:11:36 devstack sudo[89217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:37 devstack sudo[89217]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:37 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-e14f7da4-a2fa-42ec-87b8-cdf930a2b602 tempest-VolumeDependencyTests-70634728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-f9f707d6-2ee2-40dc-9cdc-1d5d82e440d1.info" returned: 0 in 0.427s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:37 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-e14f7da4-a2fa-42ec-87b8-cdf930a2b602 tempest-VolumeDependencyTests-70634728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.791s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:11:37 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-86908de0-1ccd-4a82-92bd-8ec1129a2962 tempest-GroupSnapshotsTest-180858973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.473s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:11:37 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-86908de0-1ccd-4a82-92bd-8ec1129a2962 tempest-GroupSnapshotsTest-180858973 None] Creating offline snapshot 35f4d0d9-782e-4e9a-816e-8a7aaff8d5fa of volume 589d43a5-0d32-4405-b18e-6d85bf6e9dfb {{(pid=82756) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 16 15:11:37 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-e14f7da4-a2fa-42ec-87b8-cdf930a2b602 tempest-VolumeDependencyTests-70634728 None] Create snapshot completed successfully Apr 16 15:11:37 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[89c35d8a-3d9d-40a8-887d-34451f90ff5a]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:11:37 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-86908de0-1ccd-4a82-92bd-8ec1129a2962 tempest-GroupSnapshotsTest-180858973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-589d43a5-0d32-4405-b18e-6d85bf6e9dfb {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:37 devstack sudo[89220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-589d43a5-0d32-4405-b18e-6d85bf6e9dfb Apr 16 15:11:37 devstack sudo[89220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:37 devstack sudo[89220]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:37 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-86908de0-1ccd-4a82-92bd-8ec1129a2962 tempest-GroupSnapshotsTest-180858973 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-589d43a5-0d32-4405-b18e-6d85bf6e9dfb" returned: 0 in 0.483s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:37 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-86908de0-1ccd-4a82-92bd-8ec1129a2962 tempest-GroupSnapshotsTest-180858973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-589d43a5-0d32-4405-b18e-6d85bf6e9dfb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-589d43a5-0d32-4405-b18e-6d85bf6e9dfb.35f4d0d9-782e-4e9a-816e-8a7aaff8d5fa 1G {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:37 devstack sudo[89225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-589d43a5-0d32-4405-b18e-6d85bf6e9dfb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-589d43a5-0d32-4405-b18e-6d85bf6e9dfb.35f4d0d9-782e-4e9a-816e-8a7aaff8d5fa 1G Apr 16 15:11:37 devstack sudo[89225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:38 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a4fe851-95f9-470d-b616-d4a28187595f tempest-VolumeDependencyTests-70634728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82756) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 15:11:38 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-7a4fe851-95f9-470d-b616-d4a28187595f tempest-VolumeDependencyTests-70634728 None] Flow 'volume_create_manager' (44ff6f8e-1935-46fa-902c-bf8a34167630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:11:38 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-7a4fe851-95f9-470d-b616-d4a28187595f tempest-VolumeDependencyTests-70634728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e03cc76d-d742-42b9-820c-db13fe0ef916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:11:38 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-7a4fe851-95f9-470d-b616-d4a28187595f tempest-VolumeDependencyTests-70634728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e03cc76d-d742-42b9-820c-db13fe0ef916) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:11:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1051550894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1cabcc5-3d3c-4403-834f-0b137ce05645,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66327cc4da7e4c94ae71ea059af6e5e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:11:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7265cef4-ace4-4e74-9eb1-8de28d207e7e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:11:38Z,use_quota=True,user_id='09d3295b684d4588a231683460edc860',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:11:38 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-7a4fe851-95f9-470d-b616-d4a28187595f tempest-VolumeDependencyTests-70634728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34f9054e-69e0-42fe-bc84-d581e6c0b55e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:11:38 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-7a4fe851-95f9-470d-b616-d4a28187595f tempest-VolumeDependencyTests-70634728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34f9054e-69e0-42fe-bc84-d581e6c0b55e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:11:38 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-7a4fe851-95f9-470d-b616-d4a28187595f tempest-VolumeDependencyTests-70634728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1269b406-cd37-42f5-a12a-013889d5b0ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:11:38 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-7a4fe851-95f9-470d-b616-d4a28187595f tempest-VolumeDependencyTests-70634728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1269b406-cd37-42f5-a12a-013889d5b0ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f1cabcc5-3d3c-4403-834f-0b137ce05645', 'volume_name': 'volume-f1cabcc5-3d3c-4403-834f-0b137ce05645', 'volume_size': 1, 'snapshot_id': '7265cef4-ace4-4e74-9eb1-8de28d207e7e'}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:11:38 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-7a4fe851-95f9-470d-b616-d4a28187595f tempest-VolumeDependencyTests-70634728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff914bd7-75f5-4313-81e4-db17306f3548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:11:38 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-7a4fe851-95f9-470d-b616-d4a28187595f tempest-VolumeDependencyTests-70634728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff914bd7-75f5-4313-81e4-db17306f3548) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:11:38 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-7a4fe851-95f9-470d-b616-d4a28187595f tempest-VolumeDependencyTests-70634728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e554a26-aeed-4a76-9d48-b957451200b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:11:38 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-7a4fe851-95f9-470d-b616-d4a28187595f tempest-VolumeDependencyTests-70634728 None] Volume f1cabcc5-3d3c-4403-834f-0b137ce05645: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f1cabcc5-3d3c-4403-834f-0b137ce05645', 'volume_size': 1, 'snapshot_id': '7265cef4-ace4-4e74-9eb1-8de28d207e7e'} Apr 16 15:11:38 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-7a4fe851-95f9-470d-b616-d4a28187595f tempest-VolumeDependencyTests-70634728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:11:38 devstack sudo[89225]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:38 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-86908de0-1ccd-4a82-92bd-8ec1129a2962 tempest-GroupSnapshotsTest-180858973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-589d43a5-0d32-4405-b18e-6d85bf6e9dfb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-589d43a5-0d32-4405-b18e-6d85bf6e9dfb.35f4d0d9-782e-4e9a-816e-8a7aaff8d5fa 1G" returned: 0 in 0.571s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:38 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-86908de0-1ccd-4a82-92bd-8ec1129a2962 tempest-GroupSnapshotsTest-180858973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-589d43a5-0d32-4405-b18e-6d85bf6e9dfb -F qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-589d43a5-0d32-4405-b18e-6d85bf6e9dfb.35f4d0d9-782e-4e9a-816e-8a7aaff8d5fa {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:38 devstack sudo[89230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-589d43a5-0d32-4405-b18e-6d85bf6e9dfb -F qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-589d43a5-0d32-4405-b18e-6d85bf6e9dfb.35f4d0d9-782e-4e9a-816e-8a7aaff8d5fa Apr 16 15:11:38 devstack sudo[89230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:38 devstack sudo[89230]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:38 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-86908de0-1ccd-4a82-92bd-8ec1129a2962 tempest-GroupSnapshotsTest-180858973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-589d43a5-0d32-4405-b18e-6d85bf6e9dfb -F qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-589d43a5-0d32-4405-b18e-6d85bf6e9dfb.35f4d0d9-782e-4e9a-816e-8a7aaff8d5fa" returned: 0 in 0.419s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:38 devstack cinder-volume[82756]: WARNING cinder.volume.drivers.remotefs [None req-86908de0-1ccd-4a82-92bd-8ec1129a2962 tempest-GroupSnapshotsTest-180858973 None] /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-589d43a5-0d32-4405-b18e-6d85bf6e9dfb.35f4d0d9-782e-4e9a-816e-8a7aaff8d5fa is being set with open permissions: ugo+rw: NotImplementedError Apr 16 15:11:38 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-86908de0-1ccd-4a82-92bd-8ec1129a2962 tempest-GroupSnapshotsTest-180858973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-589d43a5-0d32-4405-b18e-6d85bf6e9dfb.35f4d0d9-782e-4e9a-816e-8a7aaff8d5fa {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:38 devstack sudo[89235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-589d43a5-0d32-4405-b18e-6d85bf6e9dfb.35f4d0d9-782e-4e9a-816e-8a7aaff8d5fa Apr 16 15:11:38 devstack sudo[89235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:39 devstack sudo[89235]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:39 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-86908de0-1ccd-4a82-92bd-8ec1129a2962 tempest-GroupSnapshotsTest-180858973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-589d43a5-0d32-4405-b18e-6d85bf6e9dfb.35f4d0d9-782e-4e9a-816e-8a7aaff8d5fa" returned: 0 in 0.434s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:39 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-86908de0-1ccd-4a82-92bd-8ec1129a2962 tempest-GroupSnapshotsTest-180858973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-589d43a5-0d32-4405-b18e-6d85bf6e9dfb.info {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:39 devstack sudo[89238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-589d43a5-0d32-4405-b18e-6d85bf6e9dfb.info Apr 16 15:11:39 devstack sudo[89238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:39 devstack sudo[89238]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:39 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-86908de0-1ccd-4a82-92bd-8ec1129a2962 tempest-GroupSnapshotsTest-180858973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-589d43a5-0d32-4405-b18e-6d85bf6e9dfb.info" returned: 0 in 0.460s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:39 devstack cinder-volume[82756]: WARNING cinder.volume.drivers.remotefs [None req-86908de0-1ccd-4a82-92bd-8ec1129a2962 tempest-GroupSnapshotsTest-180858973 None] /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-589d43a5-0d32-4405-b18e-6d85bf6e9dfb.info is being set with open permissions: ugo+rw: NotImplementedError Apr 16 15:11:39 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-86908de0-1ccd-4a82-92bd-8ec1129a2962 tempest-GroupSnapshotsTest-180858973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-589d43a5-0d32-4405-b18e-6d85bf6e9dfb.info {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:39 devstack sudo[89241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-589d43a5-0d32-4405-b18e-6d85bf6e9dfb.info Apr 16 15:11:39 devstack sudo[89241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:39 devstack sudo[89241]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:39 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-86908de0-1ccd-4a82-92bd-8ec1129a2962 tempest-GroupSnapshotsTest-180858973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-589d43a5-0d32-4405-b18e-6d85bf6e9dfb.info" returned: 0 in 0.451s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:39 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-86908de0-1ccd-4a82-92bd-8ec1129a2962 tempest-GroupSnapshotsTest-180858973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.897s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:11:39 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-7a4fe851-95f9-470d-b616-d4a28187595f tempest-VolumeDependencyTests-70634728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.906s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:11:39 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-7a4fe851-95f9-470d-b616-d4a28187595f tempest-VolumeDependencyTests-70634728 None] Acquiring lock "cinder-quobyte-7265cef4-ace4-4e74-9eb1-8de28d207e7e-f1cabcc5-3d3c-4403-834f-0b137ce05645" by "_create_volume_from_snapshot" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:11:40 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-7a4fe851-95f9-470d-b616-d4a28187595f tempest-VolumeDependencyTests-70634728 None] Lock "cinder-quobyte-7265cef4-ace4-4e74-9eb1-8de28d207e7e-f1cabcc5-3d3c-4403-834f-0b137ce05645" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:11:40 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-7a4fe851-95f9-470d-b616-d4a28187595f tempest-VolumeDependencyTests-70634728 None] Creating volume f1cabcc5-3d3c-4403-834f-0b137ce05645 from snapshot 7265cef4-ace4-4e74-9eb1-8de28d207e7e {{(pid=82756) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 16 15:11:40 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-7a4fe851-95f9-470d-b616-d4a28187595f tempest-VolumeDependencyTests-70634728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:11:40 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-7a4fe851-95f9-470d-b616-d4a28187595f tempest-VolumeDependencyTests-70634728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:11:40 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-7a4fe851-95f9-470d-b616-d4a28187595f tempest-VolumeDependencyTests-70634728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:11:40 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-7a4fe851-95f9-470d-b616-d4a28187595f tempest-VolumeDependencyTests-70634728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:11:40 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-7a4fe851-95f9-470d-b616-d4a28187595f tempest-VolumeDependencyTests-70634728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:11:40 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-7a4fe851-95f9-470d-b616-d4a28187595f tempest-VolumeDependencyTests-70634728 None] Selected osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 as target Quobyte volume. {{(pid=82756) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 15:11:40 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-7a4fe851-95f9-470d-b616-d4a28187595f tempest-VolumeDependencyTests-70634728 None] Acquiring lock "cinder-quobyte-f1cabcc5-3d3c-4403-834f-0b137ce05645" by "_copy_volume_from_snapshot" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:11:40 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-7a4fe851-95f9-470d-b616-d4a28187595f tempest-VolumeDependencyTests-70634728 None] Lock "cinder-quobyte-f1cabcc5-3d3c-4403-834f-0b137ce05645" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:11:40 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-7a4fe851-95f9-470d-b616-d4a28187595f tempest-VolumeDependencyTests-70634728 None] snapshot: 7265cef4-ace4-4e74-9eb1-8de28d207e7e, volume: f1cabcc5-3d3c-4403-834f-0b137ce05645, {{(pid=82756) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 16 15:11:40 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-7a4fe851-95f9-470d-b616-d4a28187595f tempest-VolumeDependencyTests-70634728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:11:40 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-7a4fe851-95f9-470d-b616-d4a28187595f tempest-VolumeDependencyTests-70634728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:11:40 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-7a4fe851-95f9-470d-b616-d4a28187595f tempest-VolumeDependencyTests-70634728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:11:40 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-7a4fe851-95f9-470d-b616-d4a28187595f tempest-VolumeDependencyTests-70634728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:11:40 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-7a4fe851-95f9-470d-b616-d4a28187595f tempest-VolumeDependencyTests-70634728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:11:40 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b32a2c9-eb35-450d-aee7-cc2c4a5f9be8]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:11:40 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-86908de0-1ccd-4a82-92bd-8ec1129a2962 tempest-GroupSnapshotsTest-180858973 None] group_snapshot ce379dc4-08f7-47fe-962f-e1449bddb6d2: created successfully Apr 16 15:11:40 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-7a4fe851-95f9-470d-b616-d4a28187595f tempest-VolumeDependencyTests-70634728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-f9f707d6-2ee2-40dc-9cdc-1d5d82e440d1.7265cef4-ace4-4e74-9eb1-8de28d207e7e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:40 devstack sudo[89244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-f9f707d6-2ee2-40dc-9cdc-1d5d82e440d1.7265cef4-ace4-4e74-9eb1-8de28d207e7e Apr 16 15:11:40 devstack sudo[89244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:40 devstack sudo[89244]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:40 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-7a4fe851-95f9-470d-b616-d4a28187595f tempest-VolumeDependencyTests-70634728 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-f9f707d6-2ee2-40dc-9cdc-1d5d82e440d1.7265cef4-ace4-4e74-9eb1-8de28d207e7e" returned: 0 in 0.452s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:40 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-7a4fe851-95f9-470d-b616-d4a28187595f tempest-VolumeDependencyTests-70634728 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f9f707d6-2ee2-40dc-9cdc-1d5d82e440d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82756) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 15:11:40 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-7a4fe851-95f9-470d-b616-d4a28187595f tempest-VolumeDependencyTests-70634728 None] will copy from snapshot at /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-f9f707d6-2ee2-40dc-9cdc-1d5d82e440d1 {{(pid=82756) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 16 15:11:40 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-7a4fe851-95f9-470d-b616-d4a28187595f tempest-VolumeDependencyTests-70634728 None] Creating direct copy from snapshot {{(pid=82756) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 16 15:11:40 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc3aee2e-4ff7-4b35-81a4-fe6e4d486f6c]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:11:40 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-7a4fe851-95f9-470d-b616-d4a28187595f tempest-VolumeDependencyTests-70634728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-f9f707d6-2ee2-40dc-9cdc-1d5d82e440d1 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:40 devstack sudo[89249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-f9f707d6-2ee2-40dc-9cdc-1d5d82e440d1 Apr 16 15:11:40 devstack sudo[89249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:40 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-859a51d6-6bf4-421d-8c92-5c4d241fdf82 tempest-GroupSnapshotsTest-180858973 None] group_snapshot ce379dc4-08f7-47fe-962f-e1449bddb6d2: deleting Apr 16 15:11:40 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-859a51d6-6bf4-421d-8c92-5c4d241fdf82 tempest-GroupSnapshotsTest-180858973 None] group_snapshot ce379dc4-08f7-47fe-962f-e1449bddb6d2: deleting {{(pid=82756) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 16 15:11:40 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-859a51d6-6bf4-421d-8c92-5c4d241fdf82 tempest-GroupSnapshotsTest-180858973 None] Acquiring lock "cinder-quobyte-589d43a5-0d32-4405-b18e-6d85bf6e9dfb" by "delete_snapshot" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:11:40 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-859a51d6-6bf4-421d-8c92-5c4d241fdf82 tempest-GroupSnapshotsTest-180858973 None] Lock "cinder-quobyte-589d43a5-0d32-4405-b18e-6d85bf6e9dfb" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:11:40 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-859a51d6-6bf4-421d-8c92-5c4d241fdf82 tempest-GroupSnapshotsTest-180858973 None] Acquiring lock "cinder-quobyte-35f4d0d9-782e-4e9a-816e-8a7aaff8d5fa" by "_delete_snapshot" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:11:40 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-859a51d6-6bf4-421d-8c92-5c4d241fdf82 tempest-GroupSnapshotsTest-180858973 None] Lock "cinder-quobyte-35f4d0d9-782e-4e9a-816e-8a7aaff8d5fa" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:11:40 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-859a51d6-6bf4-421d-8c92-5c4d241fdf82 tempest-GroupSnapshotsTest-180858973 None] Deleting offline snapshot 35f4d0d9-782e-4e9a-816e-8a7aaff8d5fa of volume 589d43a5-0d32-4405-b18e-6d85bf6e9dfb {{(pid=82756) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 15:11:41 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-859a51d6-6bf4-421d-8c92-5c4d241fdf82 tempest-GroupSnapshotsTest-180858973 None] snapshot_file for this snap is: volume-589d43a5-0d32-4405-b18e-6d85bf6e9dfb.35f4d0d9-782e-4e9a-816e-8a7aaff8d5fa {{(pid=82756) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 15:11:41 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[7923f811-aa07-4150-970d-90cea73bf66f]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:11:41 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-859a51d6-6bf4-421d-8c92-5c4d241fdf82 tempest-GroupSnapshotsTest-180858973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-589d43a5-0d32-4405-b18e-6d85bf6e9dfb.35f4d0d9-782e-4e9a-816e-8a7aaff8d5fa {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:41 devstack sudo[89249]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:41 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-7a4fe851-95f9-470d-b616-d4a28187595f tempest-VolumeDependencyTests-70634728 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-f9f707d6-2ee2-40dc-9cdc-1d5d82e440d1" returned: 0 in 0.529s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:41 devstack cinder-volume[82756]: DEBUG cinder.utils [None req-7a4fe851-95f9-470d-b616-d4a28187595f tempest-VolumeDependencyTests-70634728 None] Path /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-f1cabcc5-3d3c-4403-834f-0b137ce05645 not found in is_blk_device check {{(pid=82756) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 16 15:11:41 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-7a4fe851-95f9-470d-b616-d4a28187595f tempest-VolumeDependencyTests-70634728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-f9f707d6-2ee2-40dc-9cdc-1d5d82e440d1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-f1cabcc5-3d3c-4403-834f-0b137ce05645 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:41 devstack sudo[89254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-589d43a5-0d32-4405-b18e-6d85bf6e9dfb.35f4d0d9-782e-4e9a-816e-8a7aaff8d5fa Apr 16 15:11:41 devstack sudo[89254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:41 devstack sudo[89255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-f9f707d6-2ee2-40dc-9cdc-1d5d82e440d1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-f1cabcc5-3d3c-4403-834f-0b137ce05645 Apr 16 15:11:41 devstack sudo[89255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:41 devstack sudo[89254]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:41 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-859a51d6-6bf4-421d-8c92-5c4d241fdf82 tempest-GroupSnapshotsTest-180858973 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-589d43a5-0d32-4405-b18e-6d85bf6e9dfb.35f4d0d9-782e-4e9a-816e-8a7aaff8d5fa" returned: 0 in 0.554s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:41 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-859a51d6-6bf4-421d-8c92-5c4d241fdf82 tempest-GroupSnapshotsTest-180858973 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-589d43a5-0d32-4405-b18e-6d85bf6e9dfb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82756) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 15:11:41 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e7aec7f-3088-4cdf-bd0e-7140589f06e9]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:11:41 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-859a51d6-6bf4-421d-8c92-5c4d241fdf82 tempest-GroupSnapshotsTest-180858973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-589d43a5-0d32-4405-b18e-6d85bf6e9dfb {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:41 devstack sudo[89271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-589d43a5-0d32-4405-b18e-6d85bf6e9dfb Apr 16 15:11:41 devstack sudo[89271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:43 devstack sudo[89271]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:43 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-859a51d6-6bf4-421d-8c92-5c4d241fdf82 tempest-GroupSnapshotsTest-180858973 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-589d43a5-0d32-4405-b18e-6d85bf6e9dfb" returned: 0 in 1.429s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:43 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-859a51d6-6bf4-421d-8c92-5c4d241fdf82 tempest-GroupSnapshotsTest-180858973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-589d43a5-0d32-4405-b18e-6d85bf6e9dfb.35f4d0d9-782e-4e9a-816e-8a7aaff8d5fa {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:43 devstack sudo[89276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-589d43a5-0d32-4405-b18e-6d85bf6e9dfb.35f4d0d9-782e-4e9a-816e-8a7aaff8d5fa Apr 16 15:11:43 devstack sudo[89276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:43 devstack sudo[89255]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:43 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-7a4fe851-95f9-470d-b616-d4a28187595f tempest-VolumeDependencyTests-70634728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-f9f707d6-2ee2-40dc-9cdc-1d5d82e440d1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-f1cabcc5-3d3c-4403-834f-0b137ce05645" returned: 0 in 2.223s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:43 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[28d87bd0-233d-4ec0-bd36-1c97015c46dd]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:11:43 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-7a4fe851-95f9-470d-b616-d4a28187595f tempest-VolumeDependencyTests-70634728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-f9f707d6-2ee2-40dc-9cdc-1d5d82e440d1 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:43 devstack sudo[89278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-f9f707d6-2ee2-40dc-9cdc-1d5d82e440d1 Apr 16 15:11:43 devstack sudo[89278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:43 devstack sudo[89276]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:43 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-859a51d6-6bf4-421d-8c92-5c4d241fdf82 tempest-GroupSnapshotsTest-180858973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-589d43a5-0d32-4405-b18e-6d85bf6e9dfb.35f4d0d9-782e-4e9a-816e-8a7aaff8d5fa" returned: 0 in 0.569s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:43 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-859a51d6-6bf4-421d-8c92-5c4d241fdf82 tempest-GroupSnapshotsTest-180858973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-589d43a5-0d32-4405-b18e-6d85bf6e9dfb.35f4d0d9-782e-4e9a-816e-8a7aaff8d5fa {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:43 devstack sudo[89284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-589d43a5-0d32-4405-b18e-6d85bf6e9dfb.35f4d0d9-782e-4e9a-816e-8a7aaff8d5fa Apr 16 15:11:43 devstack sudo[89284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:43 devstack sudo[89278]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:43 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-7a4fe851-95f9-470d-b616-d4a28187595f tempest-VolumeDependencyTests-70634728 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-f9f707d6-2ee2-40dc-9cdc-1d5d82e440d1" returned: 0 in 0.642s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:43 devstack cinder-volume[82756]: DEBUG cinder.image.image_utils [None req-7a4fe851-95f9-470d-b616-d4a28187595f tempest-VolumeDependencyTests-70634728 None] Image conversion details: src /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-f9f707d6-2ee2-40dc-9cdc-1d5d82e440d1, size 1024.00 MB, duration 2.22 sec, destination /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-f1cabcc5-3d3c-4403-834f-0b137ce05645 {{(pid=82756) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 15:11:43 devstack cinder-volume[82756]: INFO cinder.image.image_utils [None req-7a4fe851-95f9-470d-b616-d4a28187595f tempest-VolumeDependencyTests-70634728 None] Converted 1024.00 MB image at 460.25 MB/s Apr 16 15:11:43 devstack cinder-volume[82756]: WARNING cinder.volume.drivers.remotefs [None req-7a4fe851-95f9-470d-b616-d4a28187595f tempest-VolumeDependencyTests-70634728 None] /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-f1cabcc5-3d3c-4403-834f-0b137ce05645 is being set with open permissions: ugo+rw Apr 16 15:11:43 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-7a4fe851-95f9-470d-b616-d4a28187595f tempest-VolumeDependencyTests-70634728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-f1cabcc5-3d3c-4403-834f-0b137ce05645 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:43 devstack sudo[89290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-f1cabcc5-3d3c-4403-834f-0b137ce05645 Apr 16 15:11:43 devstack sudo[89290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:44 devstack sudo[89284]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:44 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-859a51d6-6bf4-421d-8c92-5c4d241fdf82 tempest-GroupSnapshotsTest-180858973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-589d43a5-0d32-4405-b18e-6d85bf6e9dfb.35f4d0d9-782e-4e9a-816e-8a7aaff8d5fa" returned: 0 in 0.468s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:44 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-859a51d6-6bf4-421d-8c92-5c4d241fdf82 tempest-GroupSnapshotsTest-180858973 None] Lock "cinder-quobyte-35f4d0d9-782e-4e9a-816e-8a7aaff8d5fa" released by "_delete_snapshot" :: held 3.112s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:11:44 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-859a51d6-6bf4-421d-8c92-5c4d241fdf82 tempest-GroupSnapshotsTest-180858973 None] Lock "cinder-quobyte-589d43a5-0d32-4405-b18e-6d85bf6e9dfb" released by "delete_snapshot" :: held 3.127s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:11:44 devstack cinder-volume[82756]: WARNING cinder.quota [None req-859a51d6-6bf4-421d-8c92-5c4d241fdf82 tempest-GroupSnapshotsTest-180858973 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-193327613 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-193327613, it is now deprecated. Please use the default quota class for default quota. Apr 16 15:11:44 devstack cinder-volume[82756]: WARNING cinder.quota [None req-859a51d6-6bf4-421d-8c92-5c4d241fdf82 tempest-GroupSnapshotsTest-180858973 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-193327613 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-193327613, it is now deprecated. Please use the default quota class for default quota. Apr 16 15:11:44 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-859a51d6-6bf4-421d-8c92-5c4d241fdf82 tempest-GroupSnapshotsTest-180858973 None] Created reservations ['5462f111-7fc0-4e93-b64d-384ac1f69098', '65adfaff-d6fc-4142-a4f9-f1258400ff81', 'ed1e48d9-e42f-4b04-8167-60eddf947438', 'cdd0d930-3c34-4604-a48c-3b827de06732'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:11:44 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-859a51d6-6bf4-421d-8c92-5c4d241fdf82 tempest-GroupSnapshotsTest-180858973 None] group_snapshot ce379dc4-08f7-47fe-962f-e1449bddb6d2: deleted successfully Apr 16 15:11:44 devstack sudo[89290]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:44 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-7a4fe851-95f9-470d-b616-d4a28187595f tempest-VolumeDependencyTests-70634728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-f1cabcc5-3d3c-4403-834f-0b137ce05645" returned: 0 in 0.448s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:44 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-7a4fe851-95f9-470d-b616-d4a28187595f tempest-VolumeDependencyTests-70634728 None] Lock "cinder-quobyte-f1cabcc5-3d3c-4403-834f-0b137ce05645" released by "_copy_volume_from_snapshot" :: held 4.371s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:11:44 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-7a4fe851-95f9-470d-b616-d4a28187595f tempest-VolumeDependencyTests-70634728 None] Lock "cinder-quobyte-7265cef4-ace4-4e74-9eb1-8de28d207e7e-f1cabcc5-3d3c-4403-834f-0b137ce05645" released by "_create_volume_from_snapshot" :: held 4.395s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:11:44 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-7a4fe851-95f9-470d-b616-d4a28187595f tempest-VolumeDependencyTests-70634728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.416s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:11:44 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-7a4fe851-95f9-470d-b616-d4a28187595f tempest-VolumeDependencyTests-70634728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e554a26-aeed-4a76-9d48-b957451200b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1cabcc5-3d3c-4403-834f-0b137ce05645', 'volume_size': 1, 'snapshot_id': '7265cef4-ace4-4e74-9eb1-8de28d207e7e'}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:11:44 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-7a4fe851-95f9-470d-b616-d4a28187595f tempest-VolumeDependencyTests-70634728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46ef4506-7086-4978-854a-4feff24fe929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:11:44 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-7a4fe851-95f9-470d-b616-d4a28187595f tempest-VolumeDependencyTests-70634728 None] Volume volume-f1cabcc5-3d3c-4403-834f-0b137ce05645 (f1cabcc5-3d3c-4403-834f-0b137ce05645): created successfully Apr 16 15:11:44 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-7a4fe851-95f9-470d-b616-d4a28187595f tempest-VolumeDependencyTests-70634728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46ef4506-7086-4978-854a-4feff24fe929) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:11:44 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-7a4fe851-95f9-470d-b616-d4a28187595f tempest-VolumeDependencyTests-70634728 None] Flow 'volume_create_manager' (44ff6f8e-1935-46fa-902c-bf8a34167630) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:11:44 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-7a4fe851-95f9-470d-b616-d4a28187595f tempest-VolumeDependencyTests-70634728 None] Created volume successfully. Apr 16 15:11:45 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-355ae1ef-1711-45b0-be75-5c89647e4c92 tempest-GroupSnapshotsTest-180858973 None] Acquiring lock "cinder-quobyte-589d43a5-0d32-4405-b18e-6d85bf6e9dfb" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:11:45 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-355ae1ef-1711-45b0-be75-5c89647e4c92 tempest-GroupSnapshotsTest-180858973 None] Lock "cinder-quobyte-589d43a5-0d32-4405-b18e-6d85bf6e9dfb" acquired by "delete_volume" :: waited 0.011s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:11:45 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba89b781-9860-442c-86c9-2e01fa4c35f9]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:11:45 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-355ae1ef-1711-45b0-be75-5c89647e4c92 tempest-GroupSnapshotsTest-180858973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-589d43a5-0d32-4405-b18e-6d85bf6e9dfb {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:45 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-05967057-0cce-49c2-ad11-698081309caa tempest-VolumeDependencyTests-70634728 None] Acquiring lock "cinder-7265cef4-ace4-4e74-9eb1-8de28d207e7e-delete_snapshot" by "delete_snapshot" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:11:45 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-05967057-0cce-49c2-ad11-698081309caa tempest-VolumeDependencyTests-70634728 None] Lock "cinder-7265cef4-ace4-4e74-9eb1-8de28d207e7e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:11:45 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-05967057-0cce-49c2-ad11-698081309caa tempest-VolumeDependencyTests-70634728 None] Acquiring lock "cinder-quobyte-f9f707d6-2ee2-40dc-9cdc-1d5d82e440d1" by "delete_snapshot" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:11:45 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-05967057-0cce-49c2-ad11-698081309caa tempest-VolumeDependencyTests-70634728 None] Lock "cinder-quobyte-f9f707d6-2ee2-40dc-9cdc-1d5d82e440d1" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:11:45 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-05967057-0cce-49c2-ad11-698081309caa tempest-VolumeDependencyTests-70634728 None] Acquiring lock "cinder-quobyte-7265cef4-ace4-4e74-9eb1-8de28d207e7e" by "_delete_snapshot" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:11:45 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-05967057-0cce-49c2-ad11-698081309caa tempest-VolumeDependencyTests-70634728 None] Lock "cinder-quobyte-7265cef4-ace4-4e74-9eb1-8de28d207e7e" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:11:45 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-05967057-0cce-49c2-ad11-698081309caa tempest-VolumeDependencyTests-70634728 None] Deleting offline snapshot 7265cef4-ace4-4e74-9eb1-8de28d207e7e of volume f9f707d6-2ee2-40dc-9cdc-1d5d82e440d1 {{(pid=82756) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 15:11:45 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-05967057-0cce-49c2-ad11-698081309caa tempest-VolumeDependencyTests-70634728 None] snapshot_file for this snap is: volume-f9f707d6-2ee2-40dc-9cdc-1d5d82e440d1.7265cef4-ace4-4e74-9eb1-8de28d207e7e {{(pid=82756) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 15:11:45 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[a15929bd-af75-4101-8cd4-e4367d46ba06]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:11:45 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-05967057-0cce-49c2-ad11-698081309caa tempest-VolumeDependencyTests-70634728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-f9f707d6-2ee2-40dc-9cdc-1d5d82e440d1.7265cef4-ace4-4e74-9eb1-8de28d207e7e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:45 devstack sudo[89293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-589d43a5-0d32-4405-b18e-6d85bf6e9dfb Apr 16 15:11:45 devstack sudo[89293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:45 devstack sudo[89294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-f9f707d6-2ee2-40dc-9cdc-1d5d82e440d1.7265cef4-ace4-4e74-9eb1-8de28d207e7e Apr 16 15:11:45 devstack sudo[89294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:45 devstack sudo[89293]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:45 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-355ae1ef-1711-45b0-be75-5c89647e4c92 tempest-GroupSnapshotsTest-180858973 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-589d43a5-0d32-4405-b18e-6d85bf6e9dfb" returned: 0 in 0.483s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:45 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-355ae1ef-1711-45b0-be75-5c89647e4c92 tempest-GroupSnapshotsTest-180858973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-589d43a5-0d32-4405-b18e-6d85bf6e9dfb {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:45 devstack sudo[89303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-589d43a5-0d32-4405-b18e-6d85bf6e9dfb Apr 16 15:11:45 devstack sudo[89303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:45 devstack sudo[89294]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:45 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-05967057-0cce-49c2-ad11-698081309caa tempest-VolumeDependencyTests-70634728 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-f9f707d6-2ee2-40dc-9cdc-1d5d82e440d1.7265cef4-ace4-4e74-9eb1-8de28d207e7e" returned: 0 in 0.514s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:45 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-05967057-0cce-49c2-ad11-698081309caa tempest-VolumeDependencyTests-70634728 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f9f707d6-2ee2-40dc-9cdc-1d5d82e440d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82756) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 15:11:46 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2f92582-7c85-4843-bc22-718781519a84]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:11:46 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-05967057-0cce-49c2-ad11-698081309caa tempest-VolumeDependencyTests-70634728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-f9f707d6-2ee2-40dc-9cdc-1d5d82e440d1 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:46 devstack sudo[89305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-f9f707d6-2ee2-40dc-9cdc-1d5d82e440d1 Apr 16 15:11:46 devstack sudo[89305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:46 devstack sudo[89303]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:46 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-355ae1ef-1711-45b0-be75-5c89647e4c92 tempest-GroupSnapshotsTest-180858973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-589d43a5-0d32-4405-b18e-6d85bf6e9dfb" returned: 0 in 0.404s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:46 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-355ae1ef-1711-45b0-be75-5c89647e4c92 tempest-GroupSnapshotsTest-180858973 None] Lock "cinder-quobyte-589d43a5-0d32-4405-b18e-6d85bf6e9dfb" released by "delete_volume" :: held 0.921s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:11:46 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-355ae1ef-1711-45b0-be75-5c89647e4c92 tempest-GroupSnapshotsTest-180858973 None] Created reservations ['febdc744-50ab-4cca-b1ea-f3d66e84aacf'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:11:46 devstack cinder-volume[82756]: WARNING cinder.quota [None req-355ae1ef-1711-45b0-be75-5c89647e4c92 tempest-GroupSnapshotsTest-180858973 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-193327613 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-193327613, it is now deprecated. Please use the default quota class for default quota. Apr 16 15:11:46 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-355ae1ef-1711-45b0-be75-5c89647e4c92 tempest-GroupSnapshotsTest-180858973 None] Created reservations ['43140631-80e2-4f3b-b8f5-6c154db7e85d', '82146d46-d1d7-47fc-9a3d-26f5dc90c719', '8b9ae79f-3e42-4173-bf6c-ed64b5558580', 'd1daa589-ea83-4bbe-ba09-ea74116e7c8b'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:11:46 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-355ae1ef-1711-45b0-be75-5c89647e4c92 tempest-GroupSnapshotsTest-180858973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:11:46 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-355ae1ef-1711-45b0-be75-5c89647e4c92 tempest-GroupSnapshotsTest-180858973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:11:46 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-355ae1ef-1711-45b0-be75-5c89647e4c92 tempest-GroupSnapshotsTest-180858973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:11:46 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-355ae1ef-1711-45b0-be75-5c89647e4c92 tempest-GroupSnapshotsTest-180858973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:11:46 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-355ae1ef-1711-45b0-be75-5c89647e4c92 tempest-GroupSnapshotsTest-180858973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:11:46 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-355ae1ef-1711-45b0-be75-5c89647e4c92 tempest-GroupSnapshotsTest-180858973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:46 devstack sudo[89311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:11:46 devstack sudo[89311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:46 devstack sudo[89305]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:46 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-05967057-0cce-49c2-ad11-698081309caa tempest-VolumeDependencyTests-70634728 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-f9f707d6-2ee2-40dc-9cdc-1d5d82e440d1" returned: 0 in 0.537s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:46 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-05967057-0cce-49c2-ad11-698081309caa tempest-VolumeDependencyTests-70634728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-f9f707d6-2ee2-40dc-9cdc-1d5d82e440d1.7265cef4-ace4-4e74-9eb1-8de28d207e7e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:46 devstack sudo[89313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-f9f707d6-2ee2-40dc-9cdc-1d5d82e440d1.7265cef4-ace4-4e74-9eb1-8de28d207e7e Apr 16 15:11:46 devstack sudo[89313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:46 devstack sudo[89311]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:46 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-355ae1ef-1711-45b0-be75-5c89647e4c92 tempest-GroupSnapshotsTest-180858973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.479s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:46 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-355ae1ef-1711-45b0-be75-5c89647e4c92 tempest-GroupSnapshotsTest-180858973 None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:11:46 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-355ae1ef-1711-45b0-be75-5c89647e4c92 tempest-GroupSnapshotsTest-180858973 None] Delete group completed successfully. Apr 16 15:11:47 devstack sudo[89313]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:47 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-05967057-0cce-49c2-ad11-698081309caa tempest-VolumeDependencyTests-70634728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-f9f707d6-2ee2-40dc-9cdc-1d5d82e440d1.7265cef4-ace4-4e74-9eb1-8de28d207e7e" returned: 0 in 0.528s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:47 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-05967057-0cce-49c2-ad11-698081309caa tempest-VolumeDependencyTests-70634728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-f9f707d6-2ee2-40dc-9cdc-1d5d82e440d1.7265cef4-ace4-4e74-9eb1-8de28d207e7e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:47 devstack sudo[89319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-f9f707d6-2ee2-40dc-9cdc-1d5d82e440d1.7265cef4-ace4-4e74-9eb1-8de28d207e7e Apr 16 15:11:47 devstack sudo[89319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:47 devstack sudo[89319]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:47 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-05967057-0cce-49c2-ad11-698081309caa tempest-VolumeDependencyTests-70634728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-f9f707d6-2ee2-40dc-9cdc-1d5d82e440d1.7265cef4-ace4-4e74-9eb1-8de28d207e7e" returned: 0 in 0.441s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:47 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-05967057-0cce-49c2-ad11-698081309caa tempest-VolumeDependencyTests-70634728 None] Lock "cinder-quobyte-7265cef4-ace4-4e74-9eb1-8de28d207e7e" released by "_delete_snapshot" :: held 2.074s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:11:47 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-05967057-0cce-49c2-ad11-698081309caa tempest-VolumeDependencyTests-70634728 None] Lock "cinder-quobyte-f9f707d6-2ee2-40dc-9cdc-1d5d82e440d1" released by "delete_snapshot" :: held 2.087s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:11:47 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-05967057-0cce-49c2-ad11-698081309caa tempest-VolumeDependencyTests-70634728 None] Created reservations ['3e2c92a9-503c-4118-9140-ed416b647807', 'cf7ef83f-9aed-4922-a1d1-b0306c00b279', 'a6f75893-2fee-41ff-b901-7ad90dc020a8', '52951f9d-4848-4e02-aa5c-1d43510eafb2'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:11:47 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-05967057-0cce-49c2-ad11-698081309caa tempest-VolumeDependencyTests-70634728 None] Delete snapshot completed successfully. Apr 16 15:11:47 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-05967057-0cce-49c2-ad11-698081309caa tempest-VolumeDependencyTests-70634728 None] Lock "cinder-7265cef4-ace4-4e74-9eb1-8de28d207e7e-delete_snapshot" released by "delete_snapshot" :: held 2.215s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:11:48 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-7de5068e-73a5-4d9f-81e4-c23d5f39968f tempest-VolumeDependencyTests-70634728 None] Acquiring lock "cinder-f9f707d6-2ee2-40dc-9cdc-1d5d82e440d1-delete_volume" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:11:48 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-7de5068e-73a5-4d9f-81e4-c23d5f39968f tempest-VolumeDependencyTests-70634728 None] Lock "cinder-f9f707d6-2ee2-40dc-9cdc-1d5d82e440d1-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:11:48 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-7de5068e-73a5-4d9f-81e4-c23d5f39968f tempest-VolumeDependencyTests-70634728 None] Acquiring lock "cinder-quobyte-f9f707d6-2ee2-40dc-9cdc-1d5d82e440d1" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:11:48 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-7de5068e-73a5-4d9f-81e4-c23d5f39968f tempest-VolumeDependencyTests-70634728 None] Lock "cinder-quobyte-f9f707d6-2ee2-40dc-9cdc-1d5d82e440d1" acquired by "delete_volume" :: waited 0.013s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:11:48 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8a89c53-efe4-4719-bc0d-2edbebc19be5]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:11:48 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-7de5068e-73a5-4d9f-81e4-c23d5f39968f tempest-VolumeDependencyTests-70634728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-f9f707d6-2ee2-40dc-9cdc-1d5d82e440d1 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:48 devstack sudo[89323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-f9f707d6-2ee2-40dc-9cdc-1d5d82e440d1 Apr 16 15:11:48 devstack sudo[89323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:49 devstack sudo[89323]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:49 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-7de5068e-73a5-4d9f-81e4-c23d5f39968f tempest-VolumeDependencyTests-70634728 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-f9f707d6-2ee2-40dc-9cdc-1d5d82e440d1" returned: 0 in 0.511s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:49 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-7de5068e-73a5-4d9f-81e4-c23d5f39968f tempest-VolumeDependencyTests-70634728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-f9f707d6-2ee2-40dc-9cdc-1d5d82e440d1 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:49 devstack sudo[89328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-f9f707d6-2ee2-40dc-9cdc-1d5d82e440d1 Apr 16 15:11:49 devstack sudo[89328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:49 devstack sudo[89328]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:49 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-7de5068e-73a5-4d9f-81e4-c23d5f39968f tempest-VolumeDependencyTests-70634728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-f9f707d6-2ee2-40dc-9cdc-1d5d82e440d1" returned: 0 in 0.433s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:49 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-7de5068e-73a5-4d9f-81e4-c23d5f39968f tempest-VolumeDependencyTests-70634728 None] Lock "cinder-quobyte-f9f707d6-2ee2-40dc-9cdc-1d5d82e440d1" released by "delete_volume" :: held 0.989s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:11:49 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-7de5068e-73a5-4d9f-81e4-c23d5f39968f tempest-VolumeDependencyTests-70634728 None] Created reservations ['c646769d-f445-4441-9826-e604fabc1310', 'a3a6116f-30ee-4d9b-a28b-c813ce6a7cb1', 'd2ab4632-a813-49f4-9f3c-217bb2d9be76', '645b5314-22d9-4e6d-a1e6-0ab96156cfac'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:11:49 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-7de5068e-73a5-4d9f-81e4-c23d5f39968f tempest-VolumeDependencyTests-70634728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:11:49 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-7de5068e-73a5-4d9f-81e4-c23d5f39968f tempest-VolumeDependencyTests-70634728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:11:49 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-7de5068e-73a5-4d9f-81e4-c23d5f39968f tempest-VolumeDependencyTests-70634728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:11:49 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-7de5068e-73a5-4d9f-81e4-c23d5f39968f tempest-VolumeDependencyTests-70634728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:11:49 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-7de5068e-73a5-4d9f-81e4-c23d5f39968f tempest-VolumeDependencyTests-70634728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:11:49 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-7de5068e-73a5-4d9f-81e4-c23d5f39968f tempest-VolumeDependencyTests-70634728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:49 devstack sudo[89331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:11:49 devstack sudo[89331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:50 devstack sudo[89331]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:50 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-7de5068e-73a5-4d9f-81e4-c23d5f39968f tempest-VolumeDependencyTests-70634728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.428s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:50 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-7de5068e-73a5-4d9f-81e4-c23d5f39968f tempest-VolumeDependencyTests-70634728 None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:11:50 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-7de5068e-73a5-4d9f-81e4-c23d5f39968f tempest-VolumeDependencyTests-70634728 None] Deleted volume successfully. Apr 16 15:11:50 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-7de5068e-73a5-4d9f-81e4-c23d5f39968f tempest-VolumeDependencyTests-70634728 None] Lock "cinder-f9f707d6-2ee2-40dc-9cdc-1d5d82e440d1-delete_volume" released by "delete_volume" :: held 1.576s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:11:50 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b3537a4-ee73-4bf6-89c7-3a11586aaabe tempest-VolumeDependencyTests-70634728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82756) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 15:11:51 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-9b3537a4-ee73-4bf6-89c7-3a11586aaabe tempest-VolumeDependencyTests-70634728 None] Flow 'volume_create_manager' (d1682d33-06d2-4af2-9da6-1044b10a0017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:11:51 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-9b3537a4-ee73-4bf6-89c7-3a11586aaabe tempest-VolumeDependencyTests-70634728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e844a77-28dd-42d1-ac9d-f346e508a05c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:11:51 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-9b3537a4-ee73-4bf6-89c7-3a11586aaabe tempest-VolumeDependencyTests-70634728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e844a77-28dd-42d1-ac9d-f346e508a05c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:11:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1265908755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26c9a2ff-a248-4813-9a80-ca6ab189d676,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66327cc4da7e4c94ae71ea059af6e5e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:11:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:11:51Z,use_quota=True,user_id='09d3295b684d4588a231683460edc860',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:11:51 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-9b3537a4-ee73-4bf6-89c7-3a11586aaabe tempest-VolumeDependencyTests-70634728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4b1e330-e179-4224-ba94-78106bbc171c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:11:51 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-9b3537a4-ee73-4bf6-89c7-3a11586aaabe tempest-VolumeDependencyTests-70634728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4b1e330-e179-4224-ba94-78106bbc171c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:11:51 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-9b3537a4-ee73-4bf6-89c7-3a11586aaabe tempest-VolumeDependencyTests-70634728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65ae1f7a-b4a8-4831-a308-3f552199d46e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:11:51 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-9b3537a4-ee73-4bf6-89c7-3a11586aaabe tempest-VolumeDependencyTests-70634728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65ae1f7a-b4a8-4831-a308-3f552199d46e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26c9a2ff-a248-4813-9a80-ca6ab189d676', 'volume_name': 'volume-26c9a2ff-a248-4813-9a80-ca6ab189d676', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:11:51 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-9b3537a4-ee73-4bf6-89c7-3a11586aaabe tempest-VolumeDependencyTests-70634728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5b964ae-b8ac-4380-9bc7-3fbdeca4616d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:11:51 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-9b3537a4-ee73-4bf6-89c7-3a11586aaabe tempest-VolumeDependencyTests-70634728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5b964ae-b8ac-4380-9bc7-3fbdeca4616d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:11:51 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-9b3537a4-ee73-4bf6-89c7-3a11586aaabe tempest-VolumeDependencyTests-70634728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (024b8024-7b3f-484a-990b-7767e2ffd71f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:11:51 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-9b3537a4-ee73-4bf6-89c7-3a11586aaabe tempest-VolumeDependencyTests-70634728 None] Volume 26c9a2ff-a248-4813-9a80-ca6ab189d676: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26c9a2ff-a248-4813-9a80-ca6ab189d676', 'volume_size': 1} Apr 16 15:11:51 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-9b3537a4-ee73-4bf6-89c7-3a11586aaabe tempest-VolumeDependencyTests-70634728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:11:51 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-9b3537a4-ee73-4bf6-89c7-3a11586aaabe tempest-VolumeDependencyTests-70634728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:11:51 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-9b3537a4-ee73-4bf6-89c7-3a11586aaabe tempest-VolumeDependencyTests-70634728 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:11:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1265908755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26c9a2ff-a248-4813-9a80-ca6ab189d676,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66327cc4da7e4c94ae71ea059af6e5e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:11:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:11:51Z,use_quota=True,user_id='09d3295b684d4588a231683460edc860',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)}" {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 15:11:51 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-9b3537a4-ee73-4bf6-89c7-3a11586aaabe tempest-VolumeDependencyTests-70634728 None] Creating volume 26c9a2ff-a248-4813-9a80-ca6ab189d676 {{(pid=82756) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 15:11:51 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-9b3537a4-ee73-4bf6-89c7-3a11586aaabe tempest-VolumeDependencyTests-70634728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:11:51 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-9b3537a4-ee73-4bf6-89c7-3a11586aaabe tempest-VolumeDependencyTests-70634728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:11:51 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-9b3537a4-ee73-4bf6-89c7-3a11586aaabe tempest-VolumeDependencyTests-70634728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:11:51 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-9b3537a4-ee73-4bf6-89c7-3a11586aaabe tempest-VolumeDependencyTests-70634728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:11:51 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-9b3537a4-ee73-4bf6-89c7-3a11586aaabe tempest-VolumeDependencyTests-70634728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:11:51 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-9b3537a4-ee73-4bf6-89c7-3a11586aaabe tempest-VolumeDependencyTests-70634728 None] Selected osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 as target Quobyte volume. {{(pid=82756) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 15:11:51 devstack cinder-volume[82756]: INFO cinder.volume.drivers.remotefs [None req-9b3537a4-ee73-4bf6-89c7-3a11586aaabe tempest-VolumeDependencyTests-70634728 None] casted to osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 Apr 16 15:11:51 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-9b3537a4-ee73-4bf6-89c7-3a11586aaabe tempest-VolumeDependencyTests-70634728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-26c9a2ff-a248-4813-9a80-ca6ab189d676 1073741824 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:51 devstack sudo[89334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-26c9a2ff-a248-4813-9a80-ca6ab189d676 1073741824 Apr 16 15:11:51 devstack sudo[89334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:51 devstack sudo[89334]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:51 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-9b3537a4-ee73-4bf6-89c7-3a11586aaabe tempest-VolumeDependencyTests-70634728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-26c9a2ff-a248-4813-9a80-ca6ab189d676 1073741824" returned: 0 in 0.532s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:51 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-9b3537a4-ee73-4bf6-89c7-3a11586aaabe tempest-VolumeDependencyTests-70634728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-26c9a2ff-a248-4813-9a80-ca6ab189d676 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:51 devstack sudo[89339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-26c9a2ff-a248-4813-9a80-ca6ab189d676 Apr 16 15:11:51 devstack sudo[89339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:51 devstack cinder-volume[82756]: DEBUG oslo_service.periodic_task [None req-9570f02d-5ef9-412b-993f-520a9e5bfa81 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82756) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 16 15:11:51 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-9570f02d-5ef9-412b-993f-520a9e5bfa81 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:11:51 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-9570f02d-5ef9-412b-993f-520a9e5bfa81 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:11:51 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-9570f02d-5ef9-412b-993f-520a9e5bfa81 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:11:51 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-9570f02d-5ef9-412b-993f-520a9e5bfa81 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:11:51 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-9570f02d-5ef9-412b-993f-520a9e5bfa81 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:11:51 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-9570f02d-5ef9-412b-993f-520a9e5bfa81 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:51 devstack sudo[89341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:11:51 devstack sudo[89341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:52 devstack sudo[89339]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:52 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-9b3537a4-ee73-4bf6-89c7-3a11586aaabe tempest-VolumeDependencyTests-70634728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-26c9a2ff-a248-4813-9a80-ca6ab189d676" returned: 0 in 0.495s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:52 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-9b3537a4-ee73-4bf6-89c7-3a11586aaabe tempest-VolumeDependencyTests-70634728 None] <== create_volume: return (1052ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'} {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 15:11:52 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-9b3537a4-ee73-4bf6-89c7-3a11586aaabe tempest-VolumeDependencyTests-70634728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.056s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:11:52 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-9b3537a4-ee73-4bf6-89c7-3a11586aaabe tempest-VolumeDependencyTests-70634728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (024b8024-7b3f-484a-990b-7767e2ffd71f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26c9a2ff-a248-4813-9a80-ca6ab189d676', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:11:52 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-9b3537a4-ee73-4bf6-89c7-3a11586aaabe tempest-VolumeDependencyTests-70634728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f559b3d-eb0b-40ba-b820-72e807696a9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:11:52 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-9b3537a4-ee73-4bf6-89c7-3a11586aaabe tempest-VolumeDependencyTests-70634728 None] Volume volume-26c9a2ff-a248-4813-9a80-ca6ab189d676 (26c9a2ff-a248-4813-9a80-ca6ab189d676): created successfully Apr 16 15:11:52 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-9b3537a4-ee73-4bf6-89c7-3a11586aaabe tempest-VolumeDependencyTests-70634728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f559b3d-eb0b-40ba-b820-72e807696a9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:11:52 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-9b3537a4-ee73-4bf6-89c7-3a11586aaabe tempest-VolumeDependencyTests-70634728 None] Flow 'volume_create_manager' (d1682d33-06d2-4af2-9da6-1044b10a0017) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:11:52 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-9b3537a4-ee73-4bf6-89c7-3a11586aaabe tempest-VolumeDependencyTests-70634728 None] Created volume successfully. Apr 16 15:11:52 devstack sudo[89341]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:52 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-9570f02d-5ef9-412b-993f-520a9e5bfa81 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.460s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:52 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-9570f02d-5ef9-412b-993f-520a9e5bfa81 None None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:11:52 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [None req-1325da6d-44aa-4790-b134-4e2130006d89 tempest-SnapshotsActionsTest-295135696 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82756) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 15:11:52 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-1325da6d-44aa-4790-b134-4e2130006d89 tempest-SnapshotsActionsTest-295135696 None] Flow 'volume_create_manager' (957dc781-afff-4a61-89ab-045dc13e9e15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:11:52 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-1325da6d-44aa-4790-b134-4e2130006d89 tempest-SnapshotsActionsTest-295135696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (706d04fc-9957-4307-a322-d9eb28c1d585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:11:52 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-1325da6d-44aa-4790-b134-4e2130006d89 tempest-SnapshotsActionsTest-295135696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (706d04fc-9957-4307-a322-d9eb28c1d585) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:11:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-120192081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08615ae8-52d0-43c6-9c67-7710d8190981,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03cfd7a4009043bbb0db6cf66b9739ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:11:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:11:53Z,use_quota=True,user_id='e49cc121a6b84d55bc1685e498f31537',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:11:52 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-1325da6d-44aa-4790-b134-4e2130006d89 tempest-SnapshotsActionsTest-295135696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f21d478-ac41-4faf-8121-22cd248f3a48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:11:52 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-1325da6d-44aa-4790-b134-4e2130006d89 tempest-SnapshotsActionsTest-295135696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f21d478-ac41-4faf-8121-22cd248f3a48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:11:52 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-1325da6d-44aa-4790-b134-4e2130006d89 tempest-SnapshotsActionsTest-295135696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e970822-a253-4ae5-a589-653d010569c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:11:52 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-1325da6d-44aa-4790-b134-4e2130006d89 tempest-SnapshotsActionsTest-295135696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e970822-a253-4ae5-a589-653d010569c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08615ae8-52d0-43c6-9c67-7710d8190981', 'volume_name': 'volume-08615ae8-52d0-43c6-9c67-7710d8190981', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:11:52 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-1325da6d-44aa-4790-b134-4e2130006d89 tempest-SnapshotsActionsTest-295135696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d875bcaf-a95c-4c4b-b33b-e887d43ad7e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:11:52 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-1325da6d-44aa-4790-b134-4e2130006d89 tempest-SnapshotsActionsTest-295135696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d875bcaf-a95c-4c4b-b33b-e887d43ad7e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:11:52 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-1325da6d-44aa-4790-b134-4e2130006d89 tempest-SnapshotsActionsTest-295135696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c25a7ae7-6386-460a-84b8-feb2bda0ba00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:11:52 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-1325da6d-44aa-4790-b134-4e2130006d89 tempest-SnapshotsActionsTest-295135696 None] Volume 08615ae8-52d0-43c6-9c67-7710d8190981: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08615ae8-52d0-43c6-9c67-7710d8190981', 'volume_size': 1} Apr 16 15:11:52 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-1325da6d-44aa-4790-b134-4e2130006d89 tempest-SnapshotsActionsTest-295135696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:11:52 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-1325da6d-44aa-4790-b134-4e2130006d89 tempest-SnapshotsActionsTest-295135696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:11:52 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-1325da6d-44aa-4790-b134-4e2130006d89 tempest-SnapshotsActionsTest-295135696 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:11:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-120192081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08615ae8-52d0-43c6-9c67-7710d8190981,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03cfd7a4009043bbb0db6cf66b9739ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:11:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:11:53Z,use_quota=True,user_id='e49cc121a6b84d55bc1685e498f31537',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)}" {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 15:11:52 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-1325da6d-44aa-4790-b134-4e2130006d89 tempest-SnapshotsActionsTest-295135696 None] Creating volume 08615ae8-52d0-43c6-9c67-7710d8190981 {{(pid=82756) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 15:11:52 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-1325da6d-44aa-4790-b134-4e2130006d89 tempest-SnapshotsActionsTest-295135696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:11:52 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-1325da6d-44aa-4790-b134-4e2130006d89 tempest-SnapshotsActionsTest-295135696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:11:52 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-1325da6d-44aa-4790-b134-4e2130006d89 tempest-SnapshotsActionsTest-295135696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:11:52 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-1325da6d-44aa-4790-b134-4e2130006d89 tempest-SnapshotsActionsTest-295135696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:11:52 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-1325da6d-44aa-4790-b134-4e2130006d89 tempest-SnapshotsActionsTest-295135696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:11:52 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-1325da6d-44aa-4790-b134-4e2130006d89 tempest-SnapshotsActionsTest-295135696 None] Selected osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 as target Quobyte volume. {{(pid=82756) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 15:11:52 devstack cinder-volume[82756]: INFO cinder.volume.drivers.remotefs [None req-1325da6d-44aa-4790-b134-4e2130006d89 tempest-SnapshotsActionsTest-295135696 None] casted to osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 Apr 16 15:11:52 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-1325da6d-44aa-4790-b134-4e2130006d89 tempest-SnapshotsActionsTest-295135696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981 1073741824 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:52 devstack sudo[89345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981 1073741824 Apr 16 15:11:52 devstack sudo[89345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:53 devstack sudo[89345]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:53 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-1325da6d-44aa-4790-b134-4e2130006d89 tempest-SnapshotsActionsTest-295135696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981 1073741824" returned: 0 in 0.515s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:53 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-1325da6d-44aa-4790-b134-4e2130006d89 tempest-SnapshotsActionsTest-295135696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:53 devstack sudo[89350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981 Apr 16 15:11:53 devstack sudo[89350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:53 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c1a750f-a2e4-4745-893b-20e35a4fd491 tempest-VolumeDependencyTests-70634728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82756) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 15:11:53 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-5c1a750f-a2e4-4745-893b-20e35a4fd491 tempest-VolumeDependencyTests-70634728 None] Flow 'volume_create_manager' (b0936088-cda8-42b8-a89c-cd04d0dde080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:11:53 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-5c1a750f-a2e4-4745-893b-20e35a4fd491 tempest-VolumeDependencyTests-70634728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84ce86a7-8d83-4871-9065-97350fe012d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:11:53 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-5c1a750f-a2e4-4745-893b-20e35a4fd491 tempest-VolumeDependencyTests-70634728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84ce86a7-8d83-4871-9065-97350fe012d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:11:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-578619787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b59f578c-b491-413a-81a9-fb5544e39008,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66327cc4da7e4c94ae71ea059af6e5e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:11:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=26c9a2ff-a248-4813-9a80-ca6ab189d676,status='creating',terminated_at=None,updated_at=2026-04-16T13:11:53Z,use_quota=True,user_id='09d3295b684d4588a231683460edc860',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:11:53 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-5c1a750f-a2e4-4745-893b-20e35a4fd491 tempest-VolumeDependencyTests-70634728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cd4a153-0f58-495d-acaa-2b182efe5739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:11:53 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-5c1a750f-a2e4-4745-893b-20e35a4fd491 tempest-VolumeDependencyTests-70634728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cd4a153-0f58-495d-acaa-2b182efe5739) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:11:53 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-5c1a750f-a2e4-4745-893b-20e35a4fd491 tempest-VolumeDependencyTests-70634728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddc9976c-0e75-4802-8613-3a713bfff320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:11:53 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-5c1a750f-a2e4-4745-893b-20e35a4fd491 tempest-VolumeDependencyTests-70634728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddc9976c-0e75-4802-8613-3a713bfff320) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'b59f578c-b491-413a-81a9-fb5544e39008', 'volume_name': 'volume-b59f578c-b491-413a-81a9-fb5544e39008', 'volume_size': 1, 'source_volid': '26c9a2ff-a248-4813-9a80-ca6ab189d676', 'source_volstatus': 'available'}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:11:53 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-5c1a750f-a2e4-4745-893b-20e35a4fd491 tempest-VolumeDependencyTests-70634728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dee298b-e0a1-41ed-80c8-2970fc1a9aba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:11:53 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-5c1a750f-a2e4-4745-893b-20e35a4fd491 tempest-VolumeDependencyTests-70634728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dee298b-e0a1-41ed-80c8-2970fc1a9aba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:11:53 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-5c1a750f-a2e4-4745-893b-20e35a4fd491 tempest-VolumeDependencyTests-70634728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (010b377d-c7f3-423f-beef-f60afd7b978e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:11:53 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-5c1a750f-a2e4-4745-893b-20e35a4fd491 tempest-VolumeDependencyTests-70634728 None] Volume b59f578c-b491-413a-81a9-fb5544e39008: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-b59f578c-b491-413a-81a9-fb5544e39008', 'volume_size': 1, 'source_volid': '26c9a2ff-a248-4813-9a80-ca6ab189d676', 'source_volstatus': 'available'} Apr 16 15:11:53 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-5c1a750f-a2e4-4745-893b-20e35a4fd491 tempest-VolumeDependencyTests-70634728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:11:53 devstack sudo[89350]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:53 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-1325da6d-44aa-4790-b134-4e2130006d89 tempest-SnapshotsActionsTest-295135696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981" returned: 0 in 0.476s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:53 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-1325da6d-44aa-4790-b134-4e2130006d89 tempest-SnapshotsActionsTest-295135696 None] <== create_volume: return (1015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'} {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 15:11:53 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-1325da6d-44aa-4790-b134-4e2130006d89 tempest-SnapshotsActionsTest-295135696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.017s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:11:53 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-5c1a750f-a2e4-4745-893b-20e35a4fd491 tempest-VolumeDependencyTests-70634728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.269s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:11:53 devstack cinder-volume[82756]: INFO cinder.volume.drivers.remotefs [None req-5c1a750f-a2e4-4745-893b-20e35a4fd491 tempest-VolumeDependencyTests-70634728 None] Cloning volume 26c9a2ff-a248-4813-9a80-ca6ab189d676 to volume b59f578c-b491-413a-81a9-fb5544e39008 Apr 16 15:11:53 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-1325da6d-44aa-4790-b134-4e2130006d89 tempest-SnapshotsActionsTest-295135696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c25a7ae7-6386-460a-84b8-feb2bda0ba00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08615ae8-52d0-43c6-9c67-7710d8190981', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:11:53 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-1325da6d-44aa-4790-b134-4e2130006d89 tempest-SnapshotsActionsTest-295135696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea871ce1-d859-4101-b433-49daaf4b7e64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:11:53 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-1325da6d-44aa-4790-b134-4e2130006d89 tempest-SnapshotsActionsTest-295135696 None] Volume volume-08615ae8-52d0-43c6-9c67-7710d8190981 (08615ae8-52d0-43c6-9c67-7710d8190981): created successfully Apr 16 15:11:53 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-1325da6d-44aa-4790-b134-4e2130006d89 tempest-SnapshotsActionsTest-295135696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea871ce1-d859-4101-b433-49daaf4b7e64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:11:53 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-1325da6d-44aa-4790-b134-4e2130006d89 tempest-SnapshotsActionsTest-295135696 None] Flow 'volume_create_manager' (957dc781-afff-4a61-89ab-045dc13e9e15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:11:53 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-5c1a750f-a2e4-4745-893b-20e35a4fd491 tempest-VolumeDependencyTests-70634728 None] Creating offline snapshot 7b40358b-d4ca-47c1-82c5-8bf875cbd411 of volume 26c9a2ff-a248-4813-9a80-ca6ab189d676 {{(pid=82756) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 16 15:11:53 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-1325da6d-44aa-4790-b134-4e2130006d89 tempest-SnapshotsActionsTest-295135696 None] Created volume successfully. Apr 16 15:11:53 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3d7ac57-4fca-4894-90f4-5673ef47dcf4]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:11:53 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-5c1a750f-a2e4-4745-893b-20e35a4fd491 tempest-VolumeDependencyTests-70634728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-26c9a2ff-a248-4813-9a80-ca6ab189d676 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:53 devstack sudo[89354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-26c9a2ff-a248-4813-9a80-ca6ab189d676 Apr 16 15:11:53 devstack sudo[89354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:54 devstack sudo[89354]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:54 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-5c1a750f-a2e4-4745-893b-20e35a4fd491 tempest-VolumeDependencyTests-70634728 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-26c9a2ff-a248-4813-9a80-ca6ab189d676" returned: 0 in 0.483s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:54 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-5c1a750f-a2e4-4745-893b-20e35a4fd491 tempest-VolumeDependencyTests-70634728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-26c9a2ff-a248-4813-9a80-ca6ab189d676,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-26c9a2ff-a248-4813-9a80-ca6ab189d676.7b40358b-d4ca-47c1-82c5-8bf875cbd411 1G {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:54 devstack sudo[89359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-26c9a2ff-a248-4813-9a80-ca6ab189d676,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-26c9a2ff-a248-4813-9a80-ca6ab189d676.7b40358b-d4ca-47c1-82c5-8bf875cbd411 1G Apr 16 15:11:54 devstack sudo[89359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:54 devstack sudo[89359]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:54 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-5c1a750f-a2e4-4745-893b-20e35a4fd491 tempest-VolumeDependencyTests-70634728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-26c9a2ff-a248-4813-9a80-ca6ab189d676,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-26c9a2ff-a248-4813-9a80-ca6ab189d676.7b40358b-d4ca-47c1-82c5-8bf875cbd411 1G" returned: 0 in 0.495s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:54 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-5c1a750f-a2e4-4745-893b-20e35a4fd491 tempest-VolumeDependencyTests-70634728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26c9a2ff-a248-4813-9a80-ca6ab189d676 -F qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-26c9a2ff-a248-4813-9a80-ca6ab189d676.7b40358b-d4ca-47c1-82c5-8bf875cbd411 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:54 devstack sudo[89364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26c9a2ff-a248-4813-9a80-ca6ab189d676 -F qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-26c9a2ff-a248-4813-9a80-ca6ab189d676.7b40358b-d4ca-47c1-82c5-8bf875cbd411 Apr 16 15:11:54 devstack sudo[89364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:54 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-adad9abe-5443-4ac8-bc21-3514d849192a tempest-SnapshotsActionsTest-295135696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:11:55 devstack sudo[89364]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:55 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-5c1a750f-a2e4-4745-893b-20e35a4fd491 tempest-VolumeDependencyTests-70634728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26c9a2ff-a248-4813-9a80-ca6ab189d676 -F qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-26c9a2ff-a248-4813-9a80-ca6ab189d676.7b40358b-d4ca-47c1-82c5-8bf875cbd411" returned: 0 in 0.411s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:55 devstack cinder-volume[82756]: WARNING cinder.volume.drivers.remotefs [None req-5c1a750f-a2e4-4745-893b-20e35a4fd491 tempest-VolumeDependencyTests-70634728 None] /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-26c9a2ff-a248-4813-9a80-ca6ab189d676.7b40358b-d4ca-47c1-82c5-8bf875cbd411 is being set with open permissions: ugo+rw Apr 16 15:11:55 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-5c1a750f-a2e4-4745-893b-20e35a4fd491 tempest-VolumeDependencyTests-70634728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-26c9a2ff-a248-4813-9a80-ca6ab189d676.7b40358b-d4ca-47c1-82c5-8bf875cbd411 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:55 devstack sudo[89369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-26c9a2ff-a248-4813-9a80-ca6ab189d676.7b40358b-d4ca-47c1-82c5-8bf875cbd411 Apr 16 15:11:55 devstack sudo[89369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:55 devstack sudo[89369]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:55 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-5c1a750f-a2e4-4745-893b-20e35a4fd491 tempest-VolumeDependencyTests-70634728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-26c9a2ff-a248-4813-9a80-ca6ab189d676.7b40358b-d4ca-47c1-82c5-8bf875cbd411" returned: 0 in 0.392s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:55 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-5c1a750f-a2e4-4745-893b-20e35a4fd491 tempest-VolumeDependencyTests-70634728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-26c9a2ff-a248-4813-9a80-ca6ab189d676.info {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:55 devstack sudo[89372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-26c9a2ff-a248-4813-9a80-ca6ab189d676.info Apr 16 15:11:55 devstack sudo[89372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:56 devstack sudo[89372]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:56 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-5c1a750f-a2e4-4745-893b-20e35a4fd491 tempest-VolumeDependencyTests-70634728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-26c9a2ff-a248-4813-9a80-ca6ab189d676.info" returned: 0 in 0.390s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:56 devstack cinder-volume[82756]: WARNING cinder.volume.drivers.remotefs [None req-5c1a750f-a2e4-4745-893b-20e35a4fd491 tempest-VolumeDependencyTests-70634728 None] /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-26c9a2ff-a248-4813-9a80-ca6ab189d676.info is being set with open permissions: ugo+rw Apr 16 15:11:56 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-5c1a750f-a2e4-4745-893b-20e35a4fd491 tempest-VolumeDependencyTests-70634728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-26c9a2ff-a248-4813-9a80-ca6ab189d676.info {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:56 devstack sudo[89375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-26c9a2ff-a248-4813-9a80-ca6ab189d676.info Apr 16 15:11:56 devstack sudo[89375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:56 devstack sudo[89375]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:56 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-5c1a750f-a2e4-4745-893b-20e35a4fd491 tempest-VolumeDependencyTests-70634728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-26c9a2ff-a248-4813-9a80-ca6ab189d676.info" returned: 0 in 0.394s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:56 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-5c1a750f-a2e4-4745-893b-20e35a4fd491 tempest-VolumeDependencyTests-70634728 None] Acquiring lock "cinder-quobyte-b59f578c-b491-413a-81a9-fb5544e39008" by "_copy_volume_from_snapshot" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:11:56 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-5c1a750f-a2e4-4745-893b-20e35a4fd491 tempest-VolumeDependencyTests-70634728 None] Lock "cinder-quobyte-b59f578c-b491-413a-81a9-fb5544e39008" acquired by "_copy_volume_from_snapshot" :: waited 0.010s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:11:56 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-5c1a750f-a2e4-4745-893b-20e35a4fd491 tempest-VolumeDependencyTests-70634728 None] snapshot: 7b40358b-d4ca-47c1-82c5-8bf875cbd411, volume: b59f578c-b491-413a-81a9-fb5544e39008, {{(pid=82756) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 16 15:11:56 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-5c1a750f-a2e4-4745-893b-20e35a4fd491 tempest-VolumeDependencyTests-70634728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:11:56 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-5c1a750f-a2e4-4745-893b-20e35a4fd491 tempest-VolumeDependencyTests-70634728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:11:56 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-5c1a750f-a2e4-4745-893b-20e35a4fd491 tempest-VolumeDependencyTests-70634728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:11:56 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-5c1a750f-a2e4-4745-893b-20e35a4fd491 tempest-VolumeDependencyTests-70634728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:11:56 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-5c1a750f-a2e4-4745-893b-20e35a4fd491 tempest-VolumeDependencyTests-70634728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:11:56 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc36dfc6-ab3a-4db9-a538-eb324ced85b5]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:11:56 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-5c1a750f-a2e4-4745-893b-20e35a4fd491 tempest-VolumeDependencyTests-70634728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-26c9a2ff-a248-4813-9a80-ca6ab189d676.7b40358b-d4ca-47c1-82c5-8bf875cbd411 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:56 devstack sudo[89378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-26c9a2ff-a248-4813-9a80-ca6ab189d676.7b40358b-d4ca-47c1-82c5-8bf875cbd411 Apr 16 15:11:56 devstack sudo[89378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:56 devstack sudo[89378]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:56 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-5c1a750f-a2e4-4745-893b-20e35a4fd491 tempest-VolumeDependencyTests-70634728 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-26c9a2ff-a248-4813-9a80-ca6ab189d676.7b40358b-d4ca-47c1-82c5-8bf875cbd411" returned: 0 in 0.436s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:56 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-5c1a750f-a2e4-4745-893b-20e35a4fd491 tempest-VolumeDependencyTests-70634728 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-26c9a2ff-a248-4813-9a80-ca6ab189d676(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82756) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 15:11:56 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-5c1a750f-a2e4-4745-893b-20e35a4fd491 tempest-VolumeDependencyTests-70634728 None] will copy from snapshot at /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-26c9a2ff-a248-4813-9a80-ca6ab189d676 {{(pid=82756) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 16 15:11:56 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-5c1a750f-a2e4-4745-893b-20e35a4fd491 tempest-VolumeDependencyTests-70634728 None] Creating direct copy from snapshot {{(pid=82756) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 16 15:11:56 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[edaa7d45-38e8-4fa4-9e54-a9d9bf31df49]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:11:56 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-5c1a750f-a2e4-4745-893b-20e35a4fd491 tempest-VolumeDependencyTests-70634728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-26c9a2ff-a248-4813-9a80-ca6ab189d676 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:57 devstack sudo[89383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-26c9a2ff-a248-4813-9a80-ca6ab189d676 Apr 16 15:11:57 devstack sudo[89383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:57 devstack sudo[89383]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:57 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-5c1a750f-a2e4-4745-893b-20e35a4fd491 tempest-VolumeDependencyTests-70634728 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-26c9a2ff-a248-4813-9a80-ca6ab189d676" returned: 0 in 0.445s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:57 devstack cinder-volume[82756]: DEBUG cinder.utils [None req-5c1a750f-a2e4-4745-893b-20e35a4fd491 tempest-VolumeDependencyTests-70634728 None] Path /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b59f578c-b491-413a-81a9-fb5544e39008 not found in is_blk_device check {{(pid=82756) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 16 15:11:57 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-5c1a750f-a2e4-4745-893b-20e35a4fd491 tempest-VolumeDependencyTests-70634728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-26c9a2ff-a248-4813-9a80-ca6ab189d676 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b59f578c-b491-413a-81a9-fb5544e39008 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:57 devstack sudo[89388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-26c9a2ff-a248-4813-9a80-ca6ab189d676 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b59f578c-b491-413a-81a9-fb5544e39008 Apr 16 15:11:57 devstack sudo[89388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:59 devstack sudo[89388]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:59 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-5c1a750f-a2e4-4745-893b-20e35a4fd491 tempest-VolumeDependencyTests-70634728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-26c9a2ff-a248-4813-9a80-ca6ab189d676 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b59f578c-b491-413a-81a9-fb5544e39008" returned: 0 in 1.935s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:59 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d81959b-6489-4fb1-8faa-b6d45e666358]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:11:59 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-5c1a750f-a2e4-4745-893b-20e35a4fd491 tempest-VolumeDependencyTests-70634728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-26c9a2ff-a248-4813-9a80-ca6ab189d676 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:59 devstack sudo[89402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-26c9a2ff-a248-4813-9a80-ca6ab189d676 Apr 16 15:11:59 devstack sudo[89402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:11:59 devstack sudo[89402]: pam_unix(sudo:session): session closed for user root Apr 16 15:11:59 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-5c1a750f-a2e4-4745-893b-20e35a4fd491 tempest-VolumeDependencyTests-70634728 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-26c9a2ff-a248-4813-9a80-ca6ab189d676" returned: 0 in 0.570s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:11:59 devstack cinder-volume[82756]: DEBUG cinder.image.image_utils [None req-5c1a750f-a2e4-4745-893b-20e35a4fd491 tempest-VolumeDependencyTests-70634728 None] Image conversion details: src /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-26c9a2ff-a248-4813-9a80-ca6ab189d676, size 1024.00 MB, duration 1.94 sec, destination /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b59f578c-b491-413a-81a9-fb5544e39008 {{(pid=82756) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 15:11:59 devstack cinder-volume[82756]: INFO cinder.image.image_utils [None req-5c1a750f-a2e4-4745-893b-20e35a4fd491 tempest-VolumeDependencyTests-70634728 None] Converted 1024.00 MB image at 528.82 MB/s Apr 16 15:11:59 devstack cinder-volume[82756]: WARNING cinder.volume.drivers.remotefs [None req-5c1a750f-a2e4-4745-893b-20e35a4fd491 tempest-VolumeDependencyTests-70634728 None] /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b59f578c-b491-413a-81a9-fb5544e39008 is being set with open permissions: ugo+rw Apr 16 15:11:59 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-5c1a750f-a2e4-4745-893b-20e35a4fd491 tempest-VolumeDependencyTests-70634728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b59f578c-b491-413a-81a9-fb5544e39008 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:11:59 devstack sudo[89407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b59f578c-b491-413a-81a9-fb5544e39008 Apr 16 15:11:59 devstack sudo[89407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:12:00 devstack sudo[89407]: pam_unix(sudo:session): session closed for user root Apr 16 15:12:00 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-5c1a750f-a2e4-4745-893b-20e35a4fd491 tempest-VolumeDependencyTests-70634728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b59f578c-b491-413a-81a9-fb5544e39008" returned: 0 in 0.396s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:12:00 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-5c1a750f-a2e4-4745-893b-20e35a4fd491 tempest-VolumeDependencyTests-70634728 None] Lock "cinder-quobyte-b59f578c-b491-413a-81a9-fb5544e39008" released by "_copy_volume_from_snapshot" :: held 3.836s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:12:00 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-5c1a750f-a2e4-4745-893b-20e35a4fd491 tempest-VolumeDependencyTests-70634728 None] Acquiring lock "cinder-quobyte-7b40358b-d4ca-47c1-82c5-8bf875cbd411" by "_delete_snapshot" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:12:00 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-5c1a750f-a2e4-4745-893b-20e35a4fd491 tempest-VolumeDependencyTests-70634728 None] Lock "cinder-quobyte-7b40358b-d4ca-47c1-82c5-8bf875cbd411" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:12:00 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-5c1a750f-a2e4-4745-893b-20e35a4fd491 tempest-VolumeDependencyTests-70634728 None] Deleting offline snapshot 7b40358b-d4ca-47c1-82c5-8bf875cbd411 of volume 26c9a2ff-a248-4813-9a80-ca6ab189d676 {{(pid=82756) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 15:12:00 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-5c1a750f-a2e4-4745-893b-20e35a4fd491 tempest-VolumeDependencyTests-70634728 None] snapshot_file for this snap is: volume-26c9a2ff-a248-4813-9a80-ca6ab189d676.7b40358b-d4ca-47c1-82c5-8bf875cbd411 {{(pid=82756) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 15:12:00 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0e469b7-fc70-4e23-a94b-f89f0049a76a]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:12:00 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-5c1a750f-a2e4-4745-893b-20e35a4fd491 tempest-VolumeDependencyTests-70634728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-26c9a2ff-a248-4813-9a80-ca6ab189d676.7b40358b-d4ca-47c1-82c5-8bf875cbd411 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:12:00 devstack sudo[89410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-26c9a2ff-a248-4813-9a80-ca6ab189d676.7b40358b-d4ca-47c1-82c5-8bf875cbd411 Apr 16 15:12:00 devstack sudo[89410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:12:00 devstack sudo[89410]: pam_unix(sudo:session): session closed for user root Apr 16 15:12:00 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-5c1a750f-a2e4-4745-893b-20e35a4fd491 tempest-VolumeDependencyTests-70634728 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-26c9a2ff-a248-4813-9a80-ca6ab189d676.7b40358b-d4ca-47c1-82c5-8bf875cbd411" returned: 0 in 0.456s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:12:00 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-5c1a750f-a2e4-4745-893b-20e35a4fd491 tempest-VolumeDependencyTests-70634728 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-26c9a2ff-a248-4813-9a80-ca6ab189d676(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82756) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 15:12:00 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e7d6278-1a9e-467f-a6db-99ae90353d96]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:12:00 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-5c1a750f-a2e4-4745-893b-20e35a4fd491 tempest-VolumeDependencyTests-70634728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-26c9a2ff-a248-4813-9a80-ca6ab189d676 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:12:00 devstack sudo[89415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-26c9a2ff-a248-4813-9a80-ca6ab189d676 Apr 16 15:12:00 devstack sudo[89415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:12:01 devstack sudo[89415]: pam_unix(sudo:session): session closed for user root Apr 16 15:12:01 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-5c1a750f-a2e4-4745-893b-20e35a4fd491 tempest-VolumeDependencyTests-70634728 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-26c9a2ff-a248-4813-9a80-ca6ab189d676" returned: 0 in 0.452s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:12:01 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-5c1a750f-a2e4-4745-893b-20e35a4fd491 tempest-VolumeDependencyTests-70634728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-26c9a2ff-a248-4813-9a80-ca6ab189d676.7b40358b-d4ca-47c1-82c5-8bf875cbd411 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:12:01 devstack sudo[89420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-26c9a2ff-a248-4813-9a80-ca6ab189d676.7b40358b-d4ca-47c1-82c5-8bf875cbd411 Apr 16 15:12:01 devstack sudo[89420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:12:01 devstack sudo[89420]: pam_unix(sudo:session): session closed for user root Apr 16 15:12:01 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-5c1a750f-a2e4-4745-893b-20e35a4fd491 tempest-VolumeDependencyTests-70634728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-26c9a2ff-a248-4813-9a80-ca6ab189d676.7b40358b-d4ca-47c1-82c5-8bf875cbd411" returned: 0 in 0.476s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:12:01 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-5c1a750f-a2e4-4745-893b-20e35a4fd491 tempest-VolumeDependencyTests-70634728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-26c9a2ff-a248-4813-9a80-ca6ab189d676.7b40358b-d4ca-47c1-82c5-8bf875cbd411 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:12:01 devstack sudo[89463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-26c9a2ff-a248-4813-9a80-ca6ab189d676.7b40358b-d4ca-47c1-82c5-8bf875cbd411 Apr 16 15:12:01 devstack sudo[89463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:12:02 devstack sudo[89463]: pam_unix(sudo:session): session closed for user root Apr 16 15:12:02 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-5c1a750f-a2e4-4745-893b-20e35a4fd491 tempest-VolumeDependencyTests-70634728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-26c9a2ff-a248-4813-9a80-ca6ab189d676.7b40358b-d4ca-47c1-82c5-8bf875cbd411" returned: 0 in 0.388s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:12:02 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-5c1a750f-a2e4-4745-893b-20e35a4fd491 tempest-VolumeDependencyTests-70634728 None] Lock "cinder-quobyte-7b40358b-d4ca-47c1-82c5-8bf875cbd411" released by "_delete_snapshot" :: held 1.821s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:12:02 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-5c1a750f-a2e4-4745-893b-20e35a4fd491 tempest-VolumeDependencyTests-70634728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 8.404s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:12:02 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-adad9abe-5443-4ac8-bc21-3514d849192a tempest-SnapshotsActionsTest-295135696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.242s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:12:02 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-5c1a750f-a2e4-4745-893b-20e35a4fd491 tempest-VolumeDependencyTests-70634728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (010b377d-c7f3-423f-beef-f60afd7b978e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b59f578c-b491-413a-81a9-fb5544e39008', 'volume_size': 1, 'source_volid': '26c9a2ff-a248-4813-9a80-ca6ab189d676', 'source_volstatus': 'available'}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:12:02 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-5c1a750f-a2e4-4745-893b-20e35a4fd491 tempest-VolumeDependencyTests-70634728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df513af3-2b07-44e9-b22b-0d4eb3c92e48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:12:02 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-adad9abe-5443-4ac8-bc21-3514d849192a tempest-SnapshotsActionsTest-295135696 None] Creating offline snapshot 2f0ed87e-fe71-404f-ae88-58fa85f36866 of volume 08615ae8-52d0-43c6-9c67-7710d8190981 {{(pid=82756) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 16 15:12:02 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-5c1a750f-a2e4-4745-893b-20e35a4fd491 tempest-VolumeDependencyTests-70634728 None] Volume volume-b59f578c-b491-413a-81a9-fb5544e39008 (b59f578c-b491-413a-81a9-fb5544e39008): created successfully Apr 16 15:12:02 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-5c1a750f-a2e4-4745-893b-20e35a4fd491 tempest-VolumeDependencyTests-70634728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df513af3-2b07-44e9-b22b-0d4eb3c92e48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:12:02 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-5c1a750f-a2e4-4745-893b-20e35a4fd491 tempest-VolumeDependencyTests-70634728 None] Flow 'volume_create_manager' (b0936088-cda8-42b8-a89c-cd04d0dde080) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:12:02 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[019ed160-8328-4722-b7b7-23315aa5d19c]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:12:02 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-adad9abe-5443-4ac8-bc21-3514d849192a tempest-SnapshotsActionsTest-295135696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:12:02 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-5c1a750f-a2e4-4745-893b-20e35a4fd491 tempest-VolumeDependencyTests-70634728 None] Created volume successfully. Apr 16 15:12:02 devstack sudo[89468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981 Apr 16 15:12:02 devstack sudo[89468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:12:02 devstack sudo[89468]: pam_unix(sudo:session): session closed for user root Apr 16 15:12:02 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-adad9abe-5443-4ac8-bc21-3514d849192a tempest-SnapshotsActionsTest-295135696 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981" returned: 0 in 0.469s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:12:02 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-adad9abe-5443-4ac8-bc21-3514d849192a tempest-SnapshotsActionsTest-295135696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.2f0ed87e-fe71-404f-ae88-58fa85f36866 1G {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:12:02 devstack sudo[89473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.2f0ed87e-fe71-404f-ae88-58fa85f36866 1G Apr 16 15:12:02 devstack sudo[89473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:12:02 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-33155535-aa5f-4690-807b-6d1382de8ff3 tempest-VolumeDependencyTests-70634728 None] Acquiring lock "cinder-26c9a2ff-a248-4813-9a80-ca6ab189d676-delete_volume" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:12:02 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-33155535-aa5f-4690-807b-6d1382de8ff3 tempest-VolumeDependencyTests-70634728 None] Lock "cinder-26c9a2ff-a248-4813-9a80-ca6ab189d676-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:12:02 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-33155535-aa5f-4690-807b-6d1382de8ff3 tempest-VolumeDependencyTests-70634728 None] Acquiring lock "cinder-quobyte-26c9a2ff-a248-4813-9a80-ca6ab189d676" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:12:02 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-33155535-aa5f-4690-807b-6d1382de8ff3 tempest-VolumeDependencyTests-70634728 None] Lock "cinder-quobyte-26c9a2ff-a248-4813-9a80-ca6ab189d676" acquired by "delete_volume" :: waited 0.008s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:12:02 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[f231a74b-4d8b-47c8-b9fe-3cdaedbbba13]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:12:02 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-33155535-aa5f-4690-807b-6d1382de8ff3 tempest-VolumeDependencyTests-70634728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-26c9a2ff-a248-4813-9a80-ca6ab189d676 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:12:03 devstack sudo[89475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-26c9a2ff-a248-4813-9a80-ca6ab189d676 Apr 16 15:12:03 devstack sudo[89475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:12:03 devstack sudo[89473]: pam_unix(sudo:session): session closed for user root Apr 16 15:12:03 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-adad9abe-5443-4ac8-bc21-3514d849192a tempest-SnapshotsActionsTest-295135696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.2f0ed87e-fe71-404f-ae88-58fa85f36866 1G" returned: 0 in 0.482s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:12:03 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-adad9abe-5443-4ac8-bc21-3514d849192a tempest-SnapshotsActionsTest-295135696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08615ae8-52d0-43c6-9c67-7710d8190981 -F qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.2f0ed87e-fe71-404f-ae88-58fa85f36866 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:12:03 devstack sudo[89480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08615ae8-52d0-43c6-9c67-7710d8190981 -F qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.2f0ed87e-fe71-404f-ae88-58fa85f36866 Apr 16 15:12:03 devstack sudo[89480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:12:03 devstack sudo[89475]: pam_unix(sudo:session): session closed for user root Apr 16 15:12:03 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-33155535-aa5f-4690-807b-6d1382de8ff3 tempest-VolumeDependencyTests-70634728 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-26c9a2ff-a248-4813-9a80-ca6ab189d676" returned: 0 in 0.479s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:12:03 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-33155535-aa5f-4690-807b-6d1382de8ff3 tempest-VolumeDependencyTests-70634728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-26c9a2ff-a248-4813-9a80-ca6ab189d676 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:12:03 devstack sudo[89486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-26c9a2ff-a248-4813-9a80-ca6ab189d676 Apr 16 15:12:03 devstack sudo[89486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:12:03 devstack sudo[89480]: pam_unix(sudo:session): session closed for user root Apr 16 15:12:03 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-adad9abe-5443-4ac8-bc21-3514d849192a tempest-SnapshotsActionsTest-295135696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08615ae8-52d0-43c6-9c67-7710d8190981 -F qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.2f0ed87e-fe71-404f-ae88-58fa85f36866" returned: 0 in 0.430s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:12:03 devstack cinder-volume[82756]: WARNING cinder.volume.drivers.remotefs [None req-adad9abe-5443-4ac8-bc21-3514d849192a tempest-SnapshotsActionsTest-295135696 None] /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.2f0ed87e-fe71-404f-ae88-58fa85f36866 is being set with open permissions: ugo+rw Apr 16 15:12:03 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-adad9abe-5443-4ac8-bc21-3514d849192a tempest-SnapshotsActionsTest-295135696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.2f0ed87e-fe71-404f-ae88-58fa85f36866 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:12:03 devstack sudo[89491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.2f0ed87e-fe71-404f-ae88-58fa85f36866 Apr 16 15:12:03 devstack sudo[89491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:12:03 devstack sudo[89486]: pam_unix(sudo:session): session closed for user root Apr 16 15:12:03 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-33155535-aa5f-4690-807b-6d1382de8ff3 tempest-VolumeDependencyTests-70634728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-26c9a2ff-a248-4813-9a80-ca6ab189d676" returned: 0 in 0.408s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:12:03 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-33155535-aa5f-4690-807b-6d1382de8ff3 tempest-VolumeDependencyTests-70634728 None] Lock "cinder-quobyte-26c9a2ff-a248-4813-9a80-ca6ab189d676" released by "delete_volume" :: held 0.929s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:12:03 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-33155535-aa5f-4690-807b-6d1382de8ff3 tempest-VolumeDependencyTests-70634728 None] Created reservations ['658ca0b9-00dc-4472-b46d-d2a4fe9b2c5a', '3c049c0b-ce09-4a7f-b246-e6abae723d25', '196973d1-b4be-4806-ba6e-7002deec2dc3', '089e2583-cd9b-43d3-a433-fccbf88a4e5c'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:12:03 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-33155535-aa5f-4690-807b-6d1382de8ff3 tempest-VolumeDependencyTests-70634728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:12:03 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-33155535-aa5f-4690-807b-6d1382de8ff3 tempest-VolumeDependencyTests-70634728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:12:03 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-33155535-aa5f-4690-807b-6d1382de8ff3 tempest-VolumeDependencyTests-70634728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:12:03 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-33155535-aa5f-4690-807b-6d1382de8ff3 tempest-VolumeDependencyTests-70634728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:12:03 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-33155535-aa5f-4690-807b-6d1382de8ff3 tempest-VolumeDependencyTests-70634728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:12:03 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-33155535-aa5f-4690-807b-6d1382de8ff3 tempest-VolumeDependencyTests-70634728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:12:03 devstack sudo[89494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:12:03 devstack sudo[89494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:12:04 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-fa525b1c-d799-4633-a883-d438d4094e8d tempest-VolumeDependencyTests-70634728 None] Acquiring lock "cinder-b59f578c-b491-413a-81a9-fb5544e39008-delete_volume" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:12:04 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-fa525b1c-d799-4633-a883-d438d4094e8d tempest-VolumeDependencyTests-70634728 None] Lock "cinder-b59f578c-b491-413a-81a9-fb5544e39008-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:12:04 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-fa525b1c-d799-4633-a883-d438d4094e8d tempest-VolumeDependencyTests-70634728 None] Acquiring lock "cinder-quobyte-b59f578c-b491-413a-81a9-fb5544e39008" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:12:04 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-fa525b1c-d799-4633-a883-d438d4094e8d tempest-VolumeDependencyTests-70634728 None] Lock "cinder-quobyte-b59f578c-b491-413a-81a9-fb5544e39008" acquired by "delete_volume" :: waited 0.009s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:12:04 devstack sudo[89491]: pam_unix(sudo:session): session closed for user root Apr 16 15:12:04 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-adad9abe-5443-4ac8-bc21-3514d849192a tempest-SnapshotsActionsTest-295135696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.2f0ed87e-fe71-404f-ae88-58fa85f36866" returned: 0 in 0.495s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:12:04 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[03aee195-5faf-4ea5-8837-02ac211fb5c6]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:12:04 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-fa525b1c-d799-4633-a883-d438d4094e8d tempest-VolumeDependencyTests-70634728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b59f578c-b491-413a-81a9-fb5544e39008 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:12:04 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-adad9abe-5443-4ac8-bc21-3514d849192a tempest-SnapshotsActionsTest-295135696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.info {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:12:04 devstack sudo[89498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.info Apr 16 15:12:04 devstack sudo[89498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:12:04 devstack sudo[89497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b59f578c-b491-413a-81a9-fb5544e39008 Apr 16 15:12:04 devstack sudo[89497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:12:04 devstack sudo[89494]: pam_unix(sudo:session): session closed for user root Apr 16 15:12:04 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-33155535-aa5f-4690-807b-6d1382de8ff3 tempest-VolumeDependencyTests-70634728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.491s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:12:04 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-33155535-aa5f-4690-807b-6d1382de8ff3 tempest-VolumeDependencyTests-70634728 None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:12:04 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-33155535-aa5f-4690-807b-6d1382de8ff3 tempest-VolumeDependencyTests-70634728 None] Deleted volume successfully. Apr 16 15:12:04 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-33155535-aa5f-4690-807b-6d1382de8ff3 tempest-VolumeDependencyTests-70634728 None] Lock "cinder-26c9a2ff-a248-4813-9a80-ca6ab189d676-delete_volume" released by "delete_volume" :: held 1.557s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:12:04 devstack sudo[89498]: pam_unix(sudo:session): session closed for user root Apr 16 15:12:04 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-adad9abe-5443-4ac8-bc21-3514d849192a tempest-SnapshotsActionsTest-295135696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.info" returned: 0 in 0.456s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:12:04 devstack cinder-volume[82756]: WARNING cinder.volume.drivers.remotefs [None req-adad9abe-5443-4ac8-bc21-3514d849192a tempest-SnapshotsActionsTest-295135696 None] /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.info is being set with open permissions: ugo+rw Apr 16 15:12:04 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-adad9abe-5443-4ac8-bc21-3514d849192a tempest-SnapshotsActionsTest-295135696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.info {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:12:04 devstack sudo[89506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.info Apr 16 15:12:04 devstack sudo[89506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:12:04 devstack sudo[89497]: pam_unix(sudo:session): session closed for user root Apr 16 15:12:04 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-fa525b1c-d799-4633-a883-d438d4094e8d tempest-VolumeDependencyTests-70634728 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b59f578c-b491-413a-81a9-fb5544e39008" returned: 0 in 0.578s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:12:04 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-fa525b1c-d799-4633-a883-d438d4094e8d tempest-VolumeDependencyTests-70634728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b59f578c-b491-413a-81a9-fb5544e39008 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:12:04 devstack sudo[89508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b59f578c-b491-413a-81a9-fb5544e39008 Apr 16 15:12:04 devstack sudo[89508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:12:05 devstack sudo[89506]: pam_unix(sudo:session): session closed for user root Apr 16 15:12:05 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-adad9abe-5443-4ac8-bc21-3514d849192a tempest-SnapshotsActionsTest-295135696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.info" returned: 0 in 0.494s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:12:05 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-adad9abe-5443-4ac8-bc21-3514d849192a tempest-SnapshotsActionsTest-295135696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.930s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:12:05 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-adad9abe-5443-4ac8-bc21-3514d849192a tempest-SnapshotsActionsTest-295135696 None] Create snapshot completed successfully Apr 16 15:12:05 devstack sudo[89508]: pam_unix(sudo:session): session closed for user root Apr 16 15:12:05 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-fa525b1c-d799-4633-a883-d438d4094e8d tempest-VolumeDependencyTests-70634728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b59f578c-b491-413a-81a9-fb5544e39008" returned: 0 in 0.472s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:12:05 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-fa525b1c-d799-4633-a883-d438d4094e8d tempest-VolumeDependencyTests-70634728 None] Lock "cinder-quobyte-b59f578c-b491-413a-81a9-fb5544e39008" released by "delete_volume" :: held 1.089s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:12:05 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-fa525b1c-d799-4633-a883-d438d4094e8d tempest-VolumeDependencyTests-70634728 None] Created reservations ['6e42bd4e-c1fc-470c-a8ef-262d710c9d03', '7dce9f2e-a7d0-4583-b97b-e1acb088f3d2', '9c15924e-47ee-494b-817e-b5e9d6e5aa09', '36104a6d-4573-4c7e-aa40-2ed0f3bec79c'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:12:05 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-fa525b1c-d799-4633-a883-d438d4094e8d tempest-VolumeDependencyTests-70634728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:12:05 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-fa525b1c-d799-4633-a883-d438d4094e8d tempest-VolumeDependencyTests-70634728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:12:05 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-fa525b1c-d799-4633-a883-d438d4094e8d tempest-VolumeDependencyTests-70634728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:12:05 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-fa525b1c-d799-4633-a883-d438d4094e8d tempest-VolumeDependencyTests-70634728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:12:05 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-fa525b1c-d799-4633-a883-d438d4094e8d tempest-VolumeDependencyTests-70634728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:12:05 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-fa525b1c-d799-4633-a883-d438d4094e8d tempest-VolumeDependencyTests-70634728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:12:05 devstack sudo[89512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:12:05 devstack sudo[89512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:12:05 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-5051c1fa-668e-4d43-8ecc-e16438e578d4 tempest-SnapshotsActionsTest-295135696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:12:05 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-5051c1fa-668e-4d43-8ecc-e16438e578d4 tempest-SnapshotsActionsTest-295135696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:12:05 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-5051c1fa-668e-4d43-8ecc-e16438e578d4 tempest-SnapshotsActionsTest-295135696 None] Creating offline snapshot f6c954dd-3cd8-4525-91a8-ae9eae5ae9fe of volume 08615ae8-52d0-43c6-9c67-7710d8190981 {{(pid=82756) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 16 15:12:05 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[865d7aff-ecd6-4bef-9412-187e1ceaca13]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:12:05 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-5051c1fa-668e-4d43-8ecc-e16438e578d4 tempest-SnapshotsActionsTest-295135696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.2f0ed87e-fe71-404f-ae88-58fa85f36866 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:12:05 devstack sudo[89515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.2f0ed87e-fe71-404f-ae88-58fa85f36866 Apr 16 15:12:05 devstack sudo[89515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:12:05 devstack sudo[89512]: pam_unix(sudo:session): session closed for user root Apr 16 15:12:05 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-fa525b1c-d799-4633-a883-d438d4094e8d tempest-VolumeDependencyTests-70634728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.447s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:12:05 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-fa525b1c-d799-4633-a883-d438d4094e8d tempest-VolumeDependencyTests-70634728 None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:12:05 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-fa525b1c-d799-4633-a883-d438d4094e8d tempest-VolumeDependencyTests-70634728 None] Deleted volume successfully. Apr 16 15:12:05 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-fa525b1c-d799-4633-a883-d438d4094e8d tempest-VolumeDependencyTests-70634728 None] Lock "cinder-b59f578c-b491-413a-81a9-fb5544e39008-delete_volume" released by "delete_volume" :: held 1.679s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:12:06 devstack sudo[89515]: pam_unix(sudo:session): session closed for user root Apr 16 15:12:06 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-5051c1fa-668e-4d43-8ecc-e16438e578d4 tempest-SnapshotsActionsTest-295135696 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.2f0ed87e-fe71-404f-ae88-58fa85f36866" returned: 0 in 0.487s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:12:06 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-5051c1fa-668e-4d43-8ecc-e16438e578d4 tempest-SnapshotsActionsTest-295135696 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-08615ae8-52d0-43c6-9c67-7710d8190981(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82756) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 15:12:06 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-5051c1fa-668e-4d43-8ecc-e16438e578d4 tempest-SnapshotsActionsTest-295135696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.2f0ed87e-fe71-404f-ae88-58fa85f36866,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.f6c954dd-3cd8-4525-91a8-ae9eae5ae9fe 1G {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:12:06 devstack sudo[89520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.2f0ed87e-fe71-404f-ae88-58fa85f36866,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.f6c954dd-3cd8-4525-91a8-ae9eae5ae9fe 1G Apr 16 15:12:06 devstack sudo[89520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:12:06 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-bb546cc5-7f9e-4110-ae67-37fdc82e701c tempest-VolumeDependencyTests-70634728 None] Acquiring lock "cinder-f1cabcc5-3d3c-4403-834f-0b137ce05645-delete_volume" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:12:06 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-bb546cc5-7f9e-4110-ae67-37fdc82e701c tempest-VolumeDependencyTests-70634728 None] Lock "cinder-f1cabcc5-3d3c-4403-834f-0b137ce05645-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:12:06 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-bb546cc5-7f9e-4110-ae67-37fdc82e701c tempest-VolumeDependencyTests-70634728 None] Acquiring lock "cinder-quobyte-f1cabcc5-3d3c-4403-834f-0b137ce05645" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:12:06 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-bb546cc5-7f9e-4110-ae67-37fdc82e701c tempest-VolumeDependencyTests-70634728 None] Lock "cinder-quobyte-f1cabcc5-3d3c-4403-834f-0b137ce05645" acquired by "delete_volume" :: waited 0.008s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:12:06 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b431fcb-0d69-4fcd-add5-9d2ff6031672]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:12:06 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-bb546cc5-7f9e-4110-ae67-37fdc82e701c tempest-VolumeDependencyTests-70634728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-f1cabcc5-3d3c-4403-834f-0b137ce05645 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:12:06 devstack sudo[89522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-f1cabcc5-3d3c-4403-834f-0b137ce05645 Apr 16 15:12:06 devstack sudo[89522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:12:06 devstack sudo[89520]: pam_unix(sudo:session): session closed for user root Apr 16 15:12:06 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-5051c1fa-668e-4d43-8ecc-e16438e578d4 tempest-SnapshotsActionsTest-295135696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.2f0ed87e-fe71-404f-ae88-58fa85f36866,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.f6c954dd-3cd8-4525-91a8-ae9eae5ae9fe 1G" returned: 0 in 0.523s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:12:06 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-5051c1fa-668e-4d43-8ecc-e16438e578d4 tempest-SnapshotsActionsTest-295135696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08615ae8-52d0-43c6-9c67-7710d8190981.2f0ed87e-fe71-404f-ae88-58fa85f36866 -F qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.f6c954dd-3cd8-4525-91a8-ae9eae5ae9fe {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:12:06 devstack sudo[89527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08615ae8-52d0-43c6-9c67-7710d8190981.2f0ed87e-fe71-404f-ae88-58fa85f36866 -F qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.f6c954dd-3cd8-4525-91a8-ae9eae5ae9fe Apr 16 15:12:06 devstack sudo[89527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:12:06 devstack sudo[89522]: pam_unix(sudo:session): session closed for user root Apr 16 15:12:06 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-bb546cc5-7f9e-4110-ae67-37fdc82e701c tempest-VolumeDependencyTests-70634728 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-f1cabcc5-3d3c-4403-834f-0b137ce05645" returned: 0 in 0.504s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:12:06 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-bb546cc5-7f9e-4110-ae67-37fdc82e701c tempest-VolumeDependencyTests-70634728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-f1cabcc5-3d3c-4403-834f-0b137ce05645 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:12:06 devstack sudo[89532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-f1cabcc5-3d3c-4403-834f-0b137ce05645 Apr 16 15:12:06 devstack sudo[89532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:12:07 devstack sudo[89527]: pam_unix(sudo:session): session closed for user root Apr 16 15:12:07 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-5051c1fa-668e-4d43-8ecc-e16438e578d4 tempest-SnapshotsActionsTest-295135696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08615ae8-52d0-43c6-9c67-7710d8190981.2f0ed87e-fe71-404f-ae88-58fa85f36866 -F qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.f6c954dd-3cd8-4525-91a8-ae9eae5ae9fe" returned: 0 in 0.427s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:12:07 devstack cinder-volume[82756]: WARNING cinder.volume.drivers.remotefs [None req-5051c1fa-668e-4d43-8ecc-e16438e578d4 tempest-SnapshotsActionsTest-295135696 None] /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.f6c954dd-3cd8-4525-91a8-ae9eae5ae9fe is being set with open permissions: ugo+rw Apr 16 15:12:07 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-5051c1fa-668e-4d43-8ecc-e16438e578d4 tempest-SnapshotsActionsTest-295135696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.f6c954dd-3cd8-4525-91a8-ae9eae5ae9fe {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:12:07 devstack sudo[89537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.f6c954dd-3cd8-4525-91a8-ae9eae5ae9fe Apr 16 15:12:07 devstack sudo[89537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:12:07 devstack sudo[89532]: pam_unix(sudo:session): session closed for user root Apr 16 15:12:07 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-bb546cc5-7f9e-4110-ae67-37fdc82e701c tempest-VolumeDependencyTests-70634728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-f1cabcc5-3d3c-4403-834f-0b137ce05645" returned: 0 in 0.407s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:12:07 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-bb546cc5-7f9e-4110-ae67-37fdc82e701c tempest-VolumeDependencyTests-70634728 None] Lock "cinder-quobyte-f1cabcc5-3d3c-4403-834f-0b137ce05645" released by "delete_volume" :: held 0.940s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:12:07 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-bb546cc5-7f9e-4110-ae67-37fdc82e701c tempest-VolumeDependencyTests-70634728 None] Created reservations ['d96e906f-a0aa-42e1-80e4-8d2e160b3fd1', '5dd4e8ba-48db-404c-a254-195373f1d8d6', 'a103874d-3b3b-4257-8a22-f8ff0ea32e11', '26b06b06-f0ef-4cfc-ac33-8a06e48ca5a4'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:12:07 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-bb546cc5-7f9e-4110-ae67-37fdc82e701c tempest-VolumeDependencyTests-70634728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:12:07 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-bb546cc5-7f9e-4110-ae67-37fdc82e701c tempest-VolumeDependencyTests-70634728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:12:07 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-bb546cc5-7f9e-4110-ae67-37fdc82e701c tempest-VolumeDependencyTests-70634728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:12:07 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-bb546cc5-7f9e-4110-ae67-37fdc82e701c tempest-VolumeDependencyTests-70634728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:12:07 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-bb546cc5-7f9e-4110-ae67-37fdc82e701c tempest-VolumeDependencyTests-70634728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:12:07 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-bb546cc5-7f9e-4110-ae67-37fdc82e701c tempest-VolumeDependencyTests-70634728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:12:07 devstack sudo[89540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:12:07 devstack sudo[89540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:12:07 devstack sudo[89537]: pam_unix(sudo:session): session closed for user root Apr 16 15:12:07 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-5051c1fa-668e-4d43-8ecc-e16438e578d4 tempest-SnapshotsActionsTest-295135696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.f6c954dd-3cd8-4525-91a8-ae9eae5ae9fe" returned: 0 in 0.425s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:12:07 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-5051c1fa-668e-4d43-8ecc-e16438e578d4 tempest-SnapshotsActionsTest-295135696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.920s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:12:07 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-5051c1fa-668e-4d43-8ecc-e16438e578d4 tempest-SnapshotsActionsTest-295135696 None] Create snapshot completed successfully Apr 16 15:12:07 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-a836d757-3597-4f59-9507-41633a9b3f0d tempest-SnapshotsActionsTest-854366568 None] Acquiring lock "cinder-f6c954dd-3cd8-4525-91a8-ae9eae5ae9fe-delete_snapshot" by "delete_snapshot" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:12:07 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-a836d757-3597-4f59-9507-41633a9b3f0d tempest-SnapshotsActionsTest-854366568 None] Lock "cinder-f6c954dd-3cd8-4525-91a8-ae9eae5ae9fe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:12:07 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-a836d757-3597-4f59-9507-41633a9b3f0d tempest-SnapshotsActionsTest-854366568 None] Acquiring lock "cinder-quobyte-08615ae8-52d0-43c6-9c67-7710d8190981" by "delete_snapshot" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:12:07 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-a836d757-3597-4f59-9507-41633a9b3f0d tempest-SnapshotsActionsTest-854366568 None] Lock "cinder-quobyte-08615ae8-52d0-43c6-9c67-7710d8190981" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:12:07 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-a836d757-3597-4f59-9507-41633a9b3f0d tempest-SnapshotsActionsTest-854366568 None] Acquiring lock "cinder-quobyte-f6c954dd-3cd8-4525-91a8-ae9eae5ae9fe" by "_delete_snapshot" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:12:07 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-a836d757-3597-4f59-9507-41633a9b3f0d tempest-SnapshotsActionsTest-854366568 None] Lock "cinder-quobyte-f6c954dd-3cd8-4525-91a8-ae9eae5ae9fe" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:12:07 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-a836d757-3597-4f59-9507-41633a9b3f0d tempest-SnapshotsActionsTest-854366568 None] Deleting offline snapshot f6c954dd-3cd8-4525-91a8-ae9eae5ae9fe of volume 08615ae8-52d0-43c6-9c67-7710d8190981 {{(pid=82756) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 15:12:07 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-a836d757-3597-4f59-9507-41633a9b3f0d tempest-SnapshotsActionsTest-854366568 None] snapshot_file for this snap is: volume-08615ae8-52d0-43c6-9c67-7710d8190981.f6c954dd-3cd8-4525-91a8-ae9eae5ae9fe {{(pid=82756) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 15:12:07 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3df74a4-14d8-434f-809d-4d03b1586e5b]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:12:07 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-a836d757-3597-4f59-9507-41633a9b3f0d tempest-SnapshotsActionsTest-854366568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.f6c954dd-3cd8-4525-91a8-ae9eae5ae9fe {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:12:07 devstack sudo[89544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.f6c954dd-3cd8-4525-91a8-ae9eae5ae9fe Apr 16 15:12:07 devstack sudo[89544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:12:07 devstack sudo[89540]: pam_unix(sudo:session): session closed for user root Apr 16 15:12:07 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-bb546cc5-7f9e-4110-ae67-37fdc82e701c tempest-VolumeDependencyTests-70634728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.517s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:12:07 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-bb546cc5-7f9e-4110-ae67-37fdc82e701c tempest-VolumeDependencyTests-70634728 None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:12:07 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-bb546cc5-7f9e-4110-ae67-37fdc82e701c tempest-VolumeDependencyTests-70634728 None] Deleted volume successfully. Apr 16 15:12:07 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-bb546cc5-7f9e-4110-ae67-37fdc82e701c tempest-VolumeDependencyTests-70634728 None] Lock "cinder-f1cabcc5-3d3c-4403-834f-0b137ce05645-delete_volume" released by "delete_volume" :: held 1.616s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:12:08 devstack sudo[89544]: pam_unix(sudo:session): session closed for user root Apr 16 15:12:08 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-a836d757-3597-4f59-9507-41633a9b3f0d tempest-SnapshotsActionsTest-854366568 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.f6c954dd-3cd8-4525-91a8-ae9eae5ae9fe" returned: 0 in 0.538s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:12:08 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-a836d757-3597-4f59-9507-41633a9b3f0d tempest-SnapshotsActionsTest-854366568 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-08615ae8-52d0-43c6-9c67-7710d8190981(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82756) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 15:12:08 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[14cd5d57-6edf-4004-9176-6a1fe460502c]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:12:08 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-a836d757-3597-4f59-9507-41633a9b3f0d tempest-SnapshotsActionsTest-854366568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.2f0ed87e-fe71-404f-ae88-58fa85f36866 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:12:08 devstack sudo[89549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.2f0ed87e-fe71-404f-ae88-58fa85f36866 Apr 16 15:12:08 devstack sudo[89549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:12:08 devstack sudo[89549]: pam_unix(sudo:session): session closed for user root Apr 16 15:12:08 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-a836d757-3597-4f59-9507-41633a9b3f0d tempest-SnapshotsActionsTest-854366568 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.2f0ed87e-fe71-404f-ae88-58fa85f36866" returned: 0 in 0.512s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:12:08 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-a836d757-3597-4f59-9507-41633a9b3f0d tempest-SnapshotsActionsTest-854366568 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-08615ae8-52d0-43c6-9c67-7710d8190981(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82756) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 15:12:08 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-a836d757-3597-4f59-9507-41633a9b3f0d tempest-SnapshotsActionsTest-854366568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.f6c954dd-3cd8-4525-91a8-ae9eae5ae9fe {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:12:08 devstack sudo[89554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.f6c954dd-3cd8-4525-91a8-ae9eae5ae9fe Apr 16 15:12:08 devstack sudo[89554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:12:09 devstack sudo[89554]: pam_unix(sudo:session): session closed for user root Apr 16 15:12:09 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-a836d757-3597-4f59-9507-41633a9b3f0d tempest-SnapshotsActionsTest-854366568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.f6c954dd-3cd8-4525-91a8-ae9eae5ae9fe" returned: 0 in 0.507s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:12:09 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-a836d757-3597-4f59-9507-41633a9b3f0d tempest-SnapshotsActionsTest-854366568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.f6c954dd-3cd8-4525-91a8-ae9eae5ae9fe {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:12:09 devstack sudo[89559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.f6c954dd-3cd8-4525-91a8-ae9eae5ae9fe Apr 16 15:12:09 devstack sudo[89559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:12:09 devstack sudo[89559]: pam_unix(sudo:session): session closed for user root Apr 16 15:12:09 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-a836d757-3597-4f59-9507-41633a9b3f0d tempest-SnapshotsActionsTest-854366568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.f6c954dd-3cd8-4525-91a8-ae9eae5ae9fe" returned: 0 in 0.474s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:12:09 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-a836d757-3597-4f59-9507-41633a9b3f0d tempest-SnapshotsActionsTest-854366568 None] Lock "cinder-quobyte-f6c954dd-3cd8-4525-91a8-ae9eae5ae9fe" released by "_delete_snapshot" :: held 2.087s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:12:09 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-a836d757-3597-4f59-9507-41633a9b3f0d tempest-SnapshotsActionsTest-854366568 None] Lock "cinder-quobyte-08615ae8-52d0-43c6-9c67-7710d8190981" released by "delete_snapshot" :: held 2.106s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:12:09 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-a836d757-3597-4f59-9507-41633a9b3f0d tempest-SnapshotsActionsTest-854366568 None] Created reservations ['d6cbc0ad-9fcb-440e-ae6f-17188d6d5533', '07d9c9ef-e356-491b-98b9-a61984bda147', '59d2fa81-2dd9-440f-995f-1921136cfc05', 'badcea27-8b75-4c77-bda1-f1c955d1d12b'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:12:09 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-a836d757-3597-4f59-9507-41633a9b3f0d tempest-SnapshotsActionsTest-854366568 None] Delete snapshot completed successfully. Apr 16 15:12:09 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-a836d757-3597-4f59-9507-41633a9b3f0d tempest-SnapshotsActionsTest-854366568 None] Lock "cinder-f6c954dd-3cd8-4525-91a8-ae9eae5ae9fe-delete_snapshot" released by "delete_snapshot" :: held 2.200s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:12:11 devstack cinder-volume[82756]: DEBUG dbcounter [-] [82756] Writing DB stats cinder:SELECT=161,cinder:UPDATE=229,cinder:INSERT=60,cinder:DELETE=9 {{(pid=82756) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 15:12:11 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-d6de4443-94b9-4667-bf0a-faf76982b7a4 tempest-SnapshotsActionsTest-295135696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:12:11 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-d6de4443-94b9-4667-bf0a-faf76982b7a4 tempest-SnapshotsActionsTest-295135696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:12:11 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-d6de4443-94b9-4667-bf0a-faf76982b7a4 tempest-SnapshotsActionsTest-295135696 None] Creating offline snapshot 8ffd52e7-02b6-4e07-af34-751089ace1d6 of volume 08615ae8-52d0-43c6-9c67-7710d8190981 {{(pid=82756) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 16 15:12:11 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff2aa315-06cd-48ee-b31b-b9416242fc12]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:12:11 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-d6de4443-94b9-4667-bf0a-faf76982b7a4 tempest-SnapshotsActionsTest-295135696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.2f0ed87e-fe71-404f-ae88-58fa85f36866 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:12:11 devstack sudo[89562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.2f0ed87e-fe71-404f-ae88-58fa85f36866 Apr 16 15:12:11 devstack sudo[89562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:12:11 devstack sudo[89562]: pam_unix(sudo:session): session closed for user root Apr 16 15:12:11 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-d6de4443-94b9-4667-bf0a-faf76982b7a4 tempest-SnapshotsActionsTest-295135696 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.2f0ed87e-fe71-404f-ae88-58fa85f36866" returned: 0 in 0.474s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:12:11 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-d6de4443-94b9-4667-bf0a-faf76982b7a4 tempest-SnapshotsActionsTest-295135696 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-08615ae8-52d0-43c6-9c67-7710d8190981(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82756) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 15:12:11 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-d6de4443-94b9-4667-bf0a-faf76982b7a4 tempest-SnapshotsActionsTest-295135696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.2f0ed87e-fe71-404f-ae88-58fa85f36866,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.8ffd52e7-02b6-4e07-af34-751089ace1d6 1G {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:12:11 devstack sudo[89567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.2f0ed87e-fe71-404f-ae88-58fa85f36866,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.8ffd52e7-02b6-4e07-af34-751089ace1d6 1G Apr 16 15:12:11 devstack sudo[89567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:12:12 devstack sudo[89567]: pam_unix(sudo:session): session closed for user root Apr 16 15:12:12 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-d6de4443-94b9-4667-bf0a-faf76982b7a4 tempest-SnapshotsActionsTest-295135696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.2f0ed87e-fe71-404f-ae88-58fa85f36866,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.8ffd52e7-02b6-4e07-af34-751089ace1d6 1G" returned: 0 in 0.679s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:12:12 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-d6de4443-94b9-4667-bf0a-faf76982b7a4 tempest-SnapshotsActionsTest-295135696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08615ae8-52d0-43c6-9c67-7710d8190981.2f0ed87e-fe71-404f-ae88-58fa85f36866 -F qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.8ffd52e7-02b6-4e07-af34-751089ace1d6 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:12:12 devstack sudo[89572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08615ae8-52d0-43c6-9c67-7710d8190981.2f0ed87e-fe71-404f-ae88-58fa85f36866 -F qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.8ffd52e7-02b6-4e07-af34-751089ace1d6 Apr 16 15:12:12 devstack sudo[89572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:12:12 devstack sudo[89572]: pam_unix(sudo:session): session closed for user root Apr 16 15:12:12 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-d6de4443-94b9-4667-bf0a-faf76982b7a4 tempest-SnapshotsActionsTest-295135696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08615ae8-52d0-43c6-9c67-7710d8190981.2f0ed87e-fe71-404f-ae88-58fa85f36866 -F qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.8ffd52e7-02b6-4e07-af34-751089ace1d6" returned: 0 in 0.456s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:12:12 devstack cinder-volume[82756]: WARNING cinder.volume.drivers.remotefs [None req-d6de4443-94b9-4667-bf0a-faf76982b7a4 tempest-SnapshotsActionsTest-295135696 None] /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.8ffd52e7-02b6-4e07-af34-751089ace1d6 is being set with open permissions: ugo+rw Apr 16 15:12:12 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-d6de4443-94b9-4667-bf0a-faf76982b7a4 tempest-SnapshotsActionsTest-295135696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.8ffd52e7-02b6-4e07-af34-751089ace1d6 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:12:12 devstack sudo[89577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.8ffd52e7-02b6-4e07-af34-751089ace1d6 Apr 16 15:12:12 devstack sudo[89577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:12:13 devstack sudo[89577]: pam_unix(sudo:session): session closed for user root Apr 16 15:12:13 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-d6de4443-94b9-4667-bf0a-faf76982b7a4 tempest-SnapshotsActionsTest-295135696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.8ffd52e7-02b6-4e07-af34-751089ace1d6" returned: 0 in 0.471s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:12:13 devstack cinder-volume[82756]: DEBUG dbcounter [-] [82756] Writing DB stats cinder:SELECT=171,cinder:INSERT=37,cinder:UPDATE=167,cinder:DELETE=16 {{(pid=82756) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 15:12:13 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-d6de4443-94b9-4667-bf0a-faf76982b7a4 tempest-SnapshotsActionsTest-295135696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.153s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:12:13 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-d6de4443-94b9-4667-bf0a-faf76982b7a4 tempest-SnapshotsActionsTest-295135696 None] Create snapshot completed successfully Apr 16 15:12:14 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-eda4074b-cd75-4426-a026-4ef4d28f614c tempest-SnapshotsActionsTest-854366568 None] Acquiring lock "cinder-8ffd52e7-02b6-4e07-af34-751089ace1d6-delete_snapshot" by "delete_snapshot" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:12:14 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-eda4074b-cd75-4426-a026-4ef4d28f614c tempest-SnapshotsActionsTest-854366568 None] Lock "cinder-8ffd52e7-02b6-4e07-af34-751089ace1d6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:12:14 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-eda4074b-cd75-4426-a026-4ef4d28f614c tempest-SnapshotsActionsTest-854366568 None] Acquiring lock "cinder-quobyte-08615ae8-52d0-43c6-9c67-7710d8190981" by "delete_snapshot" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:12:14 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-eda4074b-cd75-4426-a026-4ef4d28f614c tempest-SnapshotsActionsTest-854366568 None] Lock "cinder-quobyte-08615ae8-52d0-43c6-9c67-7710d8190981" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:12:14 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-eda4074b-cd75-4426-a026-4ef4d28f614c tempest-SnapshotsActionsTest-854366568 None] Acquiring lock "cinder-quobyte-8ffd52e7-02b6-4e07-af34-751089ace1d6" by "_delete_snapshot" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:12:14 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-eda4074b-cd75-4426-a026-4ef4d28f614c tempest-SnapshotsActionsTest-854366568 None] Lock "cinder-quobyte-8ffd52e7-02b6-4e07-af34-751089ace1d6" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:12:14 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-eda4074b-cd75-4426-a026-4ef4d28f614c tempest-SnapshotsActionsTest-854366568 None] Deleting offline snapshot 8ffd52e7-02b6-4e07-af34-751089ace1d6 of volume 08615ae8-52d0-43c6-9c67-7710d8190981 {{(pid=82756) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 15:12:14 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-eda4074b-cd75-4426-a026-4ef4d28f614c tempest-SnapshotsActionsTest-854366568 None] snapshot_file for this snap is: volume-08615ae8-52d0-43c6-9c67-7710d8190981.8ffd52e7-02b6-4e07-af34-751089ace1d6 {{(pid=82756) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 15:12:14 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9d661c5-c968-4f9f-b1eb-1abd4f0fb33e]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:12:14 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-eda4074b-cd75-4426-a026-4ef4d28f614c tempest-SnapshotsActionsTest-854366568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.8ffd52e7-02b6-4e07-af34-751089ace1d6 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:12:14 devstack sudo[89581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.8ffd52e7-02b6-4e07-af34-751089ace1d6 Apr 16 15:12:14 devstack sudo[89581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:12:14 devstack sudo[89581]: pam_unix(sudo:session): session closed for user root Apr 16 15:12:14 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-eda4074b-cd75-4426-a026-4ef4d28f614c tempest-SnapshotsActionsTest-854366568 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.8ffd52e7-02b6-4e07-af34-751089ace1d6" returned: 0 in 0.525s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:12:14 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-eda4074b-cd75-4426-a026-4ef4d28f614c tempest-SnapshotsActionsTest-854366568 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-08615ae8-52d0-43c6-9c67-7710d8190981(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82756) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 15:12:14 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6370ba9-0903-42a5-94d3-ac14ec100f3b]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:12:14 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-eda4074b-cd75-4426-a026-4ef4d28f614c tempest-SnapshotsActionsTest-854366568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.2f0ed87e-fe71-404f-ae88-58fa85f36866 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:12:15 devstack sudo[89586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.2f0ed87e-fe71-404f-ae88-58fa85f36866 Apr 16 15:12:15 devstack sudo[89586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:12:15 devstack sudo[89586]: pam_unix(sudo:session): session closed for user root Apr 16 15:12:15 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-eda4074b-cd75-4426-a026-4ef4d28f614c tempest-SnapshotsActionsTest-854366568 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.2f0ed87e-fe71-404f-ae88-58fa85f36866" returned: 0 in 0.518s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:12:15 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-eda4074b-cd75-4426-a026-4ef4d28f614c tempest-SnapshotsActionsTest-854366568 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-08615ae8-52d0-43c6-9c67-7710d8190981(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82756) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 15:12:15 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-eda4074b-cd75-4426-a026-4ef4d28f614c tempest-SnapshotsActionsTest-854366568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.8ffd52e7-02b6-4e07-af34-751089ace1d6 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:12:15 devstack sudo[89591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.8ffd52e7-02b6-4e07-af34-751089ace1d6 Apr 16 15:12:15 devstack sudo[89591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:12:16 devstack sudo[89591]: pam_unix(sudo:session): session closed for user root Apr 16 15:12:16 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-eda4074b-cd75-4426-a026-4ef4d28f614c tempest-SnapshotsActionsTest-854366568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.8ffd52e7-02b6-4e07-af34-751089ace1d6" returned: 0 in 0.577s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:12:16 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-eda4074b-cd75-4426-a026-4ef4d28f614c tempest-SnapshotsActionsTest-854366568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.8ffd52e7-02b6-4e07-af34-751089ace1d6 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:12:16 devstack sudo[89596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.8ffd52e7-02b6-4e07-af34-751089ace1d6 Apr 16 15:12:16 devstack sudo[89596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:12:16 devstack sudo[89596]: pam_unix(sudo:session): session closed for user root Apr 16 15:12:16 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-eda4074b-cd75-4426-a026-4ef4d28f614c tempest-SnapshotsActionsTest-854366568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.8ffd52e7-02b6-4e07-af34-751089ace1d6" returned: 0 in 0.465s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:12:16 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-eda4074b-cd75-4426-a026-4ef4d28f614c tempest-SnapshotsActionsTest-854366568 None] Lock "cinder-quobyte-8ffd52e7-02b6-4e07-af34-751089ace1d6" released by "_delete_snapshot" :: held 2.140s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:12:16 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-eda4074b-cd75-4426-a026-4ef4d28f614c tempest-SnapshotsActionsTest-854366568 None] Lock "cinder-quobyte-08615ae8-52d0-43c6-9c67-7710d8190981" released by "delete_snapshot" :: held 2.151s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:12:16 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-eda4074b-cd75-4426-a026-4ef4d28f614c tempest-SnapshotsActionsTest-854366568 None] Created reservations ['693e7864-d2d1-4961-868e-fc1f8a5e7258', 'b491f9e8-1065-48a3-9718-c04061f53774', '548336f2-f345-43b6-982a-c9761bdcaa47', 'b7573dd3-f64d-4eb9-9bbc-9333c2dec4dd'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:12:16 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-eda4074b-cd75-4426-a026-4ef4d28f614c tempest-SnapshotsActionsTest-854366568 None] Delete snapshot completed successfully. Apr 16 15:12:16 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-eda4074b-cd75-4426-a026-4ef4d28f614c tempest-SnapshotsActionsTest-854366568 None] Lock "cinder-8ffd52e7-02b6-4e07-af34-751089ace1d6-delete_snapshot" released by "delete_snapshot" :: held 2.244s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:12:17 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-67b1a8bc-be8e-4476-914e-5a5636ff3e1f tempest-SnapshotsActionsTest-295135696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:12:17 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-67b1a8bc-be8e-4476-914e-5a5636ff3e1f tempest-SnapshotsActionsTest-295135696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:12:17 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-67b1a8bc-be8e-4476-914e-5a5636ff3e1f tempest-SnapshotsActionsTest-295135696 None] Creating offline snapshot a5c119b1-f626-4bdc-979f-2092fc394930 of volume 08615ae8-52d0-43c6-9c67-7710d8190981 {{(pid=82756) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 16 15:12:17 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[81f27a85-46d3-4d07-b5a5-6a2d38352507]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:12:17 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-67b1a8bc-be8e-4476-914e-5a5636ff3e1f tempest-SnapshotsActionsTest-295135696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.2f0ed87e-fe71-404f-ae88-58fa85f36866 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:12:17 devstack sudo[89599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.2f0ed87e-fe71-404f-ae88-58fa85f36866 Apr 16 15:12:17 devstack sudo[89599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:12:18 devstack sudo[89599]: pam_unix(sudo:session): session closed for user root Apr 16 15:12:18 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-67b1a8bc-be8e-4476-914e-5a5636ff3e1f tempest-SnapshotsActionsTest-295135696 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.2f0ed87e-fe71-404f-ae88-58fa85f36866" returned: 0 in 0.543s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:12:18 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-67b1a8bc-be8e-4476-914e-5a5636ff3e1f tempest-SnapshotsActionsTest-295135696 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-08615ae8-52d0-43c6-9c67-7710d8190981(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82756) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 15:12:18 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-67b1a8bc-be8e-4476-914e-5a5636ff3e1f tempest-SnapshotsActionsTest-295135696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.2f0ed87e-fe71-404f-ae88-58fa85f36866,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.a5c119b1-f626-4bdc-979f-2092fc394930 1G {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:12:18 devstack sudo[89604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.2f0ed87e-fe71-404f-ae88-58fa85f36866,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.a5c119b1-f626-4bdc-979f-2092fc394930 1G Apr 16 15:12:18 devstack sudo[89604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:12:18 devstack sudo[89604]: pam_unix(sudo:session): session closed for user root Apr 16 15:12:18 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-67b1a8bc-be8e-4476-914e-5a5636ff3e1f tempest-SnapshotsActionsTest-295135696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.2f0ed87e-fe71-404f-ae88-58fa85f36866,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.a5c119b1-f626-4bdc-979f-2092fc394930 1G" returned: 0 in 0.550s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:12:18 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-67b1a8bc-be8e-4476-914e-5a5636ff3e1f tempest-SnapshotsActionsTest-295135696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08615ae8-52d0-43c6-9c67-7710d8190981.2f0ed87e-fe71-404f-ae88-58fa85f36866 -F qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.a5c119b1-f626-4bdc-979f-2092fc394930 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:12:18 devstack sudo[89609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08615ae8-52d0-43c6-9c67-7710d8190981.2f0ed87e-fe71-404f-ae88-58fa85f36866 -F qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.a5c119b1-f626-4bdc-979f-2092fc394930 Apr 16 15:12:18 devstack sudo[89609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:12:19 devstack sudo[89609]: pam_unix(sudo:session): session closed for user root Apr 16 15:12:19 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-67b1a8bc-be8e-4476-914e-5a5636ff3e1f tempest-SnapshotsActionsTest-295135696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08615ae8-52d0-43c6-9c67-7710d8190981.2f0ed87e-fe71-404f-ae88-58fa85f36866 -F qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.a5c119b1-f626-4bdc-979f-2092fc394930" returned: 0 in 0.446s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:12:19 devstack cinder-volume[82756]: WARNING cinder.volume.drivers.remotefs [None req-67b1a8bc-be8e-4476-914e-5a5636ff3e1f tempest-SnapshotsActionsTest-295135696 None] /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.a5c119b1-f626-4bdc-979f-2092fc394930 is being set with open permissions: ugo+rw Apr 16 15:12:19 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-67b1a8bc-be8e-4476-914e-5a5636ff3e1f tempest-SnapshotsActionsTest-295135696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.a5c119b1-f626-4bdc-979f-2092fc394930 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:12:19 devstack sudo[89614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.a5c119b1-f626-4bdc-979f-2092fc394930 Apr 16 15:12:19 devstack sudo[89614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:12:19 devstack sudo[89614]: pam_unix(sudo:session): session closed for user root Apr 16 15:12:19 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-67b1a8bc-be8e-4476-914e-5a5636ff3e1f tempest-SnapshotsActionsTest-295135696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.a5c119b1-f626-4bdc-979f-2092fc394930" returned: 0 in 0.517s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:12:19 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-67b1a8bc-be8e-4476-914e-5a5636ff3e1f tempest-SnapshotsActionsTest-295135696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.127s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:12:19 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-67b1a8bc-be8e-4476-914e-5a5636ff3e1f tempest-SnapshotsActionsTest-295135696 None] Create snapshot completed successfully Apr 16 15:12:20 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-4698621c-ce5b-4d72-b228-ff94d2ca0872 tempest-SnapshotsActionsTest-854366568 None] Acquiring lock "cinder-a5c119b1-f626-4bdc-979f-2092fc394930-delete_snapshot" by "delete_snapshot" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:12:20 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-4698621c-ce5b-4d72-b228-ff94d2ca0872 tempest-SnapshotsActionsTest-854366568 None] Lock "cinder-a5c119b1-f626-4bdc-979f-2092fc394930-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:12:20 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-4698621c-ce5b-4d72-b228-ff94d2ca0872 tempest-SnapshotsActionsTest-854366568 None] Acquiring lock "cinder-quobyte-08615ae8-52d0-43c6-9c67-7710d8190981" by "delete_snapshot" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:12:20 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-4698621c-ce5b-4d72-b228-ff94d2ca0872 tempest-SnapshotsActionsTest-854366568 None] Lock "cinder-quobyte-08615ae8-52d0-43c6-9c67-7710d8190981" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:12:20 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-4698621c-ce5b-4d72-b228-ff94d2ca0872 tempest-SnapshotsActionsTest-854366568 None] Acquiring lock "cinder-quobyte-a5c119b1-f626-4bdc-979f-2092fc394930" by "_delete_snapshot" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:12:20 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-4698621c-ce5b-4d72-b228-ff94d2ca0872 tempest-SnapshotsActionsTest-854366568 None] Lock "cinder-quobyte-a5c119b1-f626-4bdc-979f-2092fc394930" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:12:20 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-4698621c-ce5b-4d72-b228-ff94d2ca0872 tempest-SnapshotsActionsTest-854366568 None] Deleting offline snapshot a5c119b1-f626-4bdc-979f-2092fc394930 of volume 08615ae8-52d0-43c6-9c67-7710d8190981 {{(pid=82756) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 15:12:20 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-4698621c-ce5b-4d72-b228-ff94d2ca0872 tempest-SnapshotsActionsTest-854366568 None] snapshot_file for this snap is: volume-08615ae8-52d0-43c6-9c67-7710d8190981.a5c119b1-f626-4bdc-979f-2092fc394930 {{(pid=82756) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 15:12:20 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[da76d829-925e-4966-9f9e-d86a849b80bb]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:12:20 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-4698621c-ce5b-4d72-b228-ff94d2ca0872 tempest-SnapshotsActionsTest-854366568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.a5c119b1-f626-4bdc-979f-2092fc394930 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:12:21 devstack sudo[89617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.a5c119b1-f626-4bdc-979f-2092fc394930 Apr 16 15:12:21 devstack sudo[89617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:12:21 devstack sudo[89617]: pam_unix(sudo:session): session closed for user root Apr 16 15:12:21 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-4698621c-ce5b-4d72-b228-ff94d2ca0872 tempest-SnapshotsActionsTest-854366568 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.a5c119b1-f626-4bdc-979f-2092fc394930" returned: 0 in 0.581s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:12:21 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-4698621c-ce5b-4d72-b228-ff94d2ca0872 tempest-SnapshotsActionsTest-854366568 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-08615ae8-52d0-43c6-9c67-7710d8190981(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82756) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 15:12:21 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[de308593-a710-438b-ab9a-e9a91754822c]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:12:21 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-4698621c-ce5b-4d72-b228-ff94d2ca0872 tempest-SnapshotsActionsTest-854366568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.2f0ed87e-fe71-404f-ae88-58fa85f36866 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:12:21 devstack sudo[89623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.2f0ed87e-fe71-404f-ae88-58fa85f36866 Apr 16 15:12:21 devstack sudo[89623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:12:22 devstack sudo[89623]: pam_unix(sudo:session): session closed for user root Apr 16 15:12:22 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-4698621c-ce5b-4d72-b228-ff94d2ca0872 tempest-SnapshotsActionsTest-854366568 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.2f0ed87e-fe71-404f-ae88-58fa85f36866" returned: 0 in 0.509s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:12:22 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-4698621c-ce5b-4d72-b228-ff94d2ca0872 tempest-SnapshotsActionsTest-854366568 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-08615ae8-52d0-43c6-9c67-7710d8190981(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82756) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 15:12:22 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-4698621c-ce5b-4d72-b228-ff94d2ca0872 tempest-SnapshotsActionsTest-854366568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.a5c119b1-f626-4bdc-979f-2092fc394930 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:12:22 devstack sudo[89628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.a5c119b1-f626-4bdc-979f-2092fc394930 Apr 16 15:12:22 devstack sudo[89628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:12:22 devstack sudo[89628]: pam_unix(sudo:session): session closed for user root Apr 16 15:12:22 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-4698621c-ce5b-4d72-b228-ff94d2ca0872 tempest-SnapshotsActionsTest-854366568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.a5c119b1-f626-4bdc-979f-2092fc394930" returned: 0 in 0.537s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:12:22 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-4698621c-ce5b-4d72-b228-ff94d2ca0872 tempest-SnapshotsActionsTest-854366568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.a5c119b1-f626-4bdc-979f-2092fc394930 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:12:22 devstack sudo[89633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.a5c119b1-f626-4bdc-979f-2092fc394930 Apr 16 15:12:22 devstack sudo[89633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:12:23 devstack sudo[89633]: pam_unix(sudo:session): session closed for user root Apr 16 15:12:23 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-4698621c-ce5b-4d72-b228-ff94d2ca0872 tempest-SnapshotsActionsTest-854366568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.a5c119b1-f626-4bdc-979f-2092fc394930" returned: 0 in 0.527s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:12:23 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-4698621c-ce5b-4d72-b228-ff94d2ca0872 tempest-SnapshotsActionsTest-854366568 None] Lock "cinder-quobyte-a5c119b1-f626-4bdc-979f-2092fc394930" released by "_delete_snapshot" :: held 2.213s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:12:23 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-4698621c-ce5b-4d72-b228-ff94d2ca0872 tempest-SnapshotsActionsTest-854366568 None] Lock "cinder-quobyte-08615ae8-52d0-43c6-9c67-7710d8190981" released by "delete_snapshot" :: held 2.228s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:12:23 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-4698621c-ce5b-4d72-b228-ff94d2ca0872 tempest-SnapshotsActionsTest-854366568 None] Created reservations ['f648a8ab-ac89-4901-b22d-e53416224f11', '77ab05a9-0118-447a-b01d-7ca61fd6163b', 'cd5c3066-4667-451f-9bae-9454d3777cc2', '5f103ddf-06a4-41de-a76c-d578bd096f46'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:12:23 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-4698621c-ce5b-4d72-b228-ff94d2ca0872 tempest-SnapshotsActionsTest-854366568 None] Delete snapshot completed successfully. Apr 16 15:12:23 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-4698621c-ce5b-4d72-b228-ff94d2ca0872 tempest-SnapshotsActionsTest-854366568 None] Lock "cinder-a5c119b1-f626-4bdc-979f-2092fc394930-delete_snapshot" released by "delete_snapshot" :: held 2.321s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:12:23 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [None req-f30fcf63-7ab9-4daa-a411-976543c70ae4 tempest-SnapshotDependencyTests-2075410485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82756) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 15:12:23 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-f30fcf63-7ab9-4daa-a411-976543c70ae4 tempest-SnapshotDependencyTests-2075410485 None] Flow 'volume_create_manager' (1e950693-dd05-4150-b411-35f15b6e3322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:12:23 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-f30fcf63-7ab9-4daa-a411-976543c70ae4 tempest-SnapshotDependencyTests-2075410485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bcbb919-591c-402b-8052-c49d6f58a358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:12:23 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-f30fcf63-7ab9-4daa-a411-976543c70ae4 tempest-SnapshotDependencyTests-2075410485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bcbb919-591c-402b-8052-c49d6f58a358) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:12:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1322906140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59cf177f-aada-4733-9a33-200e63324487,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ade5e824ad94ac481ec73843704806f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:12:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:12:24Z,use_quota=True,user_id='0e15fe3575fc4883a84857da39a8895e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:12:23 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-f30fcf63-7ab9-4daa-a411-976543c70ae4 tempest-SnapshotDependencyTests-2075410485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcb29653-c66e-4130-8801-ec1099094e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:12:23 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-f30fcf63-7ab9-4daa-a411-976543c70ae4 tempest-SnapshotDependencyTests-2075410485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcb29653-c66e-4130-8801-ec1099094e43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:12:23 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-f30fcf63-7ab9-4daa-a411-976543c70ae4 tempest-SnapshotDependencyTests-2075410485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe8d6d78-0666-47e0-aec5-a6ee592991e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:12:23 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-f30fcf63-7ab9-4daa-a411-976543c70ae4 tempest-SnapshotDependencyTests-2075410485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe8d6d78-0666-47e0-aec5-a6ee592991e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59cf177f-aada-4733-9a33-200e63324487', 'volume_name': 'volume-59cf177f-aada-4733-9a33-200e63324487', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:12:23 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-f30fcf63-7ab9-4daa-a411-976543c70ae4 tempest-SnapshotDependencyTests-2075410485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf483154-397b-4028-b038-5e46fa97acc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:12:23 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-f30fcf63-7ab9-4daa-a411-976543c70ae4 tempest-SnapshotDependencyTests-2075410485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf483154-397b-4028-b038-5e46fa97acc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:12:23 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-f30fcf63-7ab9-4daa-a411-976543c70ae4 tempest-SnapshotDependencyTests-2075410485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7aeeca47-508f-48f3-ab1e-25326aac1572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:12:23 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-f30fcf63-7ab9-4daa-a411-976543c70ae4 tempest-SnapshotDependencyTests-2075410485 None] Volume 59cf177f-aada-4733-9a33-200e63324487: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59cf177f-aada-4733-9a33-200e63324487', 'volume_size': 1} Apr 16 15:12:23 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-f30fcf63-7ab9-4daa-a411-976543c70ae4 tempest-SnapshotDependencyTests-2075410485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:12:23 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-f30fcf63-7ab9-4daa-a411-976543c70ae4 tempest-SnapshotDependencyTests-2075410485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:12:23 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-f30fcf63-7ab9-4daa-a411-976543c70ae4 tempest-SnapshotDependencyTests-2075410485 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:12:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1322906140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59cf177f-aada-4733-9a33-200e63324487,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ade5e824ad94ac481ec73843704806f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:12:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:12:24Z,use_quota=True,user_id='0e15fe3575fc4883a84857da39a8895e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)}" {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 15:12:23 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-f30fcf63-7ab9-4daa-a411-976543c70ae4 tempest-SnapshotDependencyTests-2075410485 None] Creating volume 59cf177f-aada-4733-9a33-200e63324487 {{(pid=82756) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 15:12:23 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-f30fcf63-7ab9-4daa-a411-976543c70ae4 tempest-SnapshotDependencyTests-2075410485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:12:23 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-f30fcf63-7ab9-4daa-a411-976543c70ae4 tempest-SnapshotDependencyTests-2075410485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:12:23 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-f30fcf63-7ab9-4daa-a411-976543c70ae4 tempest-SnapshotDependencyTests-2075410485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:12:23 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-f30fcf63-7ab9-4daa-a411-976543c70ae4 tempest-SnapshotDependencyTests-2075410485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:12:23 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-f30fcf63-7ab9-4daa-a411-976543c70ae4 tempest-SnapshotDependencyTests-2075410485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:12:23 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-f30fcf63-7ab9-4daa-a411-976543c70ae4 tempest-SnapshotDependencyTests-2075410485 None] Selected osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 as target Quobyte volume. {{(pid=82756) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 15:12:23 devstack cinder-volume[82756]: INFO cinder.volume.drivers.remotefs [None req-f30fcf63-7ab9-4daa-a411-976543c70ae4 tempest-SnapshotDependencyTests-2075410485 None] casted to osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 Apr 16 15:12:23 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-f30fcf63-7ab9-4daa-a411-976543c70ae4 tempest-SnapshotDependencyTests-2075410485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-59cf177f-aada-4733-9a33-200e63324487 1073741824 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:12:23 devstack sudo[89637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-59cf177f-aada-4733-9a33-200e63324487 1073741824 Apr 16 15:12:23 devstack sudo[89637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:12:24 devstack sudo[89637]: pam_unix(sudo:session): session closed for user root Apr 16 15:12:24 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-f30fcf63-7ab9-4daa-a411-976543c70ae4 tempest-SnapshotDependencyTests-2075410485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-59cf177f-aada-4733-9a33-200e63324487 1073741824" returned: 0 in 0.562s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:12:24 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-40ff311f-983f-4e7c-b65c-52067688ddc4 tempest-SnapshotsActionsTest-295135696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:12:24 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-f30fcf63-7ab9-4daa-a411-976543c70ae4 tempest-SnapshotDependencyTests-2075410485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-59cf177f-aada-4733-9a33-200e63324487 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:12:24 devstack sudo[89642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-59cf177f-aada-4733-9a33-200e63324487 Apr 16 15:12:24 devstack sudo[89642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:12:24 devstack sudo[89642]: pam_unix(sudo:session): session closed for user root Apr 16 15:12:24 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-f30fcf63-7ab9-4daa-a411-976543c70ae4 tempest-SnapshotDependencyTests-2075410485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-59cf177f-aada-4733-9a33-200e63324487" returned: 0 in 0.430s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:12:24 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-f30fcf63-7ab9-4daa-a411-976543c70ae4 tempest-SnapshotDependencyTests-2075410485 None] <== create_volume: return (1029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'} {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 15:12:24 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-f30fcf63-7ab9-4daa-a411-976543c70ae4 tempest-SnapshotDependencyTests-2075410485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.031s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:12:24 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-40ff311f-983f-4e7c-b65c-52067688ddc4 tempest-SnapshotsActionsTest-295135696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.438s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:12:24 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-40ff311f-983f-4e7c-b65c-52067688ddc4 tempest-SnapshotsActionsTest-295135696 None] Creating offline snapshot 35ded98a-c569-4f31-b95a-858ffd5f1c98 of volume 08615ae8-52d0-43c6-9c67-7710d8190981 {{(pid=82756) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 16 15:12:24 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-f30fcf63-7ab9-4daa-a411-976543c70ae4 tempest-SnapshotDependencyTests-2075410485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7aeeca47-508f-48f3-ab1e-25326aac1572) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59cf177f-aada-4733-9a33-200e63324487', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:12:24 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-f30fcf63-7ab9-4daa-a411-976543c70ae4 tempest-SnapshotDependencyTests-2075410485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdd3acc1-4e4e-4142-922b-ac8c0e5e4a5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:12:24 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfa0997b-d698-4e8e-90cb-672751d07987]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:12:24 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-40ff311f-983f-4e7c-b65c-52067688ddc4 tempest-SnapshotsActionsTest-295135696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.2f0ed87e-fe71-404f-ae88-58fa85f36866 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:12:24 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-f30fcf63-7ab9-4daa-a411-976543c70ae4 tempest-SnapshotDependencyTests-2075410485 None] Volume volume-59cf177f-aada-4733-9a33-200e63324487 (59cf177f-aada-4733-9a33-200e63324487): created successfully Apr 16 15:12:24 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-f30fcf63-7ab9-4daa-a411-976543c70ae4 tempest-SnapshotDependencyTests-2075410485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdd3acc1-4e4e-4142-922b-ac8c0e5e4a5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:12:24 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-f30fcf63-7ab9-4daa-a411-976543c70ae4 tempest-SnapshotDependencyTests-2075410485 None] Flow 'volume_create_manager' (1e950693-dd05-4150-b411-35f15b6e3322) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:12:24 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-f30fcf63-7ab9-4daa-a411-976543c70ae4 tempest-SnapshotDependencyTests-2075410485 None] Created volume successfully. Apr 16 15:12:24 devstack sudo[89645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.2f0ed87e-fe71-404f-ae88-58fa85f36866 Apr 16 15:12:24 devstack sudo[89645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:12:25 devstack sudo[89645]: pam_unix(sudo:session): session closed for user root Apr 16 15:12:25 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-40ff311f-983f-4e7c-b65c-52067688ddc4 tempest-SnapshotsActionsTest-295135696 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.2f0ed87e-fe71-404f-ae88-58fa85f36866" returned: 0 in 0.493s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:12:25 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-40ff311f-983f-4e7c-b65c-52067688ddc4 tempest-SnapshotsActionsTest-295135696 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-08615ae8-52d0-43c6-9c67-7710d8190981(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82756) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 15:12:25 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-40ff311f-983f-4e7c-b65c-52067688ddc4 tempest-SnapshotsActionsTest-295135696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.2f0ed87e-fe71-404f-ae88-58fa85f36866,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.35ded98a-c569-4f31-b95a-858ffd5f1c98 1G {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:12:25 devstack sudo[89650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.2f0ed87e-fe71-404f-ae88-58fa85f36866,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.35ded98a-c569-4f31-b95a-858ffd5f1c98 1G Apr 16 15:12:25 devstack sudo[89650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:12:25 devstack sudo[89650]: pam_unix(sudo:session): session closed for user root Apr 16 15:12:25 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-40ff311f-983f-4e7c-b65c-52067688ddc4 tempest-SnapshotsActionsTest-295135696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.2f0ed87e-fe71-404f-ae88-58fa85f36866,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.35ded98a-c569-4f31-b95a-858ffd5f1c98 1G" returned: 0 in 0.510s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:12:25 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-40ff311f-983f-4e7c-b65c-52067688ddc4 tempest-SnapshotsActionsTest-295135696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08615ae8-52d0-43c6-9c67-7710d8190981.2f0ed87e-fe71-404f-ae88-58fa85f36866 -F qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.35ded98a-c569-4f31-b95a-858ffd5f1c98 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:12:25 devstack sudo[89655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08615ae8-52d0-43c6-9c67-7710d8190981.2f0ed87e-fe71-404f-ae88-58fa85f36866 -F qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.35ded98a-c569-4f31-b95a-858ffd5f1c98 Apr 16 15:12:25 devstack sudo[89655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:12:25 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-b3d7c82b-aaca-4458-944b-ac422b920225 tempest-SnapshotDependencyTests-2075410485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:12:26 devstack sudo[89655]: pam_unix(sudo:session): session closed for user root Apr 16 15:12:26 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-40ff311f-983f-4e7c-b65c-52067688ddc4 tempest-SnapshotsActionsTest-295135696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08615ae8-52d0-43c6-9c67-7710d8190981.2f0ed87e-fe71-404f-ae88-58fa85f36866 -F qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.35ded98a-c569-4f31-b95a-858ffd5f1c98" returned: 0 in 0.476s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:12:26 devstack cinder-volume[82756]: WARNING cinder.volume.drivers.remotefs [None req-40ff311f-983f-4e7c-b65c-52067688ddc4 tempest-SnapshotsActionsTest-295135696 None] /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.35ded98a-c569-4f31-b95a-858ffd5f1c98 is being set with open permissions: ugo+rw Apr 16 15:12:26 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-40ff311f-983f-4e7c-b65c-52067688ddc4 tempest-SnapshotsActionsTest-295135696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.35ded98a-c569-4f31-b95a-858ffd5f1c98 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:12:26 devstack sudo[89661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.35ded98a-c569-4f31-b95a-858ffd5f1c98 Apr 16 15:12:26 devstack sudo[89661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:12:26 devstack sudo[89661]: pam_unix(sudo:session): session closed for user root Apr 16 15:12:26 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-40ff311f-983f-4e7c-b65c-52067688ddc4 tempest-SnapshotsActionsTest-295135696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.35ded98a-c569-4f31-b95a-858ffd5f1c98" returned: 0 in 0.411s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:12:26 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-40ff311f-983f-4e7c-b65c-52067688ddc4 tempest-SnapshotsActionsTest-295135696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.948s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:12:26 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-b3d7c82b-aaca-4458-944b-ac422b920225 tempest-SnapshotDependencyTests-2075410485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.770s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:12:26 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-b3d7c82b-aaca-4458-944b-ac422b920225 tempest-SnapshotDependencyTests-2075410485 None] Creating offline snapshot 1445d111-4c74-40bd-89fc-f2c597734b58 of volume 59cf177f-aada-4733-9a33-200e63324487 {{(pid=82756) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 16 15:12:26 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[79619f03-d267-4894-9b67-b30d7bf9e060]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:12:26 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-b3d7c82b-aaca-4458-944b-ac422b920225 tempest-SnapshotDependencyTests-2075410485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-59cf177f-aada-4733-9a33-200e63324487 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:12:26 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-40ff311f-983f-4e7c-b65c-52067688ddc4 tempest-SnapshotsActionsTest-295135696 None] Create snapshot completed successfully Apr 16 15:12:26 devstack sudo[89664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-59cf177f-aada-4733-9a33-200e63324487 Apr 16 15:12:26 devstack sudo[89664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:12:27 devstack sudo[89664]: pam_unix(sudo:session): session closed for user root Apr 16 15:12:27 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-b3d7c82b-aaca-4458-944b-ac422b920225 tempest-SnapshotDependencyTests-2075410485 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-59cf177f-aada-4733-9a33-200e63324487" returned: 0 in 0.490s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:12:27 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-b3d7c82b-aaca-4458-944b-ac422b920225 tempest-SnapshotDependencyTests-2075410485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-59cf177f-aada-4733-9a33-200e63324487,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-59cf177f-aada-4733-9a33-200e63324487.1445d111-4c74-40bd-89fc-f2c597734b58 1G {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:12:27 devstack sudo[89669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-59cf177f-aada-4733-9a33-200e63324487,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-59cf177f-aada-4733-9a33-200e63324487.1445d111-4c74-40bd-89fc-f2c597734b58 1G Apr 16 15:12:27 devstack sudo[89669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:12:27 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-f04ec94a-999e-4703-a7e5-efa7c8258caf tempest-SnapshotsActionsTest-854366568 None] Acquiring lock "cinder-35ded98a-c569-4f31-b95a-858ffd5f1c98-delete_snapshot" by "delete_snapshot" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:12:27 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-f04ec94a-999e-4703-a7e5-efa7c8258caf tempest-SnapshotsActionsTest-854366568 None] Lock "cinder-35ded98a-c569-4f31-b95a-858ffd5f1c98-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:12:27 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-f04ec94a-999e-4703-a7e5-efa7c8258caf tempest-SnapshotsActionsTest-854366568 None] Acquiring lock "cinder-quobyte-08615ae8-52d0-43c6-9c67-7710d8190981" by "delete_snapshot" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:12:27 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-f04ec94a-999e-4703-a7e5-efa7c8258caf tempest-SnapshotsActionsTest-854366568 None] Lock "cinder-quobyte-08615ae8-52d0-43c6-9c67-7710d8190981" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:12:27 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-f04ec94a-999e-4703-a7e5-efa7c8258caf tempest-SnapshotsActionsTest-854366568 None] Acquiring lock "cinder-quobyte-35ded98a-c569-4f31-b95a-858ffd5f1c98" by "_delete_snapshot" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:12:27 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-f04ec94a-999e-4703-a7e5-efa7c8258caf tempest-SnapshotsActionsTest-854366568 None] Lock "cinder-quobyte-35ded98a-c569-4f31-b95a-858ffd5f1c98" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:12:27 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-f04ec94a-999e-4703-a7e5-efa7c8258caf tempest-SnapshotsActionsTest-854366568 None] Deleting offline snapshot 35ded98a-c569-4f31-b95a-858ffd5f1c98 of volume 08615ae8-52d0-43c6-9c67-7710d8190981 {{(pid=82756) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 15:12:27 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-f04ec94a-999e-4703-a7e5-efa7c8258caf tempest-SnapshotsActionsTest-854366568 None] snapshot_file for this snap is: volume-08615ae8-52d0-43c6-9c67-7710d8190981.35ded98a-c569-4f31-b95a-858ffd5f1c98 {{(pid=82756) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 15:12:27 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f13d7c0-90b6-4515-8d49-7fc873984aea]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:12:27 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-f04ec94a-999e-4703-a7e5-efa7c8258caf tempest-SnapshotsActionsTest-854366568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.35ded98a-c569-4f31-b95a-858ffd5f1c98 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:12:27 devstack sudo[89671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.35ded98a-c569-4f31-b95a-858ffd5f1c98 Apr 16 15:12:27 devstack sudo[89671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:12:27 devstack sudo[89669]: pam_unix(sudo:session): session closed for user root Apr 16 15:12:27 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-b3d7c82b-aaca-4458-944b-ac422b920225 tempest-SnapshotDependencyTests-2075410485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-59cf177f-aada-4733-9a33-200e63324487,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-59cf177f-aada-4733-9a33-200e63324487.1445d111-4c74-40bd-89fc-f2c597734b58 1G" returned: 0 in 0.506s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:12:27 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-b3d7c82b-aaca-4458-944b-ac422b920225 tempest-SnapshotDependencyTests-2075410485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59cf177f-aada-4733-9a33-200e63324487 -F qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-59cf177f-aada-4733-9a33-200e63324487.1445d111-4c74-40bd-89fc-f2c597734b58 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:12:27 devstack sudo[89676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59cf177f-aada-4733-9a33-200e63324487 -F qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-59cf177f-aada-4733-9a33-200e63324487.1445d111-4c74-40bd-89fc-f2c597734b58 Apr 16 15:12:27 devstack sudo[89676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:12:28 devstack sudo[89671]: pam_unix(sudo:session): session closed for user root Apr 16 15:12:28 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-f04ec94a-999e-4703-a7e5-efa7c8258caf tempest-SnapshotsActionsTest-854366568 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.35ded98a-c569-4f31-b95a-858ffd5f1c98" returned: 0 in 0.500s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:12:28 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-f04ec94a-999e-4703-a7e5-efa7c8258caf tempest-SnapshotsActionsTest-854366568 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-08615ae8-52d0-43c6-9c67-7710d8190981(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82756) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 15:12:28 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[0df49ede-fdb1-4979-bdd2-c2c00f1e3ab5]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:12:28 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-f04ec94a-999e-4703-a7e5-efa7c8258caf tempest-SnapshotsActionsTest-854366568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.2f0ed87e-fe71-404f-ae88-58fa85f36866 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:12:28 devstack sudo[89682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.2f0ed87e-fe71-404f-ae88-58fa85f36866 Apr 16 15:12:28 devstack sudo[89682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:12:28 devstack sudo[89676]: pam_unix(sudo:session): session closed for user root Apr 16 15:12:28 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-b3d7c82b-aaca-4458-944b-ac422b920225 tempest-SnapshotDependencyTests-2075410485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59cf177f-aada-4733-9a33-200e63324487 -F qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-59cf177f-aada-4733-9a33-200e63324487.1445d111-4c74-40bd-89fc-f2c597734b58" returned: 0 in 0.438s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:12:28 devstack cinder-volume[82756]: WARNING cinder.volume.drivers.remotefs [None req-b3d7c82b-aaca-4458-944b-ac422b920225 tempest-SnapshotDependencyTests-2075410485 None] /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-59cf177f-aada-4733-9a33-200e63324487.1445d111-4c74-40bd-89fc-f2c597734b58 is being set with open permissions: ugo+rw Apr 16 15:12:28 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-b3d7c82b-aaca-4458-944b-ac422b920225 tempest-SnapshotDependencyTests-2075410485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-59cf177f-aada-4733-9a33-200e63324487.1445d111-4c74-40bd-89fc-f2c597734b58 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:12:28 devstack sudo[89686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-59cf177f-aada-4733-9a33-200e63324487.1445d111-4c74-40bd-89fc-f2c597734b58 Apr 16 15:12:28 devstack sudo[89686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:12:28 devstack sudo[89682]: pam_unix(sudo:session): session closed for user root Apr 16 15:12:28 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-f04ec94a-999e-4703-a7e5-efa7c8258caf tempest-SnapshotsActionsTest-854366568 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.2f0ed87e-fe71-404f-ae88-58fa85f36866" returned: 0 in 0.461s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:12:28 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-f04ec94a-999e-4703-a7e5-efa7c8258caf tempest-SnapshotsActionsTest-854366568 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-08615ae8-52d0-43c6-9c67-7710d8190981(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82756) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 15:12:28 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-f04ec94a-999e-4703-a7e5-efa7c8258caf tempest-SnapshotsActionsTest-854366568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.35ded98a-c569-4f31-b95a-858ffd5f1c98 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:12:28 devstack sudo[89692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.35ded98a-c569-4f31-b95a-858ffd5f1c98 Apr 16 15:12:28 devstack sudo[89692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:12:28 devstack sudo[89686]: pam_unix(sudo:session): session closed for user root Apr 16 15:12:28 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-b3d7c82b-aaca-4458-944b-ac422b920225 tempest-SnapshotDependencyTests-2075410485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-59cf177f-aada-4733-9a33-200e63324487.1445d111-4c74-40bd-89fc-f2c597734b58" returned: 0 in 0.434s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:12:28 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-b3d7c82b-aaca-4458-944b-ac422b920225 tempest-SnapshotDependencyTests-2075410485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-59cf177f-aada-4733-9a33-200e63324487.info {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:12:28 devstack sudo[89694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-59cf177f-aada-4733-9a33-200e63324487.info Apr 16 15:12:28 devstack sudo[89694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:12:28 devstack sudo[89692]: pam_unix(sudo:session): session closed for user root Apr 16 15:12:28 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-f04ec94a-999e-4703-a7e5-efa7c8258caf tempest-SnapshotsActionsTest-854366568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.35ded98a-c569-4f31-b95a-858ffd5f1c98" returned: 0 in 0.502s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:12:28 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-f04ec94a-999e-4703-a7e5-efa7c8258caf tempest-SnapshotsActionsTest-854366568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.35ded98a-c569-4f31-b95a-858ffd5f1c98 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:12:29 devstack sudo[89700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.35ded98a-c569-4f31-b95a-858ffd5f1c98 Apr 16 15:12:29 devstack sudo[89700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:12:29 devstack sudo[89694]: pam_unix(sudo:session): session closed for user root Apr 16 15:12:29 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-b3d7c82b-aaca-4458-944b-ac422b920225 tempest-SnapshotDependencyTests-2075410485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-59cf177f-aada-4733-9a33-200e63324487.info" returned: 0 in 0.487s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:12:29 devstack cinder-volume[82756]: WARNING cinder.volume.drivers.remotefs [None req-b3d7c82b-aaca-4458-944b-ac422b920225 tempest-SnapshotDependencyTests-2075410485 None] /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-59cf177f-aada-4733-9a33-200e63324487.info is being set with open permissions: ugo+rw Apr 16 15:12:29 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-b3d7c82b-aaca-4458-944b-ac422b920225 tempest-SnapshotDependencyTests-2075410485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-59cf177f-aada-4733-9a33-200e63324487.info {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:12:29 devstack sudo[89702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-59cf177f-aada-4733-9a33-200e63324487.info Apr 16 15:12:29 devstack sudo[89702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:12:29 devstack sudo[89700]: pam_unix(sudo:session): session closed for user root Apr 16 15:12:29 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-f04ec94a-999e-4703-a7e5-efa7c8258caf tempest-SnapshotsActionsTest-854366568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.35ded98a-c569-4f31-b95a-858ffd5f1c98" returned: 0 in 0.402s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:12:29 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-f04ec94a-999e-4703-a7e5-efa7c8258caf tempest-SnapshotsActionsTest-854366568 None] Lock "cinder-quobyte-35ded98a-c569-4f31-b95a-858ffd5f1c98" released by "_delete_snapshot" :: held 1.915s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:12:29 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-f04ec94a-999e-4703-a7e5-efa7c8258caf tempest-SnapshotsActionsTest-854366568 None] Lock "cinder-quobyte-08615ae8-52d0-43c6-9c67-7710d8190981" released by "delete_snapshot" :: held 1.926s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:12:29 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-f04ec94a-999e-4703-a7e5-efa7c8258caf tempest-SnapshotsActionsTest-854366568 None] Created reservations ['c3973423-b625-4426-8830-2ed9b561102e', '60b7c936-401f-4950-be81-753aa7a31c2e', 'd4d62907-cac7-4535-902b-acf0b9eef1e1', 'b928ae84-4e3b-4082-98f0-04eb63ca7e3f'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:12:29 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-f04ec94a-999e-4703-a7e5-efa7c8258caf tempest-SnapshotsActionsTest-854366568 None] Delete snapshot completed successfully. Apr 16 15:12:29 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-f04ec94a-999e-4703-a7e5-efa7c8258caf tempest-SnapshotsActionsTest-854366568 None] Lock "cinder-35ded98a-c569-4f31-b95a-858ffd5f1c98-delete_snapshot" released by "delete_snapshot" :: held 2.007s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:12:29 devstack sudo[89702]: pam_unix(sudo:session): session closed for user root Apr 16 15:12:29 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-b3d7c82b-aaca-4458-944b-ac422b920225 tempest-SnapshotDependencyTests-2075410485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-59cf177f-aada-4733-9a33-200e63324487.info" returned: 0 in 0.411s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:12:29 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-b3d7c82b-aaca-4458-944b-ac422b920225 tempest-SnapshotDependencyTests-2075410485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.823s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:12:29 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-b3d7c82b-aaca-4458-944b-ac422b920225 tempest-SnapshotDependencyTests-2075410485 None] Create snapshot completed successfully Apr 16 15:12:29 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-c517b2c7-455c-4aaa-9575-eceab1b55b74 tempest-SnapshotsActionsTest-295135696 None] Acquiring lock "cinder-2f0ed87e-fe71-404f-ae88-58fa85f36866-delete_snapshot" by "delete_snapshot" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:12:29 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-c517b2c7-455c-4aaa-9575-eceab1b55b74 tempest-SnapshotsActionsTest-295135696 None] Lock "cinder-2f0ed87e-fe71-404f-ae88-58fa85f36866-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:12:29 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-c517b2c7-455c-4aaa-9575-eceab1b55b74 tempest-SnapshotsActionsTest-295135696 None] Acquiring lock "cinder-quobyte-08615ae8-52d0-43c6-9c67-7710d8190981" by "delete_snapshot" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:12:29 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-c517b2c7-455c-4aaa-9575-eceab1b55b74 tempest-SnapshotsActionsTest-295135696 None] Lock "cinder-quobyte-08615ae8-52d0-43c6-9c67-7710d8190981" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:12:29 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-c517b2c7-455c-4aaa-9575-eceab1b55b74 tempest-SnapshotsActionsTest-295135696 None] Acquiring lock "cinder-quobyte-2f0ed87e-fe71-404f-ae88-58fa85f36866" by "_delete_snapshot" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:12:29 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-c517b2c7-455c-4aaa-9575-eceab1b55b74 tempest-SnapshotsActionsTest-295135696 None] Lock "cinder-quobyte-2f0ed87e-fe71-404f-ae88-58fa85f36866" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:12:29 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-c517b2c7-455c-4aaa-9575-eceab1b55b74 tempest-SnapshotsActionsTest-295135696 None] Deleting offline snapshot 2f0ed87e-fe71-404f-ae88-58fa85f36866 of volume 08615ae8-52d0-43c6-9c67-7710d8190981 {{(pid=82756) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 15:12:29 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-c517b2c7-455c-4aaa-9575-eceab1b55b74 tempest-SnapshotsActionsTest-295135696 None] snapshot_file for this snap is: volume-08615ae8-52d0-43c6-9c67-7710d8190981.2f0ed87e-fe71-404f-ae88-58fa85f36866 {{(pid=82756) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 15:12:29 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[14a7675c-e624-4d2e-88ed-3224aa58f44f]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:12:29 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-c517b2c7-455c-4aaa-9575-eceab1b55b74 tempest-SnapshotsActionsTest-295135696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.2f0ed87e-fe71-404f-ae88-58fa85f36866 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:12:29 devstack sudo[89706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.2f0ed87e-fe71-404f-ae88-58fa85f36866 Apr 16 15:12:29 devstack sudo[89706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:12:30 devstack sudo[89706]: pam_unix(sudo:session): session closed for user root Apr 16 15:12:30 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-c517b2c7-455c-4aaa-9575-eceab1b55b74 tempest-SnapshotsActionsTest-295135696 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.2f0ed87e-fe71-404f-ae88-58fa85f36866" returned: 0 in 0.489s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:12:30 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-c517b2c7-455c-4aaa-9575-eceab1b55b74 tempest-SnapshotsActionsTest-295135696 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-08615ae8-52d0-43c6-9c67-7710d8190981(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82756) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 15:12:30 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eaf26b7-fc97-4fc7-946e-788acbeeecee]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:12:30 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-c517b2c7-455c-4aaa-9575-eceab1b55b74 tempest-SnapshotsActionsTest-295135696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:12:30 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8822ded-cead-4c19-ba19-2ca5953692fc tempest-SnapshotDependencyTests-2075410485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82756) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 15:12:30 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-f8822ded-cead-4c19-ba19-2ca5953692fc tempest-SnapshotDependencyTests-2075410485 None] Flow 'volume_create_manager' (1c41db34-8091-464d-9e27-f13494521a2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:12:30 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-f8822ded-cead-4c19-ba19-2ca5953692fc tempest-SnapshotDependencyTests-2075410485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4530e37-c761-4968-9c8a-abcbd0556a83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:12:30 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-f8822ded-cead-4c19-ba19-2ca5953692fc tempest-SnapshotDependencyTests-2075410485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4530e37-c761-4968-9c8a-abcbd0556a83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:12:30Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b990f992-2831-4558-8a7e-c85be60b90dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ade5e824ad94ac481ec73843704806f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:12:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1445d111-4c74-40bd-89fc-f2c597734b58,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:12:30Z,use_quota=True,user_id='0e15fe3575fc4883a84857da39a8895e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:12:30 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-f8822ded-cead-4c19-ba19-2ca5953692fc tempest-SnapshotDependencyTests-2075410485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff589d05-a075-406f-887a-beb62cc62431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:12:30 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-f8822ded-cead-4c19-ba19-2ca5953692fc tempest-SnapshotDependencyTests-2075410485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff589d05-a075-406f-887a-beb62cc62431) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:12:30 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-f8822ded-cead-4c19-ba19-2ca5953692fc tempest-SnapshotDependencyTests-2075410485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dc9f9d3-c737-4c9f-b89e-7456d2649bda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:12:30 devstack sudo[89711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981 Apr 16 15:12:30 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-f8822ded-cead-4c19-ba19-2ca5953692fc tempest-SnapshotDependencyTests-2075410485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dc9f9d3-c737-4c9f-b89e-7456d2649bda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b990f992-2831-4558-8a7e-c85be60b90dc', 'volume_name': 'volume-b990f992-2831-4558-8a7e-c85be60b90dc', 'volume_size': 1, 'snapshot_id': '1445d111-4c74-40bd-89fc-f2c597734b58'}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:12:30 devstack sudo[89711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:12:30 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-f8822ded-cead-4c19-ba19-2ca5953692fc tempest-SnapshotDependencyTests-2075410485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7618b014-4df1-4a1b-a94e-12b06de7822b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:12:30 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-f8822ded-cead-4c19-ba19-2ca5953692fc tempest-SnapshotDependencyTests-2075410485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7618b014-4df1-4a1b-a94e-12b06de7822b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:12:30 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-f8822ded-cead-4c19-ba19-2ca5953692fc tempest-SnapshotDependencyTests-2075410485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab13bda6-a5a5-44d8-8611-dcd21f6ba889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:12:30 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-f8822ded-cead-4c19-ba19-2ca5953692fc tempest-SnapshotDependencyTests-2075410485 None] Volume b990f992-2831-4558-8a7e-c85be60b90dc: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b990f992-2831-4558-8a7e-c85be60b90dc', 'volume_size': 1, 'snapshot_id': '1445d111-4c74-40bd-89fc-f2c597734b58'} Apr 16 15:12:30 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-f8822ded-cead-4c19-ba19-2ca5953692fc tempest-SnapshotDependencyTests-2075410485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:12:30 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-f8822ded-cead-4c19-ba19-2ca5953692fc tempest-SnapshotDependencyTests-2075410485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:12:30 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-f8822ded-cead-4c19-ba19-2ca5953692fc tempest-SnapshotDependencyTests-2075410485 None] Acquiring lock "cinder-quobyte-1445d111-4c74-40bd-89fc-f2c597734b58-b990f992-2831-4558-8a7e-c85be60b90dc" by "_create_volume_from_snapshot" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:12:30 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-f8822ded-cead-4c19-ba19-2ca5953692fc tempest-SnapshotDependencyTests-2075410485 None] Lock "cinder-quobyte-1445d111-4c74-40bd-89fc-f2c597734b58-b990f992-2831-4558-8a7e-c85be60b90dc" acquired by "_create_volume_from_snapshot" :: waited 0.006s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:12:30 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-f8822ded-cead-4c19-ba19-2ca5953692fc tempest-SnapshotDependencyTests-2075410485 None] Creating volume b990f992-2831-4558-8a7e-c85be60b90dc from snapshot 1445d111-4c74-40bd-89fc-f2c597734b58 {{(pid=82756) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 16 15:12:30 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-f8822ded-cead-4c19-ba19-2ca5953692fc tempest-SnapshotDependencyTests-2075410485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:12:30 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-f8822ded-cead-4c19-ba19-2ca5953692fc tempest-SnapshotDependencyTests-2075410485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:12:30 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-f8822ded-cead-4c19-ba19-2ca5953692fc tempest-SnapshotDependencyTests-2075410485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:12:30 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-f8822ded-cead-4c19-ba19-2ca5953692fc tempest-SnapshotDependencyTests-2075410485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:12:30 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-f8822ded-cead-4c19-ba19-2ca5953692fc tempest-SnapshotDependencyTests-2075410485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:12:30 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-f8822ded-cead-4c19-ba19-2ca5953692fc tempest-SnapshotDependencyTests-2075410485 None] Selected osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 as target Quobyte volume. {{(pid=82756) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 15:12:30 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-f8822ded-cead-4c19-ba19-2ca5953692fc tempest-SnapshotDependencyTests-2075410485 None] Acquiring lock "cinder-quobyte-b990f992-2831-4558-8a7e-c85be60b90dc" by "_copy_volume_from_snapshot" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:12:30 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-f8822ded-cead-4c19-ba19-2ca5953692fc tempest-SnapshotDependencyTests-2075410485 None] Lock "cinder-quobyte-b990f992-2831-4558-8a7e-c85be60b90dc" acquired by "_copy_volume_from_snapshot" :: waited 0.011s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:12:30 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-f8822ded-cead-4c19-ba19-2ca5953692fc tempest-SnapshotDependencyTests-2075410485 None] snapshot: 1445d111-4c74-40bd-89fc-f2c597734b58, volume: b990f992-2831-4558-8a7e-c85be60b90dc, {{(pid=82756) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 16 15:12:30 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-f8822ded-cead-4c19-ba19-2ca5953692fc tempest-SnapshotDependencyTests-2075410485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:12:30 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-f8822ded-cead-4c19-ba19-2ca5953692fc tempest-SnapshotDependencyTests-2075410485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:12:30 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-f8822ded-cead-4c19-ba19-2ca5953692fc tempest-SnapshotDependencyTests-2075410485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:12:30 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-f8822ded-cead-4c19-ba19-2ca5953692fc tempest-SnapshotDependencyTests-2075410485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:12:30 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-f8822ded-cead-4c19-ba19-2ca5953692fc tempest-SnapshotDependencyTests-2075410485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:12:30 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[522af7f0-417a-4aeb-af1f-fc61fb9b1b7e]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:12:30 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-f8822ded-cead-4c19-ba19-2ca5953692fc tempest-SnapshotDependencyTests-2075410485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-59cf177f-aada-4733-9a33-200e63324487.1445d111-4c74-40bd-89fc-f2c597734b58 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:12:30 devstack sudo[89713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-59cf177f-aada-4733-9a33-200e63324487.1445d111-4c74-40bd-89fc-f2c597734b58 Apr 16 15:12:30 devstack sudo[89713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:12:30 devstack sudo[89711]: pam_unix(sudo:session): session closed for user root Apr 16 15:12:30 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-c517b2c7-455c-4aaa-9575-eceab1b55b74 tempest-SnapshotsActionsTest-295135696 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981" returned: 0 in 0.459s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:12:30 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-c517b2c7-455c-4aaa-9575-eceab1b55b74 tempest-SnapshotsActionsTest-295135696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.2f0ed87e-fe71-404f-ae88-58fa85f36866 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:12:30 devstack sudo[89718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.2f0ed87e-fe71-404f-ae88-58fa85f36866 Apr 16 15:12:30 devstack sudo[89718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:12:31 devstack sudo[89713]: pam_unix(sudo:session): session closed for user root Apr 16 15:12:31 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-f8822ded-cead-4c19-ba19-2ca5953692fc tempest-SnapshotDependencyTests-2075410485 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-59cf177f-aada-4733-9a33-200e63324487.1445d111-4c74-40bd-89fc-f2c597734b58" returned: 0 in 0.471s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:12:31 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-f8822ded-cead-4c19-ba19-2ca5953692fc tempest-SnapshotDependencyTests-2075410485 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-59cf177f-aada-4733-9a33-200e63324487(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82756) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 15:12:31 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-f8822ded-cead-4c19-ba19-2ca5953692fc tempest-SnapshotDependencyTests-2075410485 None] will copy from snapshot at /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-59cf177f-aada-4733-9a33-200e63324487 {{(pid=82756) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 16 15:12:31 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-f8822ded-cead-4c19-ba19-2ca5953692fc tempest-SnapshotDependencyTests-2075410485 None] Creating direct copy from snapshot {{(pid=82756) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 16 15:12:31 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8b04e46-9824-40be-9205-ea293ee1a7c3]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:12:31 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-f8822ded-cead-4c19-ba19-2ca5953692fc tempest-SnapshotDependencyTests-2075410485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-59cf177f-aada-4733-9a33-200e63324487 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:12:31 devstack sudo[89723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-59cf177f-aada-4733-9a33-200e63324487 Apr 16 15:12:31 devstack sudo[89723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:12:31 devstack sudo[89718]: pam_unix(sudo:session): session closed for user root Apr 16 15:12:31 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-c517b2c7-455c-4aaa-9575-eceab1b55b74 tempest-SnapshotsActionsTest-295135696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.2f0ed87e-fe71-404f-ae88-58fa85f36866" returned: 0 in 0.440s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:12:31 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-c517b2c7-455c-4aaa-9575-eceab1b55b74 tempest-SnapshotsActionsTest-295135696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.2f0ed87e-fe71-404f-ae88-58fa85f36866 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:12:31 devstack sudo[89728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.2f0ed87e-fe71-404f-ae88-58fa85f36866 Apr 16 15:12:31 devstack sudo[89728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:12:31 devstack sudo[89723]: pam_unix(sudo:session): session closed for user root Apr 16 15:12:31 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-f8822ded-cead-4c19-ba19-2ca5953692fc tempest-SnapshotDependencyTests-2075410485 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-59cf177f-aada-4733-9a33-200e63324487" returned: 0 in 0.482s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:12:31 devstack cinder-volume[82756]: DEBUG cinder.utils [None req-f8822ded-cead-4c19-ba19-2ca5953692fc tempest-SnapshotDependencyTests-2075410485 None] Path /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b990f992-2831-4558-8a7e-c85be60b90dc not found in is_blk_device check {{(pid=82756) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 16 15:12:31 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-f8822ded-cead-4c19-ba19-2ca5953692fc tempest-SnapshotDependencyTests-2075410485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-59cf177f-aada-4733-9a33-200e63324487 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b990f992-2831-4558-8a7e-c85be60b90dc {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:12:31 devstack sudo[89733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-59cf177f-aada-4733-9a33-200e63324487 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b990f992-2831-4558-8a7e-c85be60b90dc Apr 16 15:12:31 devstack sudo[89733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:12:31 devstack sudo[89728]: pam_unix(sudo:session): session closed for user root Apr 16 15:12:31 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-c517b2c7-455c-4aaa-9575-eceab1b55b74 tempest-SnapshotsActionsTest-295135696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981.2f0ed87e-fe71-404f-ae88-58fa85f36866" returned: 0 in 0.415s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:12:31 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-c517b2c7-455c-4aaa-9575-eceab1b55b74 tempest-SnapshotsActionsTest-295135696 None] Lock "cinder-quobyte-2f0ed87e-fe71-404f-ae88-58fa85f36866" released by "_delete_snapshot" :: held 1.860s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:12:31 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-c517b2c7-455c-4aaa-9575-eceab1b55b74 tempest-SnapshotsActionsTest-295135696 None] Lock "cinder-quobyte-08615ae8-52d0-43c6-9c67-7710d8190981" released by "delete_snapshot" :: held 1.872s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:12:31 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-c517b2c7-455c-4aaa-9575-eceab1b55b74 tempest-SnapshotsActionsTest-295135696 None] Created reservations ['d69de198-f667-448d-832e-d05dd48c4af6', '4c7281b9-c319-4d80-a4fa-dd4b19b9eab9', '0534a779-9094-43a1-8f11-82a66d741e00', '5787b93e-3584-485c-9aa6-29bb538233b8'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:12:31 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-c517b2c7-455c-4aaa-9575-eceab1b55b74 tempest-SnapshotsActionsTest-295135696 None] Delete snapshot completed successfully. Apr 16 15:12:31 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-c517b2c7-455c-4aaa-9575-eceab1b55b74 tempest-SnapshotsActionsTest-295135696 None] Lock "cinder-2f0ed87e-fe71-404f-ae88-58fa85f36866-delete_snapshot" released by "delete_snapshot" :: held 1.954s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:12:32 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-db6d314a-ddaf-4d66-ad1f-1aad41b64a60 tempest-SnapshotsActionsTest-295135696 None] Acquiring lock "cinder-08615ae8-52d0-43c6-9c67-7710d8190981-delete_volume" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:12:32 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-db6d314a-ddaf-4d66-ad1f-1aad41b64a60 tempest-SnapshotsActionsTest-295135696 None] Lock "cinder-08615ae8-52d0-43c6-9c67-7710d8190981-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:12:32 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-db6d314a-ddaf-4d66-ad1f-1aad41b64a60 tempest-SnapshotsActionsTest-295135696 None] Acquiring lock "cinder-quobyte-08615ae8-52d0-43c6-9c67-7710d8190981" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:12:32 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-db6d314a-ddaf-4d66-ad1f-1aad41b64a60 tempest-SnapshotsActionsTest-295135696 None] Lock "cinder-quobyte-08615ae8-52d0-43c6-9c67-7710d8190981" acquired by "delete_volume" :: waited 0.013s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:12:32 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[535524d9-de51-4b79-951d-0004ed6d15a5]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:12:32 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-db6d314a-ddaf-4d66-ad1f-1aad41b64a60 tempest-SnapshotsActionsTest-295135696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:12:32 devstack sudo[89746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981 Apr 16 15:12:32 devstack sudo[89746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:12:33 devstack sudo[89733]: pam_unix(sudo:session): session closed for user root Apr 16 15:12:33 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-f8822ded-cead-4c19-ba19-2ca5953692fc tempest-SnapshotDependencyTests-2075410485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-59cf177f-aada-4733-9a33-200e63324487 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b990f992-2831-4558-8a7e-c85be60b90dc" returned: 0 in 2.169s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:12:33 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c6b583c-7679-48ee-9b39-d2d78b5d432a]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:12:33 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-f8822ded-cead-4c19-ba19-2ca5953692fc tempest-SnapshotDependencyTests-2075410485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-59cf177f-aada-4733-9a33-200e63324487 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:12:33 devstack sudo[89746]: pam_unix(sudo:session): session closed for user root Apr 16 15:12:33 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-db6d314a-ddaf-4d66-ad1f-1aad41b64a60 tempest-SnapshotsActionsTest-295135696 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981" returned: 0 in 1.420s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:12:33 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-db6d314a-ddaf-4d66-ad1f-1aad41b64a60 tempest-SnapshotsActionsTest-295135696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:12:33 devstack sudo[89752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-59cf177f-aada-4733-9a33-200e63324487 Apr 16 15:12:33 devstack sudo[89752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:12:33 devstack sudo[89753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981 Apr 16 15:12:33 devstack sudo[89753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:12:34 devstack sudo[89753]: pam_unix(sudo:session): session closed for user root Apr 16 15:12:34 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-db6d314a-ddaf-4d66-ad1f-1aad41b64a60 tempest-SnapshotsActionsTest-295135696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-08615ae8-52d0-43c6-9c67-7710d8190981" returned: 0 in 0.411s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:12:34 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-db6d314a-ddaf-4d66-ad1f-1aad41b64a60 tempest-SnapshotsActionsTest-295135696 None] Lock "cinder-quobyte-08615ae8-52d0-43c6-9c67-7710d8190981" released by "delete_volume" :: held 1.883s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:12:34 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-db6d314a-ddaf-4d66-ad1f-1aad41b64a60 tempest-SnapshotsActionsTest-295135696 None] Created reservations ['8bf08b25-68d7-4bf0-9b27-55d55b45aa27', 'ff00ffcd-bf55-4fd6-a061-cc408bc646f7', '405fb034-3ff6-4504-9d34-6ca77a443cc5', '8f1ae510-9dd0-4a90-83ae-28a89a82d775'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:12:34 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-db6d314a-ddaf-4d66-ad1f-1aad41b64a60 tempest-SnapshotsActionsTest-295135696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:12:34 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-db6d314a-ddaf-4d66-ad1f-1aad41b64a60 tempest-SnapshotsActionsTest-295135696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:12:34 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-db6d314a-ddaf-4d66-ad1f-1aad41b64a60 tempest-SnapshotsActionsTest-295135696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:12:34 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-db6d314a-ddaf-4d66-ad1f-1aad41b64a60 tempest-SnapshotsActionsTest-295135696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:12:34 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-db6d314a-ddaf-4d66-ad1f-1aad41b64a60 tempest-SnapshotsActionsTest-295135696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:12:34 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-db6d314a-ddaf-4d66-ad1f-1aad41b64a60 tempest-SnapshotsActionsTest-295135696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:12:34 devstack sudo[89760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:12:34 devstack sudo[89760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:12:34 devstack sudo[89752]: pam_unix(sudo:session): session closed for user root Apr 16 15:12:34 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-f8822ded-cead-4c19-ba19-2ca5953692fc tempest-SnapshotDependencyTests-2075410485 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-59cf177f-aada-4733-9a33-200e63324487" returned: 0 in 0.612s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:12:34 devstack cinder-volume[82756]: DEBUG cinder.image.image_utils [None req-f8822ded-cead-4c19-ba19-2ca5953692fc tempest-SnapshotDependencyTests-2075410485 None] Image conversion details: src /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-59cf177f-aada-4733-9a33-200e63324487, size 1024.00 MB, duration 2.17 sec, destination /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b990f992-2831-4558-8a7e-c85be60b90dc {{(pid=82756) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 15:12:34 devstack cinder-volume[82756]: INFO cinder.image.image_utils [None req-f8822ded-cead-4c19-ba19-2ca5953692fc tempest-SnapshotDependencyTests-2075410485 None] Converted 1024.00 MB image at 471.89 MB/s Apr 16 15:12:34 devstack cinder-volume[82756]: WARNING cinder.volume.drivers.remotefs [None req-f8822ded-cead-4c19-ba19-2ca5953692fc tempest-SnapshotDependencyTests-2075410485 None] /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b990f992-2831-4558-8a7e-c85be60b90dc is being set with open permissions: ugo+rw Apr 16 15:12:34 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-f8822ded-cead-4c19-ba19-2ca5953692fc tempest-SnapshotDependencyTests-2075410485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b990f992-2831-4558-8a7e-c85be60b90dc {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:12:34 devstack sudo[89762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b990f992-2831-4558-8a7e-c85be60b90dc Apr 16 15:12:34 devstack sudo[89762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:12:34 devstack sudo[89760]: pam_unix(sudo:session): session closed for user root Apr 16 15:12:34 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-db6d314a-ddaf-4d66-ad1f-1aad41b64a60 tempest-SnapshotsActionsTest-295135696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.439s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:12:34 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-db6d314a-ddaf-4d66-ad1f-1aad41b64a60 tempest-SnapshotsActionsTest-295135696 None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:12:34 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-db6d314a-ddaf-4d66-ad1f-1aad41b64a60 tempest-SnapshotsActionsTest-295135696 None] Deleted volume successfully. Apr 16 15:12:34 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-db6d314a-ddaf-4d66-ad1f-1aad41b64a60 tempest-SnapshotsActionsTest-295135696 None] Lock "cinder-08615ae8-52d0-43c6-9c67-7710d8190981-delete_volume" released by "delete_volume" :: held 2.502s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:12:34 devstack sudo[89762]: pam_unix(sudo:session): session closed for user root Apr 16 15:12:34 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-f8822ded-cead-4c19-ba19-2ca5953692fc tempest-SnapshotDependencyTests-2075410485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b990f992-2831-4558-8a7e-c85be60b90dc" returned: 0 in 0.458s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:12:34 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-f8822ded-cead-4c19-ba19-2ca5953692fc tempest-SnapshotDependencyTests-2075410485 None] Lock "cinder-quobyte-b990f992-2831-4558-8a7e-c85be60b90dc" released by "_copy_volume_from_snapshot" :: held 4.247s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:12:34 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-f8822ded-cead-4c19-ba19-2ca5953692fc tempest-SnapshotDependencyTests-2075410485 None] Lock "cinder-quobyte-1445d111-4c74-40bd-89fc-f2c597734b58-b990f992-2831-4558-8a7e-c85be60b90dc" released by "_create_volume_from_snapshot" :: held 4.268s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:12:34 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-f8822ded-cead-4c19-ba19-2ca5953692fc tempest-SnapshotDependencyTests-2075410485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.275s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:12:34 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-f8822ded-cead-4c19-ba19-2ca5953692fc tempest-SnapshotDependencyTests-2075410485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab13bda6-a5a5-44d8-8611-dcd21f6ba889) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b990f992-2831-4558-8a7e-c85be60b90dc', 'volume_size': 1, 'snapshot_id': '1445d111-4c74-40bd-89fc-f2c597734b58'}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:12:34 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-f8822ded-cead-4c19-ba19-2ca5953692fc tempest-SnapshotDependencyTests-2075410485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5dba9a6-55ad-4a57-88ad-d171415f6030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:12:34 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-f8822ded-cead-4c19-ba19-2ca5953692fc tempest-SnapshotDependencyTests-2075410485 None] Volume volume-b990f992-2831-4558-8a7e-c85be60b90dc (b990f992-2831-4558-8a7e-c85be60b90dc): created successfully Apr 16 15:12:34 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-f8822ded-cead-4c19-ba19-2ca5953692fc tempest-SnapshotDependencyTests-2075410485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5dba9a6-55ad-4a57-88ad-d171415f6030) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:12:34 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-f8822ded-cead-4c19-ba19-2ca5953692fc tempest-SnapshotDependencyTests-2075410485 None] Flow 'volume_create_manager' (1c41db34-8091-464d-9e27-f13494521a2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:12:34 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-f8822ded-cead-4c19-ba19-2ca5953692fc tempest-SnapshotDependencyTests-2075410485 None] Created volume successfully. Apr 16 15:12:35 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-a1fd718e-1ed4-436a-9523-133d129ee480 tempest-SnapshotDependencyTests-2075410485 None] Acquiring lock "cinder-1445d111-4c74-40bd-89fc-f2c597734b58-delete_snapshot" by "delete_snapshot" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:12:35 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-a1fd718e-1ed4-436a-9523-133d129ee480 tempest-SnapshotDependencyTests-2075410485 None] Lock "cinder-1445d111-4c74-40bd-89fc-f2c597734b58-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:12:35 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-a1fd718e-1ed4-436a-9523-133d129ee480 tempest-SnapshotDependencyTests-2075410485 None] Acquiring lock "cinder-quobyte-59cf177f-aada-4733-9a33-200e63324487" by "delete_snapshot" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:12:35 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-a1fd718e-1ed4-436a-9523-133d129ee480 tempest-SnapshotDependencyTests-2075410485 None] Lock "cinder-quobyte-59cf177f-aada-4733-9a33-200e63324487" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:12:35 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-a1fd718e-1ed4-436a-9523-133d129ee480 tempest-SnapshotDependencyTests-2075410485 None] Acquiring lock "cinder-quobyte-1445d111-4c74-40bd-89fc-f2c597734b58" by "_delete_snapshot" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:12:35 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-a1fd718e-1ed4-436a-9523-133d129ee480 tempest-SnapshotDependencyTests-2075410485 None] Lock "cinder-quobyte-1445d111-4c74-40bd-89fc-f2c597734b58" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:12:35 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-a1fd718e-1ed4-436a-9523-133d129ee480 tempest-SnapshotDependencyTests-2075410485 None] Deleting offline snapshot 1445d111-4c74-40bd-89fc-f2c597734b58 of volume 59cf177f-aada-4733-9a33-200e63324487 {{(pid=82756) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 15:12:35 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-a1fd718e-1ed4-436a-9523-133d129ee480 tempest-SnapshotDependencyTests-2075410485 None] snapshot_file for this snap is: volume-59cf177f-aada-4733-9a33-200e63324487.1445d111-4c74-40bd-89fc-f2c597734b58 {{(pid=82756) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 15:12:35 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbda1e49-2624-4ce6-bbf9-5362a7d79892]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:12:35 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-a1fd718e-1ed4-436a-9523-133d129ee480 tempest-SnapshotDependencyTests-2075410485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-59cf177f-aada-4733-9a33-200e63324487.1445d111-4c74-40bd-89fc-f2c597734b58 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:12:35 devstack sudo[89766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-59cf177f-aada-4733-9a33-200e63324487.1445d111-4c74-40bd-89fc-f2c597734b58 Apr 16 15:12:35 devstack sudo[89766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:12:36 devstack sudo[89766]: pam_unix(sudo:session): session closed for user root Apr 16 15:12:36 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-a1fd718e-1ed4-436a-9523-133d129ee480 tempest-SnapshotDependencyTests-2075410485 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-59cf177f-aada-4733-9a33-200e63324487.1445d111-4c74-40bd-89fc-f2c597734b58" returned: 0 in 0.546s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:12:36 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-a1fd718e-1ed4-436a-9523-133d129ee480 tempest-SnapshotDependencyTests-2075410485 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-59cf177f-aada-4733-9a33-200e63324487(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82756) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 15:12:36 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[68c0a357-3857-45cf-ba92-cd2afa9de694]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:12:36 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-a1fd718e-1ed4-436a-9523-133d129ee480 tempest-SnapshotDependencyTests-2075410485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-59cf177f-aada-4733-9a33-200e63324487 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:12:36 devstack sudo[89771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-59cf177f-aada-4733-9a33-200e63324487 Apr 16 15:12:36 devstack sudo[89771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:12:37 devstack sudo[89771]: pam_unix(sudo:session): session closed for user root Apr 16 15:12:37 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-a1fd718e-1ed4-436a-9523-133d129ee480 tempest-SnapshotDependencyTests-2075410485 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-59cf177f-aada-4733-9a33-200e63324487" returned: 0 in 0.553s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:12:37 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-a1fd718e-1ed4-436a-9523-133d129ee480 tempest-SnapshotDependencyTests-2075410485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-59cf177f-aada-4733-9a33-200e63324487.1445d111-4c74-40bd-89fc-f2c597734b58 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:12:37 devstack sudo[89776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-59cf177f-aada-4733-9a33-200e63324487.1445d111-4c74-40bd-89fc-f2c597734b58 Apr 16 15:12:37 devstack sudo[89776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:12:37 devstack sudo[89776]: pam_unix(sudo:session): session closed for user root Apr 16 15:12:37 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-a1fd718e-1ed4-436a-9523-133d129ee480 tempest-SnapshotDependencyTests-2075410485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-59cf177f-aada-4733-9a33-200e63324487.1445d111-4c74-40bd-89fc-f2c597734b58" returned: 0 in 0.484s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:12:37 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-a1fd718e-1ed4-436a-9523-133d129ee480 tempest-SnapshotDependencyTests-2075410485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-59cf177f-aada-4733-9a33-200e63324487.1445d111-4c74-40bd-89fc-f2c597734b58 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:12:37 devstack sudo[89781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-59cf177f-aada-4733-9a33-200e63324487.1445d111-4c74-40bd-89fc-f2c597734b58 Apr 16 15:12:37 devstack sudo[89781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:12:38 devstack sudo[89781]: pam_unix(sudo:session): session closed for user root Apr 16 15:12:38 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-a1fd718e-1ed4-436a-9523-133d129ee480 tempest-SnapshotDependencyTests-2075410485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-59cf177f-aada-4733-9a33-200e63324487.1445d111-4c74-40bd-89fc-f2c597734b58" returned: 0 in 0.493s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:12:38 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-a1fd718e-1ed4-436a-9523-133d129ee480 tempest-SnapshotDependencyTests-2075410485 None] Lock "cinder-quobyte-1445d111-4c74-40bd-89fc-f2c597734b58" released by "_delete_snapshot" :: held 2.139s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:12:38 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-a1fd718e-1ed4-436a-9523-133d129ee480 tempest-SnapshotDependencyTests-2075410485 None] Lock "cinder-quobyte-59cf177f-aada-4733-9a33-200e63324487" released by "delete_snapshot" :: held 2.153s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:12:38 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-a1fd718e-1ed4-436a-9523-133d129ee480 tempest-SnapshotDependencyTests-2075410485 None] Created reservations ['805e1148-c427-49df-ae8d-62bea122e173', '16922bbc-7357-47fb-8028-05aafb5ede1a', '77e46ea1-ef7f-4cd9-89fd-d4498676440f', '5cb5f874-1351-49be-9a02-80d2dd1d8523'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:12:38 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-a1fd718e-1ed4-436a-9523-133d129ee480 tempest-SnapshotDependencyTests-2075410485 None] Delete snapshot completed successfully. Apr 16 15:12:38 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-a1fd718e-1ed4-436a-9523-133d129ee480 tempest-SnapshotDependencyTests-2075410485 None] Lock "cinder-1445d111-4c74-40bd-89fc-f2c597734b58-delete_snapshot" released by "delete_snapshot" :: held 2.272s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:12:39 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-e8198b1d-b99b-4554-8fbf-69ca4dd1cf43 tempest-SnapshotDependencyTests-2075410485 None] Acquiring lock "cinder-59cf177f-aada-4733-9a33-200e63324487-delete_volume" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:12:39 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-e8198b1d-b99b-4554-8fbf-69ca4dd1cf43 tempest-SnapshotDependencyTests-2075410485 None] Lock "cinder-59cf177f-aada-4733-9a33-200e63324487-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:12:39 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-e8198b1d-b99b-4554-8fbf-69ca4dd1cf43 tempest-SnapshotDependencyTests-2075410485 None] Acquiring lock "cinder-quobyte-59cf177f-aada-4733-9a33-200e63324487" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:12:39 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-e8198b1d-b99b-4554-8fbf-69ca4dd1cf43 tempest-SnapshotDependencyTests-2075410485 None] Lock "cinder-quobyte-59cf177f-aada-4733-9a33-200e63324487" acquired by "delete_volume" :: waited 0.007s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:12:39 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0b85be5-8dcd-433d-81f3-5fba1a70b65a]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:12:39 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-e8198b1d-b99b-4554-8fbf-69ca4dd1cf43 tempest-SnapshotDependencyTests-2075410485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-59cf177f-aada-4733-9a33-200e63324487 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:12:39 devstack sudo[89784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-59cf177f-aada-4733-9a33-200e63324487 Apr 16 15:12:39 devstack sudo[89784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:12:39 devstack sudo[89784]: pam_unix(sudo:session): session closed for user root Apr 16 15:12:39 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-e8198b1d-b99b-4554-8fbf-69ca4dd1cf43 tempest-SnapshotDependencyTests-2075410485 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-59cf177f-aada-4733-9a33-200e63324487" returned: 0 in 0.514s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:12:39 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-e8198b1d-b99b-4554-8fbf-69ca4dd1cf43 tempest-SnapshotDependencyTests-2075410485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-59cf177f-aada-4733-9a33-200e63324487 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:12:39 devstack sudo[89789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-59cf177f-aada-4733-9a33-200e63324487 Apr 16 15:12:39 devstack sudo[89789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:12:40 devstack sudo[89789]: pam_unix(sudo:session): session closed for user root Apr 16 15:12:40 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-e8198b1d-b99b-4554-8fbf-69ca4dd1cf43 tempest-SnapshotDependencyTests-2075410485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-59cf177f-aada-4733-9a33-200e63324487" returned: 0 in 0.422s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:12:40 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-e8198b1d-b99b-4554-8fbf-69ca4dd1cf43 tempest-SnapshotDependencyTests-2075410485 None] Lock "cinder-quobyte-59cf177f-aada-4733-9a33-200e63324487" released by "delete_volume" :: held 0.977s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:12:40 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-e8198b1d-b99b-4554-8fbf-69ca4dd1cf43 tempest-SnapshotDependencyTests-2075410485 None] Created reservations ['0f083ca5-1aae-454a-b0e2-e8a192c99974', 'de89bc3d-b50a-46b9-9c03-1cbeacb9ff07', '81d3fc99-8f26-46eb-9beb-6138984ca509', '402f4534-ecc8-4fe3-bc2d-34f93bd97966'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:12:40 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-e8198b1d-b99b-4554-8fbf-69ca4dd1cf43 tempest-SnapshotDependencyTests-2075410485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:12:40 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-e8198b1d-b99b-4554-8fbf-69ca4dd1cf43 tempest-SnapshotDependencyTests-2075410485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:12:40 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-e8198b1d-b99b-4554-8fbf-69ca4dd1cf43 tempest-SnapshotDependencyTests-2075410485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:12:40 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-e8198b1d-b99b-4554-8fbf-69ca4dd1cf43 tempest-SnapshotDependencyTests-2075410485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:12:40 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-e8198b1d-b99b-4554-8fbf-69ca4dd1cf43 tempest-SnapshotDependencyTests-2075410485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:12:40 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-e8198b1d-b99b-4554-8fbf-69ca4dd1cf43 tempest-SnapshotDependencyTests-2075410485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:12:40 devstack sudo[89792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:12:40 devstack sudo[89792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:12:40 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-f434bfaa-876a-41c7-a025-56679f3e59f7 tempest-SnapshotDependencyTests-2075410485 None] Acquiring lock "cinder-b990f992-2831-4558-8a7e-c85be60b90dc-delete_volume" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:12:40 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-f434bfaa-876a-41c7-a025-56679f3e59f7 tempest-SnapshotDependencyTests-2075410485 None] Lock "cinder-b990f992-2831-4558-8a7e-c85be60b90dc-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:12:40 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-f434bfaa-876a-41c7-a025-56679f3e59f7 tempest-SnapshotDependencyTests-2075410485 None] Acquiring lock "cinder-quobyte-b990f992-2831-4558-8a7e-c85be60b90dc" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:12:40 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-f434bfaa-876a-41c7-a025-56679f3e59f7 tempest-SnapshotDependencyTests-2075410485 None] Lock "cinder-quobyte-b990f992-2831-4558-8a7e-c85be60b90dc" acquired by "delete_volume" :: waited 0.008s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:12:40 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[a24cb01f-e73c-4640-9ae3-a9ae79cc7da2]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:12:40 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-f434bfaa-876a-41c7-a025-56679f3e59f7 tempest-SnapshotDependencyTests-2075410485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b990f992-2831-4558-8a7e-c85be60b90dc {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:12:40 devstack sudo[89794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b990f992-2831-4558-8a7e-c85be60b90dc Apr 16 15:12:40 devstack sudo[89794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:12:40 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [None req-e43e3086-ec55-4d7a-bce6-b1843d0e9cff tempest-VolumeQuotasNegativeTestJSON-1544419627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82756) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 15:12:40 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-e43e3086-ec55-4d7a-bce6-b1843d0e9cff tempest-VolumeQuotasNegativeTestJSON-1544419627 None] Flow 'volume_create_manager' (0086d3d0-8eeb-4bf4-be22-b710409908ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:12:40 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-e43e3086-ec55-4d7a-bce6-b1843d0e9cff tempest-VolumeQuotasNegativeTestJSON-1544419627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e769ba4-34a6-41a5-9c4d-81abf33740d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:12:40 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-e43e3086-ec55-4d7a-bce6-b1843d0e9cff tempest-VolumeQuotasNegativeTestJSON-1544419627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e769ba4-34a6-41a5-9c4d-81abf33740d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:12:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1018930418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0331264b-5910-4e93-9867-72660d38696c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3746dfd35364e56bd7d7d65cb5e191f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:12:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:12:40Z,use_quota=True,user_id='2e5f0b2e160c481e8d4a091b3577bdda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:12:40 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-e43e3086-ec55-4d7a-bce6-b1843d0e9cff tempest-VolumeQuotasNegativeTestJSON-1544419627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (452613af-296a-4316-b99b-df440aa08836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:12:40 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-e43e3086-ec55-4d7a-bce6-b1843d0e9cff tempest-VolumeQuotasNegativeTestJSON-1544419627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (452613af-296a-4316-b99b-df440aa08836) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:12:40 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-e43e3086-ec55-4d7a-bce6-b1843d0e9cff tempest-VolumeQuotasNegativeTestJSON-1544419627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9275a612-3e0b-43b8-907b-cd2370c3903d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:12:40 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-e43e3086-ec55-4d7a-bce6-b1843d0e9cff tempest-VolumeQuotasNegativeTestJSON-1544419627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9275a612-3e0b-43b8-907b-cd2370c3903d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0331264b-5910-4e93-9867-72660d38696c', 'volume_name': 'volume-0331264b-5910-4e93-9867-72660d38696c', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:12:40 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-e43e3086-ec55-4d7a-bce6-b1843d0e9cff tempest-VolumeQuotasNegativeTestJSON-1544419627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7635e74-4b3f-4517-9356-1b720bcab76c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:12:40 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-e43e3086-ec55-4d7a-bce6-b1843d0e9cff tempest-VolumeQuotasNegativeTestJSON-1544419627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7635e74-4b3f-4517-9356-1b720bcab76c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:12:40 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-e43e3086-ec55-4d7a-bce6-b1843d0e9cff tempest-VolumeQuotasNegativeTestJSON-1544419627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1005c235-3bde-404e-bce5-4161f74fbbfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:12:40 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-e43e3086-ec55-4d7a-bce6-b1843d0e9cff tempest-VolumeQuotasNegativeTestJSON-1544419627 None] Volume 0331264b-5910-4e93-9867-72660d38696c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0331264b-5910-4e93-9867-72660d38696c', 'volume_size': 1} Apr 16 15:12:40 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-e43e3086-ec55-4d7a-bce6-b1843d0e9cff tempest-VolumeQuotasNegativeTestJSON-1544419627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:12:40 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-e43e3086-ec55-4d7a-bce6-b1843d0e9cff tempest-VolumeQuotasNegativeTestJSON-1544419627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:12:40 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-e43e3086-ec55-4d7a-bce6-b1843d0e9cff tempest-VolumeQuotasNegativeTestJSON-1544419627 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:12:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1018930418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0331264b-5910-4e93-9867-72660d38696c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3746dfd35364e56bd7d7d65cb5e191f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:12:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:12:40Z,use_quota=True,user_id='2e5f0b2e160c481e8d4a091b3577bdda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)}" {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 15:12:40 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-e43e3086-ec55-4d7a-bce6-b1843d0e9cff tempest-VolumeQuotasNegativeTestJSON-1544419627 None] Creating volume 0331264b-5910-4e93-9867-72660d38696c {{(pid=82756) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 15:12:40 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-e43e3086-ec55-4d7a-bce6-b1843d0e9cff tempest-VolumeQuotasNegativeTestJSON-1544419627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:12:40 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-e43e3086-ec55-4d7a-bce6-b1843d0e9cff tempest-VolumeQuotasNegativeTestJSON-1544419627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:12:40 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-e43e3086-ec55-4d7a-bce6-b1843d0e9cff tempest-VolumeQuotasNegativeTestJSON-1544419627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:12:40 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-e43e3086-ec55-4d7a-bce6-b1843d0e9cff tempest-VolumeQuotasNegativeTestJSON-1544419627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:12:40 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-e43e3086-ec55-4d7a-bce6-b1843d0e9cff tempest-VolumeQuotasNegativeTestJSON-1544419627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:12:40 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-e43e3086-ec55-4d7a-bce6-b1843d0e9cff tempest-VolumeQuotasNegativeTestJSON-1544419627 None] Selected osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 as target Quobyte volume. {{(pid=82756) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 15:12:40 devstack cinder-volume[82756]: INFO cinder.volume.drivers.remotefs [None req-e43e3086-ec55-4d7a-bce6-b1843d0e9cff tempest-VolumeQuotasNegativeTestJSON-1544419627 None] casted to osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 Apr 16 15:12:40 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-e43e3086-ec55-4d7a-bce6-b1843d0e9cff tempest-VolumeQuotasNegativeTestJSON-1544419627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-0331264b-5910-4e93-9867-72660d38696c 1073741824 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:12:40 devstack sudo[89797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-0331264b-5910-4e93-9867-72660d38696c 1073741824 Apr 16 15:12:40 devstack sudo[89797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:12:40 devstack sudo[89792]: pam_unix(sudo:session): session closed for user root Apr 16 15:12:40 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-e8198b1d-b99b-4554-8fbf-69ca4dd1cf43 tempest-SnapshotDependencyTests-2075410485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.468s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:12:40 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-e8198b1d-b99b-4554-8fbf-69ca4dd1cf43 tempest-SnapshotDependencyTests-2075410485 None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:12:40 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-e8198b1d-b99b-4554-8fbf-69ca4dd1cf43 tempest-SnapshotDependencyTests-2075410485 None] Deleted volume successfully. Apr 16 15:12:40 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-e8198b1d-b99b-4554-8fbf-69ca4dd1cf43 tempest-SnapshotDependencyTests-2075410485 None] Lock "cinder-59cf177f-aada-4733-9a33-200e63324487-delete_volume" released by "delete_volume" :: held 1.591s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:12:40 devstack sudo[89794]: pam_unix(sudo:session): session closed for user root Apr 16 15:12:40 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-f434bfaa-876a-41c7-a025-56679f3e59f7 tempest-SnapshotDependencyTests-2075410485 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b990f992-2831-4558-8a7e-c85be60b90dc" returned: 0 in 0.471s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:12:40 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-f434bfaa-876a-41c7-a025-56679f3e59f7 tempest-SnapshotDependencyTests-2075410485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b990f992-2831-4558-8a7e-c85be60b90dc {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:12:40 devstack sudo[89802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b990f992-2831-4558-8a7e-c85be60b90dc Apr 16 15:12:40 devstack sudo[89802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:12:41 devstack sudo[89797]: pam_unix(sudo:session): session closed for user root Apr 16 15:12:41 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-e43e3086-ec55-4d7a-bce6-b1843d0e9cff tempest-VolumeQuotasNegativeTestJSON-1544419627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-0331264b-5910-4e93-9867-72660d38696c 1073741824" returned: 0 in 0.539s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:12:41 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-e43e3086-ec55-4d7a-bce6-b1843d0e9cff tempest-VolumeQuotasNegativeTestJSON-1544419627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-0331264b-5910-4e93-9867-72660d38696c {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:12:41 devstack sudo[89802]: pam_unix(sudo:session): session closed for user root Apr 16 15:12:41 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-f434bfaa-876a-41c7-a025-56679f3e59f7 tempest-SnapshotDependencyTests-2075410485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b990f992-2831-4558-8a7e-c85be60b90dc" returned: 0 in 0.426s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:12:41 devstack sudo[89808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-0331264b-5910-4e93-9867-72660d38696c Apr 16 15:12:41 devstack sudo[89808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:12:41 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-f434bfaa-876a-41c7-a025-56679f3e59f7 tempest-SnapshotDependencyTests-2075410485 None] Lock "cinder-quobyte-b990f992-2831-4558-8a7e-c85be60b90dc" released by "delete_volume" :: held 0.929s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:12:41 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-f434bfaa-876a-41c7-a025-56679f3e59f7 tempest-SnapshotDependencyTests-2075410485 None] Created reservations ['357d1f4d-e8e0-4885-a3c4-1e90afaca120', 'e72cdebb-637d-4041-8acc-0011a4b16f1d', 'c867ec3a-722d-456e-a22b-a63d5fd8736e', 'b38db498-64d6-48f2-b702-36bf0fd76742'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:12:41 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-f434bfaa-876a-41c7-a025-56679f3e59f7 tempest-SnapshotDependencyTests-2075410485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:12:41 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-f434bfaa-876a-41c7-a025-56679f3e59f7 tempest-SnapshotDependencyTests-2075410485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:12:41 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-f434bfaa-876a-41c7-a025-56679f3e59f7 tempest-SnapshotDependencyTests-2075410485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:12:41 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-f434bfaa-876a-41c7-a025-56679f3e59f7 tempest-SnapshotDependencyTests-2075410485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:12:41 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-f434bfaa-876a-41c7-a025-56679f3e59f7 tempest-SnapshotDependencyTests-2075410485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:12:41 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-f434bfaa-876a-41c7-a025-56679f3e59f7 tempest-SnapshotDependencyTests-2075410485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:12:41 devstack sudo[89810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:12:41 devstack sudo[89810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:12:41 devstack sudo[89808]: pam_unix(sudo:session): session closed for user root Apr 16 15:12:41 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-e43e3086-ec55-4d7a-bce6-b1843d0e9cff tempest-VolumeQuotasNegativeTestJSON-1544419627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-0331264b-5910-4e93-9867-72660d38696c" returned: 0 in 0.467s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:12:41 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-e43e3086-ec55-4d7a-bce6-b1843d0e9cff tempest-VolumeQuotasNegativeTestJSON-1544419627 None] <== create_volume: return (1036ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'} {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 15:12:41 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-e43e3086-ec55-4d7a-bce6-b1843d0e9cff tempest-VolumeQuotasNegativeTestJSON-1544419627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.039s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:12:41 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-e43e3086-ec55-4d7a-bce6-b1843d0e9cff tempest-VolumeQuotasNegativeTestJSON-1544419627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1005c235-3bde-404e-bce5-4161f74fbbfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0331264b-5910-4e93-9867-72660d38696c', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:12:41 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-e43e3086-ec55-4d7a-bce6-b1843d0e9cff tempest-VolumeQuotasNegativeTestJSON-1544419627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef97e372-9b00-4803-966e-32e004686980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:12:41 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-e43e3086-ec55-4d7a-bce6-b1843d0e9cff tempest-VolumeQuotasNegativeTestJSON-1544419627 None] Volume volume-0331264b-5910-4e93-9867-72660d38696c (0331264b-5910-4e93-9867-72660d38696c): created successfully Apr 16 15:12:41 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-e43e3086-ec55-4d7a-bce6-b1843d0e9cff tempest-VolumeQuotasNegativeTestJSON-1544419627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef97e372-9b00-4803-966e-32e004686980) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:12:41 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-e43e3086-ec55-4d7a-bce6-b1843d0e9cff tempest-VolumeQuotasNegativeTestJSON-1544419627 None] Flow 'volume_create_manager' (0086d3d0-8eeb-4bf4-be22-b710409908ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:12:41 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-e43e3086-ec55-4d7a-bce6-b1843d0e9cff tempest-VolumeQuotasNegativeTestJSON-1544419627 None] Created volume successfully. Apr 16 15:12:41 devstack sudo[89810]: pam_unix(sudo:session): session closed for user root Apr 16 15:12:41 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-f434bfaa-876a-41c7-a025-56679f3e59f7 tempest-SnapshotDependencyTests-2075410485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.467s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:12:41 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-f434bfaa-876a-41c7-a025-56679f3e59f7 tempest-SnapshotDependencyTests-2075410485 None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:12:41 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-f434bfaa-876a-41c7-a025-56679f3e59f7 tempest-SnapshotDependencyTests-2075410485 None] Deleted volume successfully. Apr 16 15:12:41 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-f434bfaa-876a-41c7-a025-56679f3e59f7 tempest-SnapshotDependencyTests-2075410485 None] Lock "cinder-b990f992-2831-4558-8a7e-c85be60b90dc-delete_volume" released by "delete_volume" :: held 1.538s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:12:43 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-49500cc9-85a2-48b3-a76d-b00d4d92ce1d tempest-VolumeQuotasNegativeTestJSON-1544419627 None] Acquiring lock "cinder-0331264b-5910-4e93-9867-72660d38696c-delete_volume" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:12:43 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-49500cc9-85a2-48b3-a76d-b00d4d92ce1d tempest-VolumeQuotasNegativeTestJSON-1544419627 None] Lock "cinder-0331264b-5910-4e93-9867-72660d38696c-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:12:43 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-49500cc9-85a2-48b3-a76d-b00d4d92ce1d tempest-VolumeQuotasNegativeTestJSON-1544419627 None] Acquiring lock "cinder-quobyte-0331264b-5910-4e93-9867-72660d38696c" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:12:43 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-49500cc9-85a2-48b3-a76d-b00d4d92ce1d tempest-VolumeQuotasNegativeTestJSON-1544419627 None] Lock "cinder-quobyte-0331264b-5910-4e93-9867-72660d38696c" acquired by "delete_volume" :: waited 0.007s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:12:43 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f5e0a76-fffd-4ef6-9b97-580d18b6a18c]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:12:43 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-49500cc9-85a2-48b3-a76d-b00d4d92ce1d tempest-VolumeQuotasNegativeTestJSON-1544419627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-0331264b-5910-4e93-9867-72660d38696c {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:12:43 devstack sudo[89815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-0331264b-5910-4e93-9867-72660d38696c Apr 16 15:12:43 devstack sudo[89815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:12:43 devstack sudo[89815]: pam_unix(sudo:session): session closed for user root Apr 16 15:12:43 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-49500cc9-85a2-48b3-a76d-b00d4d92ce1d tempest-VolumeQuotasNegativeTestJSON-1544419627 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-0331264b-5910-4e93-9867-72660d38696c" returned: 0 in 0.503s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:12:43 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-49500cc9-85a2-48b3-a76d-b00d4d92ce1d tempest-VolumeQuotasNegativeTestJSON-1544419627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-0331264b-5910-4e93-9867-72660d38696c {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:12:43 devstack sudo[89822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-0331264b-5910-4e93-9867-72660d38696c Apr 16 15:12:43 devstack sudo[89822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:12:44 devstack sudo[89822]: pam_unix(sudo:session): session closed for user root Apr 16 15:12:44 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-49500cc9-85a2-48b3-a76d-b00d4d92ce1d tempest-VolumeQuotasNegativeTestJSON-1544419627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-0331264b-5910-4e93-9867-72660d38696c" returned: 0 in 0.409s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:12:44 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-49500cc9-85a2-48b3-a76d-b00d4d92ce1d tempest-VolumeQuotasNegativeTestJSON-1544419627 None] Lock "cinder-quobyte-0331264b-5910-4e93-9867-72660d38696c" released by "delete_volume" :: held 0.940s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:12:44 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-49500cc9-85a2-48b3-a76d-b00d4d92ce1d tempest-VolumeQuotasNegativeTestJSON-1544419627 None] Created reservations ['30d6817a-ea14-42a2-9275-a5633512b75e', 'd03877fb-af2a-4139-aea8-b77a8fbeafda', 'f8675b00-87a0-4dd3-aef8-ed1207743ed6', '67f20164-ccf0-457a-b5f7-49502c18c711'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:12:44 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-49500cc9-85a2-48b3-a76d-b00d4d92ce1d tempest-VolumeQuotasNegativeTestJSON-1544419627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:12:44 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-49500cc9-85a2-48b3-a76d-b00d4d92ce1d tempest-VolumeQuotasNegativeTestJSON-1544419627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:12:44 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-49500cc9-85a2-48b3-a76d-b00d4d92ce1d tempest-VolumeQuotasNegativeTestJSON-1544419627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:12:44 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-49500cc9-85a2-48b3-a76d-b00d4d92ce1d tempest-VolumeQuotasNegativeTestJSON-1544419627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:12:44 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-49500cc9-85a2-48b3-a76d-b00d4d92ce1d tempest-VolumeQuotasNegativeTestJSON-1544419627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:12:44 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-49500cc9-85a2-48b3-a76d-b00d4d92ce1d tempest-VolumeQuotasNegativeTestJSON-1544419627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:12:44 devstack sudo[89825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:12:44 devstack sudo[89825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:12:44 devstack sudo[89825]: pam_unix(sudo:session): session closed for user root Apr 16 15:12:44 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-49500cc9-85a2-48b3-a76d-b00d4d92ce1d tempest-VolumeQuotasNegativeTestJSON-1544419627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.495s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:12:44 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-49500cc9-85a2-48b3-a76d-b00d4d92ce1d tempest-VolumeQuotasNegativeTestJSON-1544419627 None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:12:44 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-49500cc9-85a2-48b3-a76d-b00d4d92ce1d tempest-VolumeQuotasNegativeTestJSON-1544419627 None] Deleted volume successfully. Apr 16 15:12:44 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-49500cc9-85a2-48b3-a76d-b00d4d92ce1d tempest-VolumeQuotasNegativeTestJSON-1544419627 None] Lock "cinder-0331264b-5910-4e93-9867-72660d38696c-delete_volume" released by "delete_volume" :: held 1.559s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:12:48 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [None req-e077f4d9-2cc8-4caf-a5a1-448e51c751a1 tempest-VolumeRetypeWithoutMigrationTest-1124114826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82756) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 15:12:48 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-e077f4d9-2cc8-4caf-a5a1-448e51c751a1 tempest-VolumeRetypeWithoutMigrationTest-1124114826 None] Flow 'volume_create_manager' (6074078e-0cd5-4c08-8ed0-4f190c184f2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:12:48 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-e077f4d9-2cc8-4caf-a5a1-448e51c751a1 tempest-VolumeRetypeWithoutMigrationTest-1124114826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4c9c051-616a-4e54-845f-0927083e18cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:12:48 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-e077f4d9-2cc8-4caf-a5a1-448e51c751a1 tempest-VolumeRetypeWithoutMigrationTest-1124114826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4c9c051-616a-4e54-845f-0927083e18cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:12:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-569256432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46d133a6-fb67-42bf-8f76-a7620571cae0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df3272a9d58a47b792350c6777808ff7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:12:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:12:48Z,use_quota=True,user_id='aab93a9b19f14981aed579bc158a91b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae3a64e5-a941-4c5c-be0c-1775e1918152),volume_type_id=ae3a64e5-a941-4c5c-be0c-1775e1918152)' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:12:48 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-e077f4d9-2cc8-4caf-a5a1-448e51c751a1 tempest-VolumeRetypeWithoutMigrationTest-1124114826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67377e24-2999-4926-8316-5b041599296c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:12:48 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-e077f4d9-2cc8-4caf-a5a1-448e51c751a1 tempest-VolumeRetypeWithoutMigrationTest-1124114826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67377e24-2999-4926-8316-5b041599296c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:12:48 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-e077f4d9-2cc8-4caf-a5a1-448e51c751a1 tempest-VolumeRetypeWithoutMigrationTest-1124114826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (600907ce-d2d6-4b8e-bd7a-10e40f66eb0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:12:48 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-e077f4d9-2cc8-4caf-a5a1-448e51c751a1 tempest-VolumeRetypeWithoutMigrationTest-1124114826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (600907ce-d2d6-4b8e-bd7a-10e40f66eb0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46d133a6-fb67-42bf-8f76-a7620571cae0', 'volume_name': 'volume-46d133a6-fb67-42bf-8f76-a7620571cae0', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:12:48 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-e077f4d9-2cc8-4caf-a5a1-448e51c751a1 tempest-VolumeRetypeWithoutMigrationTest-1124114826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (986832f4-cfe7-49ba-a0f2-fdcece91161d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:12:48 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-e077f4d9-2cc8-4caf-a5a1-448e51c751a1 tempest-VolumeRetypeWithoutMigrationTest-1124114826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (986832f4-cfe7-49ba-a0f2-fdcece91161d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:12:48 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-e077f4d9-2cc8-4caf-a5a1-448e51c751a1 tempest-VolumeRetypeWithoutMigrationTest-1124114826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d8100be-0ea2-45e1-bcb6-056eb0832514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:12:48 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-e077f4d9-2cc8-4caf-a5a1-448e51c751a1 tempest-VolumeRetypeWithoutMigrationTest-1124114826 None] Volume 46d133a6-fb67-42bf-8f76-a7620571cae0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46d133a6-fb67-42bf-8f76-a7620571cae0', 'volume_size': 1} Apr 16 15:12:48 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-e077f4d9-2cc8-4caf-a5a1-448e51c751a1 tempest-VolumeRetypeWithoutMigrationTest-1124114826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:12:48 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-e077f4d9-2cc8-4caf-a5a1-448e51c751a1 tempest-VolumeRetypeWithoutMigrationTest-1124114826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:12:48 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-e077f4d9-2cc8-4caf-a5a1-448e51c751a1 tempest-VolumeRetypeWithoutMigrationTest-1124114826 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:12:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-569256432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46d133a6-fb67-42bf-8f76-a7620571cae0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df3272a9d58a47b792350c6777808ff7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:12:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:12:48Z,use_quota=True,user_id='aab93a9b19f14981aed579bc158a91b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae3a64e5-a941-4c5c-be0c-1775e1918152),volume_type_id=ae3a64e5-a941-4c5c-be0c-1775e1918152)}" {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 15:12:48 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-e077f4d9-2cc8-4caf-a5a1-448e51c751a1 tempest-VolumeRetypeWithoutMigrationTest-1124114826 None] Creating volume 46d133a6-fb67-42bf-8f76-a7620571cae0 {{(pid=82756) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 15:12:48 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-e077f4d9-2cc8-4caf-a5a1-448e51c751a1 tempest-VolumeRetypeWithoutMigrationTest-1124114826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:12:48 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-e077f4d9-2cc8-4caf-a5a1-448e51c751a1 tempest-VolumeRetypeWithoutMigrationTest-1124114826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:12:48 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-e077f4d9-2cc8-4caf-a5a1-448e51c751a1 tempest-VolumeRetypeWithoutMigrationTest-1124114826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:12:48 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-e077f4d9-2cc8-4caf-a5a1-448e51c751a1 tempest-VolumeRetypeWithoutMigrationTest-1124114826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:12:48 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-e077f4d9-2cc8-4caf-a5a1-448e51c751a1 tempest-VolumeRetypeWithoutMigrationTest-1124114826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:12:48 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-e077f4d9-2cc8-4caf-a5a1-448e51c751a1 tempest-VolumeRetypeWithoutMigrationTest-1124114826 None] Selected osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 as target Quobyte volume. {{(pid=82756) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 15:12:48 devstack cinder-volume[82756]: INFO cinder.volume.drivers.remotefs [None req-e077f4d9-2cc8-4caf-a5a1-448e51c751a1 tempest-VolumeRetypeWithoutMigrationTest-1124114826 None] casted to osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 Apr 16 15:12:48 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-e077f4d9-2cc8-4caf-a5a1-448e51c751a1 tempest-VolumeRetypeWithoutMigrationTest-1124114826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-46d133a6-fb67-42bf-8f76-a7620571cae0 1073741824 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:12:48 devstack sudo[89830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-46d133a6-fb67-42bf-8f76-a7620571cae0 1073741824 Apr 16 15:12:48 devstack sudo[89830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:12:48 devstack sudo[89830]: pam_unix(sudo:session): session closed for user root Apr 16 15:12:48 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-e077f4d9-2cc8-4caf-a5a1-448e51c751a1 tempest-VolumeRetypeWithoutMigrationTest-1124114826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-46d133a6-fb67-42bf-8f76-a7620571cae0 1073741824" returned: 0 in 0.458s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:12:48 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-e077f4d9-2cc8-4caf-a5a1-448e51c751a1 tempest-VolumeRetypeWithoutMigrationTest-1124114826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-46d133a6-fb67-42bf-8f76-a7620571cae0 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:12:48 devstack sudo[89835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-46d133a6-fb67-42bf-8f76-a7620571cae0 Apr 16 15:12:48 devstack sudo[89835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:12:49 devstack sudo[89835]: pam_unix(sudo:session): session closed for user root Apr 16 15:12:49 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-e077f4d9-2cc8-4caf-a5a1-448e51c751a1 tempest-VolumeRetypeWithoutMigrationTest-1124114826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-46d133a6-fb67-42bf-8f76-a7620571cae0" returned: 0 in 0.384s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:12:49 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-e077f4d9-2cc8-4caf-a5a1-448e51c751a1 tempest-VolumeRetypeWithoutMigrationTest-1124114826 None] <== create_volume: return (867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'} {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 15:12:49 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-e077f4d9-2cc8-4caf-a5a1-448e51c751a1 tempest-VolumeRetypeWithoutMigrationTest-1124114826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.870s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:12:49 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-e077f4d9-2cc8-4caf-a5a1-448e51c751a1 tempest-VolumeRetypeWithoutMigrationTest-1124114826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d8100be-0ea2-45e1-bcb6-056eb0832514) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46d133a6-fb67-42bf-8f76-a7620571cae0', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:12:49 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-e077f4d9-2cc8-4caf-a5a1-448e51c751a1 tempest-VolumeRetypeWithoutMigrationTest-1124114826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2111f681-12b6-44dc-a559-294c668ef500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:12:49 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-e077f4d9-2cc8-4caf-a5a1-448e51c751a1 tempest-VolumeRetypeWithoutMigrationTest-1124114826 None] Volume volume-46d133a6-fb67-42bf-8f76-a7620571cae0 (46d133a6-fb67-42bf-8f76-a7620571cae0): created successfully Apr 16 15:12:49 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-e077f4d9-2cc8-4caf-a5a1-448e51c751a1 tempest-VolumeRetypeWithoutMigrationTest-1124114826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2111f681-12b6-44dc-a559-294c668ef500) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:12:49 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-e077f4d9-2cc8-4caf-a5a1-448e51c751a1 tempest-VolumeRetypeWithoutMigrationTest-1124114826 None] Flow 'volume_create_manager' (6074078e-0cd5-4c08-8ed0-4f190c184f2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:12:49 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-e077f4d9-2cc8-4caf-a5a1-448e51c751a1 tempest-VolumeRetypeWithoutMigrationTest-1124114826 None] Created volume successfully. Apr 16 15:12:49 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-ec6265cb-1800-4a0c-83f4-4916fefed700 tempest-VolumeRetypeWithoutMigrationTest-1124114826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:12:49 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-ec6265cb-1800-4a0c-83f4-4916fefed700 tempest-VolumeRetypeWithoutMigrationTest-1124114826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:12:49 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-ec6265cb-1800-4a0c-83f4-4916fefed700 tempest-VolumeRetypeWithoutMigrationTest-1124114826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:12:49 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-ec6265cb-1800-4a0c-83f4-4916fefed700 tempest-VolumeRetypeWithoutMigrationTest-1124114826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:12:49 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-ec6265cb-1800-4a0c-83f4-4916fefed700 tempest-VolumeRetypeWithoutMigrationTest-1124114826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:12:49 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-ec6265cb-1800-4a0c-83f4-4916fefed700 tempest-VolumeRetypeWithoutMigrationTest-1124114826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:12:49 devstack sudo[89838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:12:49 devstack sudo[89838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:12:50 devstack sudo[89838]: pam_unix(sudo:session): session closed for user root Apr 16 15:12:50 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-ec6265cb-1800-4a0c-83f4-4916fefed700 tempest-VolumeRetypeWithoutMigrationTest-1124114826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.417s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:12:50 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-ec6265cb-1800-4a0c-83f4-4916fefed700 tempest-VolumeRetypeWithoutMigrationTest-1124114826 None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:12:50 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-ec6265cb-1800-4a0c-83f4-4916fefed700 tempest-VolumeRetypeWithoutMigrationTest-1124114826 None] Retype volume completed successfully. Apr 16 15:12:50 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-57843be3-e5d0-43d0-964b-39e7042c9544 tempest-VolumeRetypeWithoutMigrationTest-1124114826 None] Acquiring lock "cinder-46d133a6-fb67-42bf-8f76-a7620571cae0-delete_volume" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:12:50 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-57843be3-e5d0-43d0-964b-39e7042c9544 tempest-VolumeRetypeWithoutMigrationTest-1124114826 None] Lock "cinder-46d133a6-fb67-42bf-8f76-a7620571cae0-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:12:50 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-57843be3-e5d0-43d0-964b-39e7042c9544 tempest-VolumeRetypeWithoutMigrationTest-1124114826 None] Acquiring lock "cinder-quobyte-46d133a6-fb67-42bf-8f76-a7620571cae0" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:12:50 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-57843be3-e5d0-43d0-964b-39e7042c9544 tempest-VolumeRetypeWithoutMigrationTest-1124114826 None] Lock "cinder-quobyte-46d133a6-fb67-42bf-8f76-a7620571cae0" acquired by "delete_volume" :: waited 0.006s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:12:50 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fb941ad-1a1f-4f6a-8f3e-5d7b5094c9af]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:12:50 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-57843be3-e5d0-43d0-964b-39e7042c9544 tempest-VolumeRetypeWithoutMigrationTest-1124114826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-46d133a6-fb67-42bf-8f76-a7620571cae0 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:12:50 devstack sudo[89841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-46d133a6-fb67-42bf-8f76-a7620571cae0 Apr 16 15:12:50 devstack sudo[89841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:12:51 devstack sudo[89841]: pam_unix(sudo:session): session closed for user root Apr 16 15:12:51 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-57843be3-e5d0-43d0-964b-39e7042c9544 tempest-VolumeRetypeWithoutMigrationTest-1124114826 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-46d133a6-fb67-42bf-8f76-a7620571cae0" returned: 0 in 0.446s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:12:51 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-57843be3-e5d0-43d0-964b-39e7042c9544 tempest-VolumeRetypeWithoutMigrationTest-1124114826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-46d133a6-fb67-42bf-8f76-a7620571cae0 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:12:51 devstack sudo[89846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-46d133a6-fb67-42bf-8f76-a7620571cae0 Apr 16 15:12:51 devstack sudo[89846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:12:51 devstack sudo[89846]: pam_unix(sudo:session): session closed for user root Apr 16 15:12:51 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-57843be3-e5d0-43d0-964b-39e7042c9544 tempest-VolumeRetypeWithoutMigrationTest-1124114826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-46d133a6-fb67-42bf-8f76-a7620571cae0" returned: 0 in 0.394s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:12:51 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-57843be3-e5d0-43d0-964b-39e7042c9544 tempest-VolumeRetypeWithoutMigrationTest-1124114826 None] Lock "cinder-quobyte-46d133a6-fb67-42bf-8f76-a7620571cae0" released by "delete_volume" :: held 0.859s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:12:51 devstack cinder-volume[82756]: WARNING cinder.quota [None req-57843be3-e5d0-43d0-964b-39e7042c9544 tempest-VolumeRetypeWithoutMigrationTest-1124114826 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 16 15:12:51 devstack cinder-volume[82756]: WARNING cinder.quota [None req-57843be3-e5d0-43d0-964b-39e7042c9544 tempest-VolumeRetypeWithoutMigrationTest-1124114826 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 16 15:12:51 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-57843be3-e5d0-43d0-964b-39e7042c9544 tempest-VolumeRetypeWithoutMigrationTest-1124114826 None] Created reservations ['5252189b-df60-4250-8284-49f76bf54252', '920e2583-e6ed-4a42-90da-56dc2b1f502f', '4034dfbc-9160-44d0-9fd0-279707adda7b', '0ef69f0d-e7c1-45bc-b073-0aa7db7f7cba'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:12:51 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-57843be3-e5d0-43d0-964b-39e7042c9544 tempest-VolumeRetypeWithoutMigrationTest-1124114826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:12:51 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-57843be3-e5d0-43d0-964b-39e7042c9544 tempest-VolumeRetypeWithoutMigrationTest-1124114826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:12:51 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-57843be3-e5d0-43d0-964b-39e7042c9544 tempest-VolumeRetypeWithoutMigrationTest-1124114826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:12:51 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-57843be3-e5d0-43d0-964b-39e7042c9544 tempest-VolumeRetypeWithoutMigrationTest-1124114826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:12:51 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-57843be3-e5d0-43d0-964b-39e7042c9544 tempest-VolumeRetypeWithoutMigrationTest-1124114826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:12:51 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-57843be3-e5d0-43d0-964b-39e7042c9544 tempest-VolumeRetypeWithoutMigrationTest-1124114826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:12:51 devstack cinder-volume[82756]: DEBUG oslo_service.periodic_task [None req-9570f02d-5ef9-412b-993f-520a9e5bfa81 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82756) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 16 15:12:51 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-9570f02d-5ef9-412b-993f-520a9e5bfa81 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:12:51 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-9570f02d-5ef9-412b-993f-520a9e5bfa81 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:12:51 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-9570f02d-5ef9-412b-993f-520a9e5bfa81 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:12:51 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-9570f02d-5ef9-412b-993f-520a9e5bfa81 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:12:51 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-9570f02d-5ef9-412b-993f-520a9e5bfa81 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:12:51 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-9570f02d-5ef9-412b-993f-520a9e5bfa81 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:12:51 devstack sudo[89849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:12:51 devstack sudo[89849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:12:51 devstack sudo[89850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:12:51 devstack sudo[89850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:12:52 devstack sudo[89849]: pam_unix(sudo:session): session closed for user root Apr 16 15:12:52 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-57843be3-e5d0-43d0-964b-39e7042c9544 tempest-VolumeRetypeWithoutMigrationTest-1124114826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.457s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:12:52 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-57843be3-e5d0-43d0-964b-39e7042c9544 tempest-VolumeRetypeWithoutMigrationTest-1124114826 None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:12:52 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-57843be3-e5d0-43d0-964b-39e7042c9544 tempest-VolumeRetypeWithoutMigrationTest-1124114826 None] Deleted volume successfully. Apr 16 15:12:52 devstack sudo[89850]: pam_unix(sudo:session): session closed for user root Apr 16 15:12:52 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-57843be3-e5d0-43d0-964b-39e7042c9544 tempest-VolumeRetypeWithoutMigrationTest-1124114826 None] Lock "cinder-46d133a6-fb67-42bf-8f76-a7620571cae0-delete_volume" released by "delete_volume" :: held 1.436s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:12:52 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-9570f02d-5ef9-412b-993f-520a9e5bfa81 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.469s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:12:52 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-9570f02d-5ef9-412b-993f-520a9e5bfa81 None None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:12:55 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [None req-00dcbcfb-e504-407c-b771-a42056f3bb70 tempest-VolumeTypesAccessTest-1961845034 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82756) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 15:12:55 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-00dcbcfb-e504-407c-b771-a42056f3bb70 tempest-VolumeTypesAccessTest-1961845034 None] Flow 'volume_create_manager' (b177c64c-f31d-46ea-afa8-78611f395dca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:12:55 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-00dcbcfb-e504-407c-b771-a42056f3bb70 tempest-VolumeTypesAccessTest-1961845034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03862d62-0513-4f20-a588-85497913437e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:12:55 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-00dcbcfb-e504-407c-b771-a42056f3bb70 tempest-VolumeTypesAccessTest-1961845034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03862d62-0513-4f20-a588-85497913437e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:12:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-971616362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edd5f659-75bc-4803-b46b-f49108272a81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23d9c962785c4b498e1252e7369742a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:12:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:12:55Z,use_quota=True,user_id='fde963fae5d44a5ab616a61ffee35d26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98a3057e-70f1-40c8-8b01-876e3dfaf679),volume_type_id=98a3057e-70f1-40c8-8b01-876e3dfaf679)' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:12:55 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-00dcbcfb-e504-407c-b771-a42056f3bb70 tempest-VolumeTypesAccessTest-1961845034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db6dd456-9464-45bf-93ae-6d95770f638a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:12:55 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-00dcbcfb-e504-407c-b771-a42056f3bb70 tempest-VolumeTypesAccessTest-1961845034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db6dd456-9464-45bf-93ae-6d95770f638a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:12:55 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-00dcbcfb-e504-407c-b771-a42056f3bb70 tempest-VolumeTypesAccessTest-1961845034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f12e40c-a4b6-4178-8b8c-83ae3b08d579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:12:55 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-00dcbcfb-e504-407c-b771-a42056f3bb70 tempest-VolumeTypesAccessTest-1961845034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f12e40c-a4b6-4178-8b8c-83ae3b08d579) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'edd5f659-75bc-4803-b46b-f49108272a81', 'volume_name': 'volume-edd5f659-75bc-4803-b46b-f49108272a81', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:12:55 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-00dcbcfb-e504-407c-b771-a42056f3bb70 tempest-VolumeTypesAccessTest-1961845034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f51838e5-cbbb-4aab-a5a5-9d331fd3edb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:12:55 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-00dcbcfb-e504-407c-b771-a42056f3bb70 tempest-VolumeTypesAccessTest-1961845034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f51838e5-cbbb-4aab-a5a5-9d331fd3edb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:12:55 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-00dcbcfb-e504-407c-b771-a42056f3bb70 tempest-VolumeTypesAccessTest-1961845034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f039cb2-aba9-4a49-9d8a-8e0a69de8f65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:12:55 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-00dcbcfb-e504-407c-b771-a42056f3bb70 tempest-VolumeTypesAccessTest-1961845034 None] Volume edd5f659-75bc-4803-b46b-f49108272a81: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-edd5f659-75bc-4803-b46b-f49108272a81', 'volume_size': 1} Apr 16 15:12:55 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-00dcbcfb-e504-407c-b771-a42056f3bb70 tempest-VolumeTypesAccessTest-1961845034 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:12:55 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-00dcbcfb-e504-407c-b771-a42056f3bb70 tempest-VolumeTypesAccessTest-1961845034 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:12:55 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-00dcbcfb-e504-407c-b771-a42056f3bb70 tempest-VolumeTypesAccessTest-1961845034 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:12:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-971616362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edd5f659-75bc-4803-b46b-f49108272a81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23d9c962785c4b498e1252e7369742a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:12:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:12:55Z,use_quota=True,user_id='fde963fae5d44a5ab616a61ffee35d26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98a3057e-70f1-40c8-8b01-876e3dfaf679),volume_type_id=98a3057e-70f1-40c8-8b01-876e3dfaf679)}" {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 15:12:55 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-00dcbcfb-e504-407c-b771-a42056f3bb70 tempest-VolumeTypesAccessTest-1961845034 None] Creating volume edd5f659-75bc-4803-b46b-f49108272a81 {{(pid=82756) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 15:12:55 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-00dcbcfb-e504-407c-b771-a42056f3bb70 tempest-VolumeTypesAccessTest-1961845034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:12:55 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-00dcbcfb-e504-407c-b771-a42056f3bb70 tempest-VolumeTypesAccessTest-1961845034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:12:55 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-00dcbcfb-e504-407c-b771-a42056f3bb70 tempest-VolumeTypesAccessTest-1961845034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:12:55 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-00dcbcfb-e504-407c-b771-a42056f3bb70 tempest-VolumeTypesAccessTest-1961845034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:12:55 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-00dcbcfb-e504-407c-b771-a42056f3bb70 tempest-VolumeTypesAccessTest-1961845034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:12:55 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-00dcbcfb-e504-407c-b771-a42056f3bb70 tempest-VolumeTypesAccessTest-1961845034 None] Selected osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 as target Quobyte volume. {{(pid=82756) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 15:12:55 devstack cinder-volume[82756]: INFO cinder.volume.drivers.remotefs [None req-00dcbcfb-e504-407c-b771-a42056f3bb70 tempest-VolumeTypesAccessTest-1961845034 None] casted to osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 Apr 16 15:12:55 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-00dcbcfb-e504-407c-b771-a42056f3bb70 tempest-VolumeTypesAccessTest-1961845034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-edd5f659-75bc-4803-b46b-f49108272a81 1073741824 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:12:55 devstack sudo[89857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-edd5f659-75bc-4803-b46b-f49108272a81 1073741824 Apr 16 15:12:55 devstack sudo[89857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:12:56 devstack sudo[89857]: pam_unix(sudo:session): session closed for user root Apr 16 15:12:56 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-00dcbcfb-e504-407c-b771-a42056f3bb70 tempest-VolumeTypesAccessTest-1961845034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-edd5f659-75bc-4803-b46b-f49108272a81 1073741824" returned: 0 in 0.466s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:12:56 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-00dcbcfb-e504-407c-b771-a42056f3bb70 tempest-VolumeTypesAccessTest-1961845034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-edd5f659-75bc-4803-b46b-f49108272a81 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:12:56 devstack sudo[89862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-edd5f659-75bc-4803-b46b-f49108272a81 Apr 16 15:12:56 devstack sudo[89862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:12:56 devstack sudo[89862]: pam_unix(sudo:session): session closed for user root Apr 16 15:12:56 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-00dcbcfb-e504-407c-b771-a42056f3bb70 tempest-VolumeTypesAccessTest-1961845034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-edd5f659-75bc-4803-b46b-f49108272a81" returned: 0 in 0.399s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:12:56 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-00dcbcfb-e504-407c-b771-a42056f3bb70 tempest-VolumeTypesAccessTest-1961845034 None] <== create_volume: return (897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'} {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 15:12:56 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-00dcbcfb-e504-407c-b771-a42056f3bb70 tempest-VolumeTypesAccessTest-1961845034 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.900s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:12:56 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-00dcbcfb-e504-407c-b771-a42056f3bb70 tempest-VolumeTypesAccessTest-1961845034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f039cb2-aba9-4a49-9d8a-8e0a69de8f65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-edd5f659-75bc-4803-b46b-f49108272a81', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:12:56 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-00dcbcfb-e504-407c-b771-a42056f3bb70 tempest-VolumeTypesAccessTest-1961845034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ce27af0-8486-4a1d-99d9-68231497f9cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:12:56 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-00dcbcfb-e504-407c-b771-a42056f3bb70 tempest-VolumeTypesAccessTest-1961845034 None] Volume volume-edd5f659-75bc-4803-b46b-f49108272a81 (edd5f659-75bc-4803-b46b-f49108272a81): created successfully Apr 16 15:12:56 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-00dcbcfb-e504-407c-b771-a42056f3bb70 tempest-VolumeTypesAccessTest-1961845034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ce27af0-8486-4a1d-99d9-68231497f9cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:12:56 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-00dcbcfb-e504-407c-b771-a42056f3bb70 tempest-VolumeTypesAccessTest-1961845034 None] Flow 'volume_create_manager' (b177c64c-f31d-46ea-afa8-78611f395dca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:12:56 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-00dcbcfb-e504-407c-b771-a42056f3bb70 tempest-VolumeTypesAccessTest-1961845034 None] Created volume successfully. Apr 16 15:12:57 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-2534b2d3-5c63-4ef8-81d5-a19c8e34dd76 tempest-VolumeTypesAccessTest-1961845034 None] Acquiring lock "cinder-edd5f659-75bc-4803-b46b-f49108272a81-delete_volume" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:12:57 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-2534b2d3-5c63-4ef8-81d5-a19c8e34dd76 tempest-VolumeTypesAccessTest-1961845034 None] Lock "cinder-edd5f659-75bc-4803-b46b-f49108272a81-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:12:57 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-2534b2d3-5c63-4ef8-81d5-a19c8e34dd76 tempest-VolumeTypesAccessTest-1961845034 None] Acquiring lock "cinder-quobyte-edd5f659-75bc-4803-b46b-f49108272a81" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:12:57 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-2534b2d3-5c63-4ef8-81d5-a19c8e34dd76 tempest-VolumeTypesAccessTest-1961845034 None] Lock "cinder-quobyte-edd5f659-75bc-4803-b46b-f49108272a81" acquired by "delete_volume" :: waited 0.009s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:12:57 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[a891bfd2-4952-4a14-9b24-f886de6bf673]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:12:57 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-2534b2d3-5c63-4ef8-81d5-a19c8e34dd76 tempest-VolumeTypesAccessTest-1961845034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-edd5f659-75bc-4803-b46b-f49108272a81 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:12:57 devstack sudo[89865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-edd5f659-75bc-4803-b46b-f49108272a81 Apr 16 15:12:57 devstack sudo[89865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:12:58 devstack sudo[89865]: pam_unix(sudo:session): session closed for user root Apr 16 15:12:58 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-2534b2d3-5c63-4ef8-81d5-a19c8e34dd76 tempest-VolumeTypesAccessTest-1961845034 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-edd5f659-75bc-4803-b46b-f49108272a81" returned: 0 in 0.531s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:12:58 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-2534b2d3-5c63-4ef8-81d5-a19c8e34dd76 tempest-VolumeTypesAccessTest-1961845034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-edd5f659-75bc-4803-b46b-f49108272a81 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:12:58 devstack sudo[89870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-edd5f659-75bc-4803-b46b-f49108272a81 Apr 16 15:12:58 devstack sudo[89870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:12:58 devstack sudo[89870]: pam_unix(sudo:session): session closed for user root Apr 16 15:12:58 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-2534b2d3-5c63-4ef8-81d5-a19c8e34dd76 tempest-VolumeTypesAccessTest-1961845034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-edd5f659-75bc-4803-b46b-f49108272a81" returned: 0 in 0.466s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:12:58 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-2534b2d3-5c63-4ef8-81d5-a19c8e34dd76 tempest-VolumeTypesAccessTest-1961845034 None] Lock "cinder-quobyte-edd5f659-75bc-4803-b46b-f49108272a81" released by "delete_volume" :: held 1.025s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:12:58 devstack cinder-volume[82756]: WARNING cinder.quota [None req-2534b2d3-5c63-4ef8-81d5-a19c8e34dd76 tempest-VolumeTypesAccessTest-1961845034 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1814021063 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1814021063, it is now deprecated. Please use the default quota class for default quota. Apr 16 15:12:58 devstack cinder-volume[82756]: WARNING cinder.quota [None req-2534b2d3-5c63-4ef8-81d5-a19c8e34dd76 tempest-VolumeTypesAccessTest-1961845034 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1814021063 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1814021063, it is now deprecated. Please use the default quota class for default quota. Apr 16 15:12:58 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-2534b2d3-5c63-4ef8-81d5-a19c8e34dd76 tempest-VolumeTypesAccessTest-1961845034 None] Created reservations ['c6848e6f-9358-4f34-8df1-61cf78c97be5', '3b82002c-1fa6-42ab-bb21-c6dfd2644fb6', 'f8d0f3da-56be-4c47-a040-a1c516741962', 'a3f68f81-119e-4001-b65f-78c0b17a44c6'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:12:58 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-2534b2d3-5c63-4ef8-81d5-a19c8e34dd76 tempest-VolumeTypesAccessTest-1961845034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:12:58 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-2534b2d3-5c63-4ef8-81d5-a19c8e34dd76 tempest-VolumeTypesAccessTest-1961845034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:12:58 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-2534b2d3-5c63-4ef8-81d5-a19c8e34dd76 tempest-VolumeTypesAccessTest-1961845034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:12:58 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-2534b2d3-5c63-4ef8-81d5-a19c8e34dd76 tempest-VolumeTypesAccessTest-1961845034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:12:58 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-2534b2d3-5c63-4ef8-81d5-a19c8e34dd76 tempest-VolumeTypesAccessTest-1961845034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:12:58 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-2534b2d3-5c63-4ef8-81d5-a19c8e34dd76 tempest-VolumeTypesAccessTest-1961845034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:12:58 devstack sudo[89873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:12:58 devstack sudo[89873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:12:59 devstack sudo[89873]: pam_unix(sudo:session): session closed for user root Apr 16 15:12:59 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-2534b2d3-5c63-4ef8-81d5-a19c8e34dd76 tempest-VolumeTypesAccessTest-1961845034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.505s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:12:59 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-2534b2d3-5c63-4ef8-81d5-a19c8e34dd76 tempest-VolumeTypesAccessTest-1961845034 None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:12:59 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-2534b2d3-5c63-4ef8-81d5-a19c8e34dd76 tempest-VolumeTypesAccessTest-1961845034 None] Deleted volume successfully. Apr 16 15:12:59 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-2534b2d3-5c63-4ef8-81d5-a19c8e34dd76 tempest-VolumeTypesAccessTest-1961845034 None] Lock "cinder-edd5f659-75bc-4803-b46b-f49108272a81-delete_volume" released by "delete_volume" :: held 1.667s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:13:08 devstack cinder-volume[82756]: DEBUG dbcounter [-] [82756] Writing DB stats cinder:SELECT=88,cinder:INSERT=23,cinder:UPDATE=112,cinder:DELETE=7 {{(pid=82756) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 15:13:09 devstack cinder-volume[82756]: DEBUG dbcounter [-] [82756] Writing DB stats cinder:SELECT=76,cinder:UPDATE=85,cinder:DELETE=8,cinder:INSERT=26 {{(pid=82756) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 15:13:09 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [None req-71a3a26e-51e0-43ad-991e-bf10cd731e45 tempest-VolumesListAdminTestJSON-1182933838 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82756) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 15:13:09 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-71a3a26e-51e0-43ad-991e-bf10cd731e45 tempest-VolumesListAdminTestJSON-1182933838 None] Flow 'volume_create_manager' (e914b889-7d50-4912-b329-843221218fa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:13:09 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-71a3a26e-51e0-43ad-991e-bf10cd731e45 tempest-VolumesListAdminTestJSON-1182933838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (216ab520-0428-410b-9325-c7c388f052c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:13:09 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-71a3a26e-51e0-43ad-991e-bf10cd731e45 tempest-VolumesListAdminTestJSON-1182933838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (216ab520-0428-410b-9325-c7c388f052c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:13:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2115879829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e058d9a1-a27c-4356-af79-402c9713120e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a95abadd1de4d7a9ebdec16fa3e0ab0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:13:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:13:10Z,use_quota=True,user_id='e46d471755c843a6a92f38486fafedfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:13:09 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-71a3a26e-51e0-43ad-991e-bf10cd731e45 tempest-VolumesListAdminTestJSON-1182933838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac65efff-ff76-4ef2-9256-2356e5b2ea96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:13:09 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-71a3a26e-51e0-43ad-991e-bf10cd731e45 tempest-VolumesListAdminTestJSON-1182933838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac65efff-ff76-4ef2-9256-2356e5b2ea96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:13:09 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-71a3a26e-51e0-43ad-991e-bf10cd731e45 tempest-VolumesListAdminTestJSON-1182933838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5f0b0d1-10db-41b7-88ec-a12ada40cd19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:13:09 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-71a3a26e-51e0-43ad-991e-bf10cd731e45 tempest-VolumesListAdminTestJSON-1182933838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5f0b0d1-10db-41b7-88ec-a12ada40cd19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e058d9a1-a27c-4356-af79-402c9713120e', 'volume_name': 'volume-e058d9a1-a27c-4356-af79-402c9713120e', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:13:09 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-71a3a26e-51e0-43ad-991e-bf10cd731e45 tempest-VolumesListAdminTestJSON-1182933838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e69e5d2-bd10-4a4a-a4af-fbd4385bd186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:13:09 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-71a3a26e-51e0-43ad-991e-bf10cd731e45 tempest-VolumesListAdminTestJSON-1182933838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e69e5d2-bd10-4a4a-a4af-fbd4385bd186) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:13:09 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-71a3a26e-51e0-43ad-991e-bf10cd731e45 tempest-VolumesListAdminTestJSON-1182933838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1efa2cba-ba0a-45ed-b3f7-b95d30a2e0ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:13:09 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-71a3a26e-51e0-43ad-991e-bf10cd731e45 tempest-VolumesListAdminTestJSON-1182933838 None] Volume e058d9a1-a27c-4356-af79-402c9713120e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e058d9a1-a27c-4356-af79-402c9713120e', 'volume_size': 1} Apr 16 15:13:09 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-71a3a26e-51e0-43ad-991e-bf10cd731e45 tempest-VolumesListAdminTestJSON-1182933838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:13:09 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-71a3a26e-51e0-43ad-991e-bf10cd731e45 tempest-VolumesListAdminTestJSON-1182933838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:13:09 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-71a3a26e-51e0-43ad-991e-bf10cd731e45 tempest-VolumesListAdminTestJSON-1182933838 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:13:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2115879829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e058d9a1-a27c-4356-af79-402c9713120e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a95abadd1de4d7a9ebdec16fa3e0ab0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:13:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:13:10Z,use_quota=True,user_id='e46d471755c843a6a92f38486fafedfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)}" {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 15:13:09 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-71a3a26e-51e0-43ad-991e-bf10cd731e45 tempest-VolumesListAdminTestJSON-1182933838 None] Creating volume e058d9a1-a27c-4356-af79-402c9713120e {{(pid=82756) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 15:13:09 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-71a3a26e-51e0-43ad-991e-bf10cd731e45 tempest-VolumesListAdminTestJSON-1182933838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:13:09 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-71a3a26e-51e0-43ad-991e-bf10cd731e45 tempest-VolumesListAdminTestJSON-1182933838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:13:09 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-71a3a26e-51e0-43ad-991e-bf10cd731e45 tempest-VolumesListAdminTestJSON-1182933838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:13:09 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-71a3a26e-51e0-43ad-991e-bf10cd731e45 tempest-VolumesListAdminTestJSON-1182933838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:13:09 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-71a3a26e-51e0-43ad-991e-bf10cd731e45 tempest-VolumesListAdminTestJSON-1182933838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:13:09 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-71a3a26e-51e0-43ad-991e-bf10cd731e45 tempest-VolumesListAdminTestJSON-1182933838 None] Selected osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 as target Quobyte volume. {{(pid=82756) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 15:13:09 devstack cinder-volume[82756]: INFO cinder.volume.drivers.remotefs [None req-71a3a26e-51e0-43ad-991e-bf10cd731e45 tempest-VolumesListAdminTestJSON-1182933838 None] casted to osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 Apr 16 15:13:09 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-71a3a26e-51e0-43ad-991e-bf10cd731e45 tempest-VolumesListAdminTestJSON-1182933838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-e058d9a1-a27c-4356-af79-402c9713120e 1073741824 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:13:09 devstack sudo[89919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-e058d9a1-a27c-4356-af79-402c9713120e 1073741824 Apr 16 15:13:09 devstack sudo[89919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:13:10 devstack sudo[89919]: pam_unix(sudo:session): session closed for user root Apr 16 15:13:10 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-71a3a26e-51e0-43ad-991e-bf10cd731e45 tempest-VolumesListAdminTestJSON-1182933838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-e058d9a1-a27c-4356-af79-402c9713120e 1073741824" returned: 0 in 0.500s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:13:10 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-71a3a26e-51e0-43ad-991e-bf10cd731e45 tempest-VolumesListAdminTestJSON-1182933838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-e058d9a1-a27c-4356-af79-402c9713120e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:13:10 devstack sudo[89924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-e058d9a1-a27c-4356-af79-402c9713120e Apr 16 15:13:10 devstack sudo[89924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:13:10 devstack sudo[89924]: pam_unix(sudo:session): session closed for user root Apr 16 15:13:10 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-71a3a26e-51e0-43ad-991e-bf10cd731e45 tempest-VolumesListAdminTestJSON-1182933838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-e058d9a1-a27c-4356-af79-402c9713120e" returned: 0 in 0.425s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:13:10 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-71a3a26e-51e0-43ad-991e-bf10cd731e45 tempest-VolumesListAdminTestJSON-1182933838 None] <== create_volume: return (955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'} {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 15:13:10 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-71a3a26e-51e0-43ad-991e-bf10cd731e45 tempest-VolumesListAdminTestJSON-1182933838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:13:10 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-71a3a26e-51e0-43ad-991e-bf10cd731e45 tempest-VolumesListAdminTestJSON-1182933838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1efa2cba-ba0a-45ed-b3f7-b95d30a2e0ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e058d9a1-a27c-4356-af79-402c9713120e', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:13:10 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-71a3a26e-51e0-43ad-991e-bf10cd731e45 tempest-VolumesListAdminTestJSON-1182933838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (929fb011-2842-48d2-8a1c-8b9390e6331d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:13:10 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-71a3a26e-51e0-43ad-991e-bf10cd731e45 tempest-VolumesListAdminTestJSON-1182933838 None] Volume volume-e058d9a1-a27c-4356-af79-402c9713120e (e058d9a1-a27c-4356-af79-402c9713120e): created successfully Apr 16 15:13:10 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-71a3a26e-51e0-43ad-991e-bf10cd731e45 tempest-VolumesListAdminTestJSON-1182933838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (929fb011-2842-48d2-8a1c-8b9390e6331d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:13:10 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-71a3a26e-51e0-43ad-991e-bf10cd731e45 tempest-VolumesListAdminTestJSON-1182933838 None] Flow 'volume_create_manager' (e914b889-7d50-4912-b329-843221218fa6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:13:10 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-71a3a26e-51e0-43ad-991e-bf10cd731e45 tempest-VolumesListAdminTestJSON-1182933838 None] Created volume successfully. Apr 16 15:13:12 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [None req-05318f16-fbe7-4fa1-bb11-48a631c068fe tempest-VolumesListAdminTestJSON-1182933838 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82756) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 15:13:12 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-05318f16-fbe7-4fa1-bb11-48a631c068fe tempest-VolumesListAdminTestJSON-1182933838 None] Flow 'volume_create_manager' (c2f009d1-d53d-4543-82c3-82a110f03250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:13:12 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-05318f16-fbe7-4fa1-bb11-48a631c068fe tempest-VolumesListAdminTestJSON-1182933838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36c22c98-2743-4914-ac01-f825388ad7ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:13:12 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-05318f16-fbe7-4fa1-bb11-48a631c068fe tempest-VolumesListAdminTestJSON-1182933838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36c22c98-2743-4914-ac01-f825388ad7ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:13:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1197058199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7011a824-10fc-4a75-a6eb-5cf3adb22475,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a95abadd1de4d7a9ebdec16fa3e0ab0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:13:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:13:12Z,use_quota=True,user_id='e46d471755c843a6a92f38486fafedfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:13:12 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-05318f16-fbe7-4fa1-bb11-48a631c068fe tempest-VolumesListAdminTestJSON-1182933838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1e09850-6485-4e92-9c37-ac53b8ca8981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:13:12 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-05318f16-fbe7-4fa1-bb11-48a631c068fe tempest-VolumesListAdminTestJSON-1182933838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1e09850-6485-4e92-9c37-ac53b8ca8981) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:13:12 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-05318f16-fbe7-4fa1-bb11-48a631c068fe tempest-VolumesListAdminTestJSON-1182933838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a00abce-e766-46af-bafd-883537677833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:13:12 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-05318f16-fbe7-4fa1-bb11-48a631c068fe tempest-VolumesListAdminTestJSON-1182933838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a00abce-e766-46af-bafd-883537677833) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7011a824-10fc-4a75-a6eb-5cf3adb22475', 'volume_name': 'volume-7011a824-10fc-4a75-a6eb-5cf3adb22475', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:13:12 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-05318f16-fbe7-4fa1-bb11-48a631c068fe tempest-VolumesListAdminTestJSON-1182933838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e082085f-36f6-4ad7-843c-3afa44c13125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:13:12 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-05318f16-fbe7-4fa1-bb11-48a631c068fe tempest-VolumesListAdminTestJSON-1182933838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e082085f-36f6-4ad7-843c-3afa44c13125) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:13:12 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-05318f16-fbe7-4fa1-bb11-48a631c068fe tempest-VolumesListAdminTestJSON-1182933838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1aac841-2b2d-4ea8-8a54-7342fc915a39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:13:12 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-05318f16-fbe7-4fa1-bb11-48a631c068fe tempest-VolumesListAdminTestJSON-1182933838 None] Volume 7011a824-10fc-4a75-a6eb-5cf3adb22475: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7011a824-10fc-4a75-a6eb-5cf3adb22475', 'volume_size': 1} Apr 16 15:13:12 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-05318f16-fbe7-4fa1-bb11-48a631c068fe tempest-VolumesListAdminTestJSON-1182933838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:13:12 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-05318f16-fbe7-4fa1-bb11-48a631c068fe tempest-VolumesListAdminTestJSON-1182933838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:13:12 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-05318f16-fbe7-4fa1-bb11-48a631c068fe tempest-VolumesListAdminTestJSON-1182933838 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:13:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1197058199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7011a824-10fc-4a75-a6eb-5cf3adb22475,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a95abadd1de4d7a9ebdec16fa3e0ab0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:13:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:13:12Z,use_quota=True,user_id='e46d471755c843a6a92f38486fafedfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)}" {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 15:13:12 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-05318f16-fbe7-4fa1-bb11-48a631c068fe tempest-VolumesListAdminTestJSON-1182933838 None] Creating volume 7011a824-10fc-4a75-a6eb-5cf3adb22475 {{(pid=82756) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 15:13:12 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-05318f16-fbe7-4fa1-bb11-48a631c068fe tempest-VolumesListAdminTestJSON-1182933838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:13:12 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-05318f16-fbe7-4fa1-bb11-48a631c068fe tempest-VolumesListAdminTestJSON-1182933838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:13:12 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-05318f16-fbe7-4fa1-bb11-48a631c068fe tempest-VolumesListAdminTestJSON-1182933838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:13:12 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-05318f16-fbe7-4fa1-bb11-48a631c068fe tempest-VolumesListAdminTestJSON-1182933838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:13:12 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-05318f16-fbe7-4fa1-bb11-48a631c068fe tempest-VolumesListAdminTestJSON-1182933838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:13:12 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-05318f16-fbe7-4fa1-bb11-48a631c068fe tempest-VolumesListAdminTestJSON-1182933838 None] Selected osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 as target Quobyte volume. {{(pid=82756) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 15:13:12 devstack cinder-volume[82756]: INFO cinder.volume.drivers.remotefs [None req-05318f16-fbe7-4fa1-bb11-48a631c068fe tempest-VolumesListAdminTestJSON-1182933838 None] casted to osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 Apr 16 15:13:12 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-05318f16-fbe7-4fa1-bb11-48a631c068fe tempest-VolumesListAdminTestJSON-1182933838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-7011a824-10fc-4a75-a6eb-5cf3adb22475 1073741824 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:13:12 devstack sudo[89927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-7011a824-10fc-4a75-a6eb-5cf3adb22475 1073741824 Apr 16 15:13:12 devstack sudo[89927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:13:12 devstack sudo[89927]: pam_unix(sudo:session): session closed for user root Apr 16 15:13:12 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-05318f16-fbe7-4fa1-bb11-48a631c068fe tempest-VolumesListAdminTestJSON-1182933838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-7011a824-10fc-4a75-a6eb-5cf3adb22475 1073741824" returned: 0 in 0.489s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:13:12 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-05318f16-fbe7-4fa1-bb11-48a631c068fe tempest-VolumesListAdminTestJSON-1182933838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-7011a824-10fc-4a75-a6eb-5cf3adb22475 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:13:12 devstack sudo[89932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-7011a824-10fc-4a75-a6eb-5cf3adb22475 Apr 16 15:13:12 devstack sudo[89932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:13:13 devstack sudo[89932]: pam_unix(sudo:session): session closed for user root Apr 16 15:13:13 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-05318f16-fbe7-4fa1-bb11-48a631c068fe tempest-VolumesListAdminTestJSON-1182933838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-7011a824-10fc-4a75-a6eb-5cf3adb22475" returned: 0 in 0.429s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:13:13 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-05318f16-fbe7-4fa1-bb11-48a631c068fe tempest-VolumesListAdminTestJSON-1182933838 None] <== create_volume: return (947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'} {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 15:13:13 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-05318f16-fbe7-4fa1-bb11-48a631c068fe tempest-VolumesListAdminTestJSON-1182933838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.950s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:13:13 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-05318f16-fbe7-4fa1-bb11-48a631c068fe tempest-VolumesListAdminTestJSON-1182933838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1aac841-2b2d-4ea8-8a54-7342fc915a39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7011a824-10fc-4a75-a6eb-5cf3adb22475', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:13:13 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-05318f16-fbe7-4fa1-bb11-48a631c068fe tempest-VolumesListAdminTestJSON-1182933838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42ff2749-5af8-4592-b29d-8d121546eb9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:13:13 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-05318f16-fbe7-4fa1-bb11-48a631c068fe tempest-VolumesListAdminTestJSON-1182933838 None] Volume volume-7011a824-10fc-4a75-a6eb-5cf3adb22475 (7011a824-10fc-4a75-a6eb-5cf3adb22475): created successfully Apr 16 15:13:13 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-05318f16-fbe7-4fa1-bb11-48a631c068fe tempest-VolumesListAdminTestJSON-1182933838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42ff2749-5af8-4592-b29d-8d121546eb9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:13:13 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-05318f16-fbe7-4fa1-bb11-48a631c068fe tempest-VolumesListAdminTestJSON-1182933838 None] Flow 'volume_create_manager' (c2f009d1-d53d-4543-82c3-82a110f03250) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:13:13 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-05318f16-fbe7-4fa1-bb11-48a631c068fe tempest-VolumesListAdminTestJSON-1182933838 None] Created volume successfully. Apr 16 15:13:14 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [None req-53953b4b-9a6e-480b-b98b-0f6158b4f21a tempest-VolumesListAdminTestJSON-1182933838 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82756) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 15:13:14 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-53953b4b-9a6e-480b-b98b-0f6158b4f21a tempest-VolumesListAdminTestJSON-1182933838 None] Flow 'volume_create_manager' (e4206625-3e99-430f-89cb-bad9c99dc688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:13:14 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-53953b4b-9a6e-480b-b98b-0f6158b4f21a tempest-VolumesListAdminTestJSON-1182933838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d19fd244-232b-405e-bfca-81540fed9bc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:13:14 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-53953b4b-9a6e-480b-b98b-0f6158b4f21a tempest-VolumesListAdminTestJSON-1182933838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d19fd244-232b-405e-bfca-81540fed9bc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:13:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1558394278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=731d8ddf-320c-4089-b6b5-5df4cb63e5ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a95abadd1de4d7a9ebdec16fa3e0ab0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:13:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:13:15Z,use_quota=True,user_id='e46d471755c843a6a92f38486fafedfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:13:14 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-53953b4b-9a6e-480b-b98b-0f6158b4f21a tempest-VolumesListAdminTestJSON-1182933838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c689657-762e-4ac3-bca7-9a24929f5f37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:13:14 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-53953b4b-9a6e-480b-b98b-0f6158b4f21a tempest-VolumesListAdminTestJSON-1182933838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c689657-762e-4ac3-bca7-9a24929f5f37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:13:14 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-53953b4b-9a6e-480b-b98b-0f6158b4f21a tempest-VolumesListAdminTestJSON-1182933838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc033dca-7042-4d56-af2e-4745cf87dbc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:13:14 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-53953b4b-9a6e-480b-b98b-0f6158b4f21a tempest-VolumesListAdminTestJSON-1182933838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc033dca-7042-4d56-af2e-4745cf87dbc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '731d8ddf-320c-4089-b6b5-5df4cb63e5ca', 'volume_name': 'volume-731d8ddf-320c-4089-b6b5-5df4cb63e5ca', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:13:14 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-53953b4b-9a6e-480b-b98b-0f6158b4f21a tempest-VolumesListAdminTestJSON-1182933838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5765b990-247d-4473-b8c9-9402593c618a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:13:14 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-53953b4b-9a6e-480b-b98b-0f6158b4f21a tempest-VolumesListAdminTestJSON-1182933838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5765b990-247d-4473-b8c9-9402593c618a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:13:14 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-53953b4b-9a6e-480b-b98b-0f6158b4f21a tempest-VolumesListAdminTestJSON-1182933838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9877a3e1-528f-4e03-a472-012a4866e68f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:13:14 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-53953b4b-9a6e-480b-b98b-0f6158b4f21a tempest-VolumesListAdminTestJSON-1182933838 None] Volume 731d8ddf-320c-4089-b6b5-5df4cb63e5ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-731d8ddf-320c-4089-b6b5-5df4cb63e5ca', 'volume_size': 1} Apr 16 15:13:14 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-53953b4b-9a6e-480b-b98b-0f6158b4f21a tempest-VolumesListAdminTestJSON-1182933838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:13:14 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-53953b4b-9a6e-480b-b98b-0f6158b4f21a tempest-VolumesListAdminTestJSON-1182933838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:13:14 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-53953b4b-9a6e-480b-b98b-0f6158b4f21a tempest-VolumesListAdminTestJSON-1182933838 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:13:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1558394278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=731d8ddf-320c-4089-b6b5-5df4cb63e5ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a95abadd1de4d7a9ebdec16fa3e0ab0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:13:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:13:15Z,use_quota=True,user_id='e46d471755c843a6a92f38486fafedfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)}" {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 15:13:14 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-53953b4b-9a6e-480b-b98b-0f6158b4f21a tempest-VolumesListAdminTestJSON-1182933838 None] Creating volume 731d8ddf-320c-4089-b6b5-5df4cb63e5ca {{(pid=82756) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 15:13:14 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-53953b4b-9a6e-480b-b98b-0f6158b4f21a tempest-VolumesListAdminTestJSON-1182933838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:13:14 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-53953b4b-9a6e-480b-b98b-0f6158b4f21a tempest-VolumesListAdminTestJSON-1182933838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:13:14 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-53953b4b-9a6e-480b-b98b-0f6158b4f21a tempest-VolumesListAdminTestJSON-1182933838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:13:14 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-53953b4b-9a6e-480b-b98b-0f6158b4f21a tempest-VolumesListAdminTestJSON-1182933838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:13:14 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-53953b4b-9a6e-480b-b98b-0f6158b4f21a tempest-VolumesListAdminTestJSON-1182933838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:13:14 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-53953b4b-9a6e-480b-b98b-0f6158b4f21a tempest-VolumesListAdminTestJSON-1182933838 None] Selected osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 as target Quobyte volume. {{(pid=82756) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 15:13:14 devstack cinder-volume[82756]: INFO cinder.volume.drivers.remotefs [None req-53953b4b-9a6e-480b-b98b-0f6158b4f21a tempest-VolumesListAdminTestJSON-1182933838 None] casted to osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 Apr 16 15:13:14 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-53953b4b-9a6e-480b-b98b-0f6158b4f21a tempest-VolumesListAdminTestJSON-1182933838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-731d8ddf-320c-4089-b6b5-5df4cb63e5ca 1073741824 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:13:14 devstack sudo[89936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-731d8ddf-320c-4089-b6b5-5df4cb63e5ca 1073741824 Apr 16 15:13:14 devstack sudo[89936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:13:15 devstack sudo[89936]: pam_unix(sudo:session): session closed for user root Apr 16 15:13:15 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-53953b4b-9a6e-480b-b98b-0f6158b4f21a tempest-VolumesListAdminTestJSON-1182933838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-731d8ddf-320c-4089-b6b5-5df4cb63e5ca 1073741824" returned: 0 in 0.533s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:13:15 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-53953b4b-9a6e-480b-b98b-0f6158b4f21a tempest-VolumesListAdminTestJSON-1182933838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-731d8ddf-320c-4089-b6b5-5df4cb63e5ca {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:13:15 devstack sudo[89941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-731d8ddf-320c-4089-b6b5-5df4cb63e5ca Apr 16 15:13:15 devstack sudo[89941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:13:15 devstack sudo[89941]: pam_unix(sudo:session): session closed for user root Apr 16 15:13:15 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-53953b4b-9a6e-480b-b98b-0f6158b4f21a tempest-VolumesListAdminTestJSON-1182933838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-731d8ddf-320c-4089-b6b5-5df4cb63e5ca" returned: 0 in 0.489s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:13:15 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-53953b4b-9a6e-480b-b98b-0f6158b4f21a tempest-VolumesListAdminTestJSON-1182933838 None] <== create_volume: return (1235ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'} {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 15:13:15 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-53953b4b-9a6e-480b-b98b-0f6158b4f21a tempest-VolumesListAdminTestJSON-1182933838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.241s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:13:15 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-53953b4b-9a6e-480b-b98b-0f6158b4f21a tempest-VolumesListAdminTestJSON-1182933838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9877a3e1-528f-4e03-a472-012a4866e68f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-731d8ddf-320c-4089-b6b5-5df4cb63e5ca', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:13:15 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-53953b4b-9a6e-480b-b98b-0f6158b4f21a tempest-VolumesListAdminTestJSON-1182933838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41f4247d-5c54-49ad-8a41-1bf7b6ee3bae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:13:15 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-53953b4b-9a6e-480b-b98b-0f6158b4f21a tempest-VolumesListAdminTestJSON-1182933838 None] Volume volume-731d8ddf-320c-4089-b6b5-5df4cb63e5ca (731d8ddf-320c-4089-b6b5-5df4cb63e5ca): created successfully Apr 16 15:13:15 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-53953b4b-9a6e-480b-b98b-0f6158b4f21a tempest-VolumesListAdminTestJSON-1182933838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41f4247d-5c54-49ad-8a41-1bf7b6ee3bae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:13:15 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-53953b4b-9a6e-480b-b98b-0f6158b4f21a tempest-VolumesListAdminTestJSON-1182933838 None] Flow 'volume_create_manager' (e4206625-3e99-430f-89cb-bad9c99dc688) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:13:15 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-53953b4b-9a6e-480b-b98b-0f6158b4f21a tempest-VolumesListAdminTestJSON-1182933838 None] Created volume successfully. Apr 16 15:13:16 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [None req-353ed399-73f7-41b0-bfff-7c2312fc7b77 tempest-VolumesListAdminTestJSON-2087561432 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82756) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 15:13:17 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-353ed399-73f7-41b0-bfff-7c2312fc7b77 tempest-VolumesListAdminTestJSON-2087561432 None] Flow 'volume_create_manager' (203c8754-888f-4792-9290-4451db740693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:13:17 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-353ed399-73f7-41b0-bfff-7c2312fc7b77 tempest-VolumesListAdminTestJSON-2087561432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c0b0d97-7de1-49cb-853d-9878be4d4277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:13:17 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-353ed399-73f7-41b0-bfff-7c2312fc7b77 tempest-VolumesListAdminTestJSON-2087561432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c0b0d97-7de1-49cb-853d-9878be4d4277) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:13:17Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9064187a-8e9b-49bb-9f89-3b2a1bb52e01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e09ff0cb4e143a7be33d17e6b6f5040',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:13:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:13:17Z,use_quota=True,user_id='6bbd9081c3314812b54d42c914b6547c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:13:17 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-353ed399-73f7-41b0-bfff-7c2312fc7b77 tempest-VolumesListAdminTestJSON-2087561432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b59e4717-fe74-4e09-bd4a-15787331ea18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:13:17 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-353ed399-73f7-41b0-bfff-7c2312fc7b77 tempest-VolumesListAdminTestJSON-2087561432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b59e4717-fe74-4e09-bd4a-15787331ea18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:13:17 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-353ed399-73f7-41b0-bfff-7c2312fc7b77 tempest-VolumesListAdminTestJSON-2087561432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c272922-203b-40d3-b3c8-a5d19ec8f6de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:13:17 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-353ed399-73f7-41b0-bfff-7c2312fc7b77 tempest-VolumesListAdminTestJSON-2087561432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c272922-203b-40d3-b3c8-a5d19ec8f6de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9064187a-8e9b-49bb-9f89-3b2a1bb52e01', 'volume_name': 'volume-9064187a-8e9b-49bb-9f89-3b2a1bb52e01', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:13:17 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-353ed399-73f7-41b0-bfff-7c2312fc7b77 tempest-VolumesListAdminTestJSON-2087561432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6f1a554-106b-4de8-9fa4-6325718513e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:13:17 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-353ed399-73f7-41b0-bfff-7c2312fc7b77 tempest-VolumesListAdminTestJSON-2087561432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6f1a554-106b-4de8-9fa4-6325718513e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:13:17 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-353ed399-73f7-41b0-bfff-7c2312fc7b77 tempest-VolumesListAdminTestJSON-2087561432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (703a15c2-2842-4fea-b714-92c8e8aa7899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:13:17 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-353ed399-73f7-41b0-bfff-7c2312fc7b77 tempest-VolumesListAdminTestJSON-2087561432 None] Volume 9064187a-8e9b-49bb-9f89-3b2a1bb52e01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9064187a-8e9b-49bb-9f89-3b2a1bb52e01', 'volume_size': 1} Apr 16 15:13:17 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-353ed399-73f7-41b0-bfff-7c2312fc7b77 tempest-VolumesListAdminTestJSON-2087561432 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:13:17 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-353ed399-73f7-41b0-bfff-7c2312fc7b77 tempest-VolumesListAdminTestJSON-2087561432 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:13:17 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-353ed399-73f7-41b0-bfff-7c2312fc7b77 tempest-VolumesListAdminTestJSON-2087561432 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:13:17Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9064187a-8e9b-49bb-9f89-3b2a1bb52e01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e09ff0cb4e143a7be33d17e6b6f5040',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:13:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:13:17Z,use_quota=True,user_id='6bbd9081c3314812b54d42c914b6547c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)}" {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 15:13:17 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-353ed399-73f7-41b0-bfff-7c2312fc7b77 tempest-VolumesListAdminTestJSON-2087561432 None] Creating volume 9064187a-8e9b-49bb-9f89-3b2a1bb52e01 {{(pid=82756) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 15:13:17 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-353ed399-73f7-41b0-bfff-7c2312fc7b77 tempest-VolumesListAdminTestJSON-2087561432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:13:17 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-353ed399-73f7-41b0-bfff-7c2312fc7b77 tempest-VolumesListAdminTestJSON-2087561432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:13:17 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-353ed399-73f7-41b0-bfff-7c2312fc7b77 tempest-VolumesListAdminTestJSON-2087561432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:13:17 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-353ed399-73f7-41b0-bfff-7c2312fc7b77 tempest-VolumesListAdminTestJSON-2087561432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:13:17 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-353ed399-73f7-41b0-bfff-7c2312fc7b77 tempest-VolumesListAdminTestJSON-2087561432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:13:17 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-353ed399-73f7-41b0-bfff-7c2312fc7b77 tempest-VolumesListAdminTestJSON-2087561432 None] Selected osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 as target Quobyte volume. {{(pid=82756) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 15:13:17 devstack cinder-volume[82756]: INFO cinder.volume.drivers.remotefs [None req-353ed399-73f7-41b0-bfff-7c2312fc7b77 tempest-VolumesListAdminTestJSON-2087561432 None] casted to osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 Apr 16 15:13:17 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-353ed399-73f7-41b0-bfff-7c2312fc7b77 tempest-VolumesListAdminTestJSON-2087561432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-9064187a-8e9b-49bb-9f89-3b2a1bb52e01 1073741824 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:13:17 devstack sudo[89944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-9064187a-8e9b-49bb-9f89-3b2a1bb52e01 1073741824 Apr 16 15:13:17 devstack sudo[89944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:13:17 devstack sudo[89944]: pam_unix(sudo:session): session closed for user root Apr 16 15:13:17 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-353ed399-73f7-41b0-bfff-7c2312fc7b77 tempest-VolumesListAdminTestJSON-2087561432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-9064187a-8e9b-49bb-9f89-3b2a1bb52e01 1073741824" returned: 0 in 0.465s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:13:17 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-353ed399-73f7-41b0-bfff-7c2312fc7b77 tempest-VolumesListAdminTestJSON-2087561432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-9064187a-8e9b-49bb-9f89-3b2a1bb52e01 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:13:17 devstack sudo[89949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-9064187a-8e9b-49bb-9f89-3b2a1bb52e01 Apr 16 15:13:17 devstack sudo[89949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:13:17 devstack sudo[89949]: pam_unix(sudo:session): session closed for user root Apr 16 15:13:17 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-353ed399-73f7-41b0-bfff-7c2312fc7b77 tempest-VolumesListAdminTestJSON-2087561432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-9064187a-8e9b-49bb-9f89-3b2a1bb52e01" returned: 0 in 0.408s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:13:17 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-353ed399-73f7-41b0-bfff-7c2312fc7b77 tempest-VolumesListAdminTestJSON-2087561432 None] <== create_volume: return (898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'} {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 15:13:17 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-353ed399-73f7-41b0-bfff-7c2312fc7b77 tempest-VolumesListAdminTestJSON-2087561432 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:13:17 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-353ed399-73f7-41b0-bfff-7c2312fc7b77 tempest-VolumesListAdminTestJSON-2087561432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (703a15c2-2842-4fea-b714-92c8e8aa7899) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9064187a-8e9b-49bb-9f89-3b2a1bb52e01', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:13:17 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-353ed399-73f7-41b0-bfff-7c2312fc7b77 tempest-VolumesListAdminTestJSON-2087561432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6a411fe-b265-4343-8652-43942c36a6f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:13:17 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-353ed399-73f7-41b0-bfff-7c2312fc7b77 tempest-VolumesListAdminTestJSON-2087561432 None] Volume volume-9064187a-8e9b-49bb-9f89-3b2a1bb52e01 (9064187a-8e9b-49bb-9f89-3b2a1bb52e01): created successfully Apr 16 15:13:17 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-353ed399-73f7-41b0-bfff-7c2312fc7b77 tempest-VolumesListAdminTestJSON-2087561432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6a411fe-b265-4343-8652-43942c36a6f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:13:17 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-353ed399-73f7-41b0-bfff-7c2312fc7b77 tempest-VolumesListAdminTestJSON-2087561432 None] Flow 'volume_create_manager' (203c8754-888f-4792-9290-4451db740693) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:13:17 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-353ed399-73f7-41b0-bfff-7c2312fc7b77 tempest-VolumesListAdminTestJSON-2087561432 None] Created volume successfully. Apr 16 15:13:18 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-8a151948-49a2-4fa4-923e-80b9cb406834 tempest-VolumesListAdminTestJSON-2087561432 None] Acquiring lock "cinder-9064187a-8e9b-49bb-9f89-3b2a1bb52e01-delete_volume" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:13:18 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-8a151948-49a2-4fa4-923e-80b9cb406834 tempest-VolumesListAdminTestJSON-2087561432 None] Lock "cinder-9064187a-8e9b-49bb-9f89-3b2a1bb52e01-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:13:18 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-8a151948-49a2-4fa4-923e-80b9cb406834 tempest-VolumesListAdminTestJSON-2087561432 None] Acquiring lock "cinder-quobyte-9064187a-8e9b-49bb-9f89-3b2a1bb52e01" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:13:18 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-8a151948-49a2-4fa4-923e-80b9cb406834 tempest-VolumesListAdminTestJSON-2087561432 None] Lock "cinder-quobyte-9064187a-8e9b-49bb-9f89-3b2a1bb52e01" acquired by "delete_volume" :: waited 0.011s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:13:18 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9d10899-55ce-4ccf-9ac7-72ba02f4d23b]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:13:18 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-8a151948-49a2-4fa4-923e-80b9cb406834 tempest-VolumesListAdminTestJSON-2087561432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-9064187a-8e9b-49bb-9f89-3b2a1bb52e01 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:13:18 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-df01dfa9-da75-4767-a608-0b21bfcf586d tempest-VolumesListAdminTestJSON-1182933838 None] Acquiring lock "cinder-731d8ddf-320c-4089-b6b5-5df4cb63e5ca-delete_volume" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:13:18 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-df01dfa9-da75-4767-a608-0b21bfcf586d tempest-VolumesListAdminTestJSON-1182933838 None] Lock "cinder-731d8ddf-320c-4089-b6b5-5df4cb63e5ca-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:13:18 devstack sudo[89952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-9064187a-8e9b-49bb-9f89-3b2a1bb52e01 Apr 16 15:13:18 devstack sudo[89952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:13:18 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-df01dfa9-da75-4767-a608-0b21bfcf586d tempest-VolumesListAdminTestJSON-1182933838 None] Acquiring lock "cinder-quobyte-731d8ddf-320c-4089-b6b5-5df4cb63e5ca" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:13:18 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-df01dfa9-da75-4767-a608-0b21bfcf586d tempest-VolumesListAdminTestJSON-1182933838 None] Lock "cinder-quobyte-731d8ddf-320c-4089-b6b5-5df4cb63e5ca" acquired by "delete_volume" :: waited 0.015s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:13:18 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bc7d9e1-a06b-4be1-80d2-338bef61a104]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:13:18 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-df01dfa9-da75-4767-a608-0b21bfcf586d tempest-VolumesListAdminTestJSON-1182933838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-731d8ddf-320c-4089-b6b5-5df4cb63e5ca {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:13:18 devstack sudo[89954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-731d8ddf-320c-4089-b6b5-5df4cb63e5ca Apr 16 15:13:18 devstack sudo[89954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:13:18 devstack sudo[89952]: pam_unix(sudo:session): session closed for user root Apr 16 15:13:18 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-8a151948-49a2-4fa4-923e-80b9cb406834 tempest-VolumesListAdminTestJSON-2087561432 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-9064187a-8e9b-49bb-9f89-3b2a1bb52e01" returned: 0 in 0.500s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:13:18 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-8a151948-49a2-4fa4-923e-80b9cb406834 tempest-VolumesListAdminTestJSON-2087561432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-9064187a-8e9b-49bb-9f89-3b2a1bb52e01 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:13:18 devstack sudo[89960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-9064187a-8e9b-49bb-9f89-3b2a1bb52e01 Apr 16 15:13:18 devstack sudo[89960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:13:18 devstack sudo[89954]: pam_unix(sudo:session): session closed for user root Apr 16 15:13:18 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-df01dfa9-da75-4767-a608-0b21bfcf586d tempest-VolumesListAdminTestJSON-1182933838 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-731d8ddf-320c-4089-b6b5-5df4cb63e5ca" returned: 0 in 0.503s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:13:18 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-df01dfa9-da75-4767-a608-0b21bfcf586d tempest-VolumesListAdminTestJSON-1182933838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-731d8ddf-320c-4089-b6b5-5df4cb63e5ca {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:13:18 devstack sudo[89964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-731d8ddf-320c-4089-b6b5-5df4cb63e5ca Apr 16 15:13:18 devstack sudo[89964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:13:19 devstack sudo[89960]: pam_unix(sudo:session): session closed for user root Apr 16 15:13:19 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-8a151948-49a2-4fa4-923e-80b9cb406834 tempest-VolumesListAdminTestJSON-2087561432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-9064187a-8e9b-49bb-9f89-3b2a1bb52e01" returned: 0 in 0.427s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:13:19 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-8a151948-49a2-4fa4-923e-80b9cb406834 tempest-VolumesListAdminTestJSON-2087561432 None] Lock "cinder-quobyte-9064187a-8e9b-49bb-9f89-3b2a1bb52e01" released by "delete_volume" :: held 0.963s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:13:19 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-8a151948-49a2-4fa4-923e-80b9cb406834 tempest-VolumesListAdminTestJSON-2087561432 None] Created reservations ['0b6626eb-bd92-4b0d-9395-56c1d8059942', '08042b9e-297b-4b3f-9687-9a36b8d74484', '84138141-d058-481b-9385-b715f35f021d', 'da628a11-806a-4166-a2c6-294a6a07d5f8'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:13:19 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-8a151948-49a2-4fa4-923e-80b9cb406834 tempest-VolumesListAdminTestJSON-2087561432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:13:19 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-8a151948-49a2-4fa4-923e-80b9cb406834 tempest-VolumesListAdminTestJSON-2087561432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:13:19 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-8a151948-49a2-4fa4-923e-80b9cb406834 tempest-VolumesListAdminTestJSON-2087561432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:13:19 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-8a151948-49a2-4fa4-923e-80b9cb406834 tempest-VolumesListAdminTestJSON-2087561432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:13:19 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-8a151948-49a2-4fa4-923e-80b9cb406834 tempest-VolumesListAdminTestJSON-2087561432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:13:19 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-8a151948-49a2-4fa4-923e-80b9cb406834 tempest-VolumesListAdminTestJSON-2087561432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:13:19 devstack sudo[89968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:13:19 devstack sudo[89968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:13:19 devstack sudo[89964]: pam_unix(sudo:session): session closed for user root Apr 16 15:13:19 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-df01dfa9-da75-4767-a608-0b21bfcf586d tempest-VolumesListAdminTestJSON-1182933838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-731d8ddf-320c-4089-b6b5-5df4cb63e5ca" returned: 0 in 0.425s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:13:19 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-df01dfa9-da75-4767-a608-0b21bfcf586d tempest-VolumesListAdminTestJSON-1182933838 None] Lock "cinder-quobyte-731d8ddf-320c-4089-b6b5-5df4cb63e5ca" released by "delete_volume" :: held 0.951s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:13:19 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-df01dfa9-da75-4767-a608-0b21bfcf586d tempest-VolumesListAdminTestJSON-1182933838 None] Created reservations ['b03ce4fd-472d-401d-b232-6aa313ee8d74', '8a00c56c-4e66-453e-803b-0c65e598816f', 'a762c653-7726-4d6a-9499-99a183a1abed', '83b559fd-1734-43b2-a63d-4df07eb8366e'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:13:19 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-df01dfa9-da75-4767-a608-0b21bfcf586d tempest-VolumesListAdminTestJSON-1182933838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:13:19 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-df01dfa9-da75-4767-a608-0b21bfcf586d tempest-VolumesListAdminTestJSON-1182933838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:13:19 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-df01dfa9-da75-4767-a608-0b21bfcf586d tempest-VolumesListAdminTestJSON-1182933838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:13:19 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-df01dfa9-da75-4767-a608-0b21bfcf586d tempest-VolumesListAdminTestJSON-1182933838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:13:19 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-df01dfa9-da75-4767-a608-0b21bfcf586d tempest-VolumesListAdminTestJSON-1182933838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:13:19 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-df01dfa9-da75-4767-a608-0b21bfcf586d tempest-VolumesListAdminTestJSON-1182933838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:13:19 devstack sudo[89970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:13:19 devstack sudo[89970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:13:19 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-3391b62d-acc3-47d7-8ba3-23d1c0cb5bdd tempest-VolumesListAdminTestJSON-1182933838 None] Acquiring lock "cinder-7011a824-10fc-4a75-a6eb-5cf3adb22475-delete_volume" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:13:19 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-3391b62d-acc3-47d7-8ba3-23d1c0cb5bdd tempest-VolumesListAdminTestJSON-1182933838 None] Lock "cinder-7011a824-10fc-4a75-a6eb-5cf3adb22475-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:13:19 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-3391b62d-acc3-47d7-8ba3-23d1c0cb5bdd tempest-VolumesListAdminTestJSON-1182933838 None] Acquiring lock "cinder-quobyte-7011a824-10fc-4a75-a6eb-5cf3adb22475" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:13:19 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-3391b62d-acc3-47d7-8ba3-23d1c0cb5bdd tempest-VolumesListAdminTestJSON-1182933838 None] Lock "cinder-quobyte-7011a824-10fc-4a75-a6eb-5cf3adb22475" acquired by "delete_volume" :: waited 0.009s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:13:19 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[04d17e70-9c02-4061-9bf6-760561495f8e]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:13:19 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-3391b62d-acc3-47d7-8ba3-23d1c0cb5bdd tempest-VolumesListAdminTestJSON-1182933838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-7011a824-10fc-4a75-a6eb-5cf3adb22475 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:13:19 devstack sudo[89972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-7011a824-10fc-4a75-a6eb-5cf3adb22475 Apr 16 15:13:19 devstack sudo[89972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:13:19 devstack sudo[89968]: pam_unix(sudo:session): session closed for user root Apr 16 15:13:19 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-8a151948-49a2-4fa4-923e-80b9cb406834 tempest-VolumesListAdminTestJSON-2087561432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.451s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:13:19 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-8a151948-49a2-4fa4-923e-80b9cb406834 tempest-VolumesListAdminTestJSON-2087561432 None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:13:19 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-8a151948-49a2-4fa4-923e-80b9cb406834 tempest-VolumesListAdminTestJSON-2087561432 None] Deleted volume successfully. Apr 16 15:13:19 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-8a151948-49a2-4fa4-923e-80b9cb406834 tempest-VolumesListAdminTestJSON-2087561432 None] Lock "cinder-9064187a-8e9b-49bb-9f89-3b2a1bb52e01-delete_volume" released by "delete_volume" :: held 1.545s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:13:19 devstack sudo[89970]: pam_unix(sudo:session): session closed for user root Apr 16 15:13:19 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-df01dfa9-da75-4767-a608-0b21bfcf586d tempest-VolumesListAdminTestJSON-1182933838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.538s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:13:19 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-df01dfa9-da75-4767-a608-0b21bfcf586d tempest-VolumesListAdminTestJSON-1182933838 None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:13:19 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-df01dfa9-da75-4767-a608-0b21bfcf586d tempest-VolumesListAdminTestJSON-1182933838 None] Deleted volume successfully. Apr 16 15:13:19 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-df01dfa9-da75-4767-a608-0b21bfcf586d tempest-VolumesListAdminTestJSON-1182933838 None] Lock "cinder-731d8ddf-320c-4089-b6b5-5df4cb63e5ca-delete_volume" released by "delete_volume" :: held 1.625s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:13:19 devstack sudo[89972]: pam_unix(sudo:session): session closed for user root Apr 16 15:13:19 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-3391b62d-acc3-47d7-8ba3-23d1c0cb5bdd tempest-VolumesListAdminTestJSON-1182933838 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-7011a824-10fc-4a75-a6eb-5cf3adb22475" returned: 0 in 0.494s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:13:19 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-3391b62d-acc3-47d7-8ba3-23d1c0cb5bdd tempest-VolumesListAdminTestJSON-1182933838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-7011a824-10fc-4a75-a6eb-5cf3adb22475 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:13:20 devstack sudo[89979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-7011a824-10fc-4a75-a6eb-5cf3adb22475 Apr 16 15:13:20 devstack sudo[89979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:13:20 devstack sudo[89979]: pam_unix(sudo:session): session closed for user root Apr 16 15:13:20 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-3391b62d-acc3-47d7-8ba3-23d1c0cb5bdd tempest-VolumesListAdminTestJSON-1182933838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-7011a824-10fc-4a75-a6eb-5cf3adb22475" returned: 0 in 0.415s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:13:20 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-3391b62d-acc3-47d7-8ba3-23d1c0cb5bdd tempest-VolumesListAdminTestJSON-1182933838 None] Lock "cinder-quobyte-7011a824-10fc-4a75-a6eb-5cf3adb22475" released by "delete_volume" :: held 0.931s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:13:20 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-3391b62d-acc3-47d7-8ba3-23d1c0cb5bdd tempest-VolumesListAdminTestJSON-1182933838 None] Created reservations ['85e2c701-d952-4e13-8d9d-573d91e0eb2d', 'c1227b9b-eecf-4b42-be85-af217de059d4', '9c162507-a9c0-4492-8149-3ab464e202c0', '5480c16a-064c-4057-b85c-27d92e78bd73'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:13:20 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-3391b62d-acc3-47d7-8ba3-23d1c0cb5bdd tempest-VolumesListAdminTestJSON-1182933838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:13:20 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-3391b62d-acc3-47d7-8ba3-23d1c0cb5bdd tempest-VolumesListAdminTestJSON-1182933838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:13:20 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-3391b62d-acc3-47d7-8ba3-23d1c0cb5bdd tempest-VolumesListAdminTestJSON-1182933838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:13:20 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-3391b62d-acc3-47d7-8ba3-23d1c0cb5bdd tempest-VolumesListAdminTestJSON-1182933838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:13:20 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-3391b62d-acc3-47d7-8ba3-23d1c0cb5bdd tempest-VolumesListAdminTestJSON-1182933838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:13:20 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-3391b62d-acc3-47d7-8ba3-23d1c0cb5bdd tempest-VolumesListAdminTestJSON-1182933838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:13:20 devstack sudo[89982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:13:20 devstack sudo[89982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:13:20 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-3261a301-ff87-4a50-b870-2c1608fe04e4 tempest-VolumesListAdminTestJSON-1182933838 None] Acquiring lock "cinder-e058d9a1-a27c-4356-af79-402c9713120e-delete_volume" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:13:20 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-3261a301-ff87-4a50-b870-2c1608fe04e4 tempest-VolumesListAdminTestJSON-1182933838 None] Lock "cinder-e058d9a1-a27c-4356-af79-402c9713120e-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:13:20 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-3261a301-ff87-4a50-b870-2c1608fe04e4 tempest-VolumesListAdminTestJSON-1182933838 None] Acquiring lock "cinder-quobyte-e058d9a1-a27c-4356-af79-402c9713120e" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:13:20 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-3261a301-ff87-4a50-b870-2c1608fe04e4 tempest-VolumesListAdminTestJSON-1182933838 None] Lock "cinder-quobyte-e058d9a1-a27c-4356-af79-402c9713120e" acquired by "delete_volume" :: waited 0.008s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:13:20 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[013933b4-5deb-4804-bc17-99b741cc1b81]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:13:20 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-3261a301-ff87-4a50-b870-2c1608fe04e4 tempest-VolumesListAdminTestJSON-1182933838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-e058d9a1-a27c-4356-af79-402c9713120e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:13:20 devstack sudo[89984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-e058d9a1-a27c-4356-af79-402c9713120e Apr 16 15:13:20 devstack sudo[89984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:13:20 devstack sudo[89982]: pam_unix(sudo:session): session closed for user root Apr 16 15:13:20 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-3391b62d-acc3-47d7-8ba3-23d1c0cb5bdd tempest-VolumesListAdminTestJSON-1182933838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.452s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:13:20 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-3391b62d-acc3-47d7-8ba3-23d1c0cb5bdd tempest-VolumesListAdminTestJSON-1182933838 None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:13:20 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-3391b62d-acc3-47d7-8ba3-23d1c0cb5bdd tempest-VolumesListAdminTestJSON-1182933838 None] Deleted volume successfully. Apr 16 15:13:20 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-3391b62d-acc3-47d7-8ba3-23d1c0cb5bdd tempest-VolumesListAdminTestJSON-1182933838 None] Lock "cinder-7011a824-10fc-4a75-a6eb-5cf3adb22475-delete_volume" released by "delete_volume" :: held 1.529s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:13:21 devstack sudo[89984]: pam_unix(sudo:session): session closed for user root Apr 16 15:13:21 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-3261a301-ff87-4a50-b870-2c1608fe04e4 tempest-VolumesListAdminTestJSON-1182933838 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-e058d9a1-a27c-4356-af79-402c9713120e" returned: 0 in 0.486s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:13:21 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-3261a301-ff87-4a50-b870-2c1608fe04e4 tempest-VolumesListAdminTestJSON-1182933838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-e058d9a1-a27c-4356-af79-402c9713120e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:13:21 devstack sudo[89991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-e058d9a1-a27c-4356-af79-402c9713120e Apr 16 15:13:21 devstack sudo[89991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:13:21 devstack sudo[89991]: pam_unix(sudo:session): session closed for user root Apr 16 15:13:21 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-3261a301-ff87-4a50-b870-2c1608fe04e4 tempest-VolumesListAdminTestJSON-1182933838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-e058d9a1-a27c-4356-af79-402c9713120e" returned: 0 in 0.470s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:13:21 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-3261a301-ff87-4a50-b870-2c1608fe04e4 tempest-VolumesListAdminTestJSON-1182933838 None] Lock "cinder-quobyte-e058d9a1-a27c-4356-af79-402c9713120e" released by "delete_volume" :: held 0.989s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:13:21 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-3261a301-ff87-4a50-b870-2c1608fe04e4 tempest-VolumesListAdminTestJSON-1182933838 None] Created reservations ['168482a6-8e9e-4886-9cb5-e34624bc8741', '635d2e05-7be6-49da-a7b4-eae360d1caa4', '4a65000e-2650-4809-88df-39b33ce1f454', 'c9a13e0b-4edb-43c2-b50c-4f122945a40d'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:13:21 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-3261a301-ff87-4a50-b870-2c1608fe04e4 tempest-VolumesListAdminTestJSON-1182933838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:13:21 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-3261a301-ff87-4a50-b870-2c1608fe04e4 tempest-VolumesListAdminTestJSON-1182933838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:13:21 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-3261a301-ff87-4a50-b870-2c1608fe04e4 tempest-VolumesListAdminTestJSON-1182933838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:13:21 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-3261a301-ff87-4a50-b870-2c1608fe04e4 tempest-VolumesListAdminTestJSON-1182933838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:13:21 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-3261a301-ff87-4a50-b870-2c1608fe04e4 tempest-VolumesListAdminTestJSON-1182933838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:13:21 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-3261a301-ff87-4a50-b870-2c1608fe04e4 tempest-VolumesListAdminTestJSON-1182933838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:13:21 devstack sudo[89994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:13:21 devstack sudo[89994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:13:22 devstack sudo[89994]: pam_unix(sudo:session): session closed for user root Apr 16 15:13:22 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-3261a301-ff87-4a50-b870-2c1608fe04e4 tempest-VolumesListAdminTestJSON-1182933838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.461s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:13:22 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-3261a301-ff87-4a50-b870-2c1608fe04e4 tempest-VolumesListAdminTestJSON-1182933838 None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:13:22 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-3261a301-ff87-4a50-b870-2c1608fe04e4 tempest-VolumesListAdminTestJSON-1182933838 None] Deleted volume successfully. Apr 16 15:13:22 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-3261a301-ff87-4a50-b870-2c1608fe04e4 tempest-VolumesListAdminTestJSON-1182933838 None] Lock "cinder-e058d9a1-a27c-4356-af79-402c9713120e-delete_volume" released by "delete_volume" :: held 1.616s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:13:25 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [None req-46917701-2b66-4109-bcb8-20a6323e9386 tempest-VolumesMetadataTest-699838053 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82756) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 15:13:25 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-46917701-2b66-4109-bcb8-20a6323e9386 tempest-VolumesMetadataTest-699838053 None] Flow 'volume_create_manager' (00998fe7-fd00-454f-af98-8f34ca3e7e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:13:25 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-46917701-2b66-4109-bcb8-20a6323e9386 tempest-VolumesMetadataTest-699838053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f93ea1e-1303-4969-a4ba-20b709df0ae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:13:25 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-46917701-2b66-4109-bcb8-20a6323e9386 tempest-VolumesMetadataTest-699838053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f93ea1e-1303-4969-a4ba-20b709df0ae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:13:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-950215139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b458533-b899-45a8-9292-4d3ba543a262,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d055cb3a9fab4823a2eaa3fe9a1a8497',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:13:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:13:26Z,use_quota=True,user_id='5b8e8471701f4f6ba7cae4031703c013',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:13:25 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-46917701-2b66-4109-bcb8-20a6323e9386 tempest-VolumesMetadataTest-699838053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c1f2b58-1509-4d02-8882-ade578ce59c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:13:25 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-46917701-2b66-4109-bcb8-20a6323e9386 tempest-VolumesMetadataTest-699838053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c1f2b58-1509-4d02-8882-ade578ce59c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:13:25 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-46917701-2b66-4109-bcb8-20a6323e9386 tempest-VolumesMetadataTest-699838053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ceeba4a-c2fb-4951-b90f-d4a39db5cc24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:13:25 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-46917701-2b66-4109-bcb8-20a6323e9386 tempest-VolumesMetadataTest-699838053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ceeba4a-c2fb-4951-b90f-d4a39db5cc24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b458533-b899-45a8-9292-4d3ba543a262', 'volume_name': 'volume-6b458533-b899-45a8-9292-4d3ba543a262', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:13:25 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-46917701-2b66-4109-bcb8-20a6323e9386 tempest-VolumesMetadataTest-699838053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8eaf1176-6ce5-4656-9c22-a987b827336c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:13:25 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-46917701-2b66-4109-bcb8-20a6323e9386 tempest-VolumesMetadataTest-699838053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8eaf1176-6ce5-4656-9c22-a987b827336c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:13:25 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-46917701-2b66-4109-bcb8-20a6323e9386 tempest-VolumesMetadataTest-699838053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c8d96f0-2157-4757-b934-6fab91073c60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:13:25 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-46917701-2b66-4109-bcb8-20a6323e9386 tempest-VolumesMetadataTest-699838053 None] Volume 6b458533-b899-45a8-9292-4d3ba543a262: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b458533-b899-45a8-9292-4d3ba543a262', 'volume_size': 1} Apr 16 15:13:25 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-46917701-2b66-4109-bcb8-20a6323e9386 tempest-VolumesMetadataTest-699838053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:13:25 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-46917701-2b66-4109-bcb8-20a6323e9386 tempest-VolumesMetadataTest-699838053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:13:25 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-46917701-2b66-4109-bcb8-20a6323e9386 tempest-VolumesMetadataTest-699838053 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:13:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-950215139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b458533-b899-45a8-9292-4d3ba543a262,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d055cb3a9fab4823a2eaa3fe9a1a8497',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:13:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:13:26Z,use_quota=True,user_id='5b8e8471701f4f6ba7cae4031703c013',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)}" {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 15:13:25 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-46917701-2b66-4109-bcb8-20a6323e9386 tempest-VolumesMetadataTest-699838053 None] Creating volume 6b458533-b899-45a8-9292-4d3ba543a262 {{(pid=82756) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 15:13:25 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-46917701-2b66-4109-bcb8-20a6323e9386 tempest-VolumesMetadataTest-699838053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:13:25 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-46917701-2b66-4109-bcb8-20a6323e9386 tempest-VolumesMetadataTest-699838053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:13:25 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-46917701-2b66-4109-bcb8-20a6323e9386 tempest-VolumesMetadataTest-699838053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:13:25 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-46917701-2b66-4109-bcb8-20a6323e9386 tempest-VolumesMetadataTest-699838053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:13:25 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-46917701-2b66-4109-bcb8-20a6323e9386 tempest-VolumesMetadataTest-699838053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:13:25 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-46917701-2b66-4109-bcb8-20a6323e9386 tempest-VolumesMetadataTest-699838053 None] Selected osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 as target Quobyte volume. {{(pid=82756) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 15:13:25 devstack cinder-volume[82756]: INFO cinder.volume.drivers.remotefs [None req-46917701-2b66-4109-bcb8-20a6323e9386 tempest-VolumesMetadataTest-699838053 None] casted to osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 Apr 16 15:13:25 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-46917701-2b66-4109-bcb8-20a6323e9386 tempest-VolumesMetadataTest-699838053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6b458533-b899-45a8-9292-4d3ba543a262 1073741824 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:13:25 devstack sudo[89998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6b458533-b899-45a8-9292-4d3ba543a262 1073741824 Apr 16 15:13:25 devstack sudo[89998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:13:26 devstack sudo[89998]: pam_unix(sudo:session): session closed for user root Apr 16 15:13:26 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-46917701-2b66-4109-bcb8-20a6323e9386 tempest-VolumesMetadataTest-699838053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6b458533-b899-45a8-9292-4d3ba543a262 1073741824" returned: 0 in 0.524s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:13:26 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-46917701-2b66-4109-bcb8-20a6323e9386 tempest-VolumesMetadataTest-699838053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6b458533-b899-45a8-9292-4d3ba543a262 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:13:26 devstack sudo[90003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6b458533-b899-45a8-9292-4d3ba543a262 Apr 16 15:13:26 devstack sudo[90003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:13:26 devstack sudo[90003]: pam_unix(sudo:session): session closed for user root Apr 16 15:13:26 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-46917701-2b66-4109-bcb8-20a6323e9386 tempest-VolumesMetadataTest-699838053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6b458533-b899-45a8-9292-4d3ba543a262" returned: 0 in 0.427s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:13:26 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-46917701-2b66-4109-bcb8-20a6323e9386 tempest-VolumesMetadataTest-699838053 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'} {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 15:13:26 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-46917701-2b66-4109-bcb8-20a6323e9386 tempest-VolumesMetadataTest-699838053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.980s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:13:26 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-46917701-2b66-4109-bcb8-20a6323e9386 tempest-VolumesMetadataTest-699838053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c8d96f0-2157-4757-b934-6fab91073c60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b458533-b899-45a8-9292-4d3ba543a262', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:13:26 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-46917701-2b66-4109-bcb8-20a6323e9386 tempest-VolumesMetadataTest-699838053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de591da6-b1c9-4cab-8568-36014240aaa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:13:26 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-46917701-2b66-4109-bcb8-20a6323e9386 tempest-VolumesMetadataTest-699838053 None] Volume volume-6b458533-b899-45a8-9292-4d3ba543a262 (6b458533-b899-45a8-9292-4d3ba543a262): created successfully Apr 16 15:13:26 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-46917701-2b66-4109-bcb8-20a6323e9386 tempest-VolumesMetadataTest-699838053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de591da6-b1c9-4cab-8568-36014240aaa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:13:26 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-46917701-2b66-4109-bcb8-20a6323e9386 tempest-VolumesMetadataTest-699838053 None] Flow 'volume_create_manager' (00998fe7-fd00-454f-af98-8f34ca3e7e71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:13:26 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-46917701-2b66-4109-bcb8-20a6323e9386 tempest-VolumesMetadataTest-699838053 None] Created volume successfully. Apr 16 15:13:28 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-853c6eac-a621-4df5-8eb7-bfc9ea6a16d2 tempest-VolumesMetadataTest-699838053 None] Acquiring lock "cinder-6b458533-b899-45a8-9292-4d3ba543a262-delete_volume" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:13:28 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-853c6eac-a621-4df5-8eb7-bfc9ea6a16d2 tempest-VolumesMetadataTest-699838053 None] Lock "cinder-6b458533-b899-45a8-9292-4d3ba543a262-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:13:28 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-853c6eac-a621-4df5-8eb7-bfc9ea6a16d2 tempest-VolumesMetadataTest-699838053 None] Acquiring lock "cinder-quobyte-6b458533-b899-45a8-9292-4d3ba543a262" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:13:28 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-853c6eac-a621-4df5-8eb7-bfc9ea6a16d2 tempest-VolumesMetadataTest-699838053 None] Lock "cinder-quobyte-6b458533-b899-45a8-9292-4d3ba543a262" acquired by "delete_volume" :: waited 0.009s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:13:28 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2c8c386-70d6-4b90-8188-8432c1898f89]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:13:28 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-853c6eac-a621-4df5-8eb7-bfc9ea6a16d2 tempest-VolumesMetadataTest-699838053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6b458533-b899-45a8-9292-4d3ba543a262 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:13:28 devstack sudo[90007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6b458533-b899-45a8-9292-4d3ba543a262 Apr 16 15:13:28 devstack sudo[90007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:13:28 devstack sudo[90007]: pam_unix(sudo:session): session closed for user root Apr 16 15:13:28 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-853c6eac-a621-4df5-8eb7-bfc9ea6a16d2 tempest-VolumesMetadataTest-699838053 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6b458533-b899-45a8-9292-4d3ba543a262" returned: 0 in 0.544s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:13:28 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-853c6eac-a621-4df5-8eb7-bfc9ea6a16d2 tempest-VolumesMetadataTest-699838053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6b458533-b899-45a8-9292-4d3ba543a262 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:13:28 devstack sudo[90012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6b458533-b899-45a8-9292-4d3ba543a262 Apr 16 15:13:28 devstack sudo[90012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:13:29 devstack sudo[90012]: pam_unix(sudo:session): session closed for user root Apr 16 15:13:29 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-853c6eac-a621-4df5-8eb7-bfc9ea6a16d2 tempest-VolumesMetadataTest-699838053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6b458533-b899-45a8-9292-4d3ba543a262" returned: 0 in 0.468s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:13:29 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-853c6eac-a621-4df5-8eb7-bfc9ea6a16d2 tempest-VolumesMetadataTest-699838053 None] Lock "cinder-quobyte-6b458533-b899-45a8-9292-4d3ba543a262" released by "delete_volume" :: held 1.036s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:13:29 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-853c6eac-a621-4df5-8eb7-bfc9ea6a16d2 tempest-VolumesMetadataTest-699838053 None] Created reservations ['104cb374-7711-40f3-958c-9398719c776f', '927dd20a-831c-47c2-87ec-d4b5ccbd5429', '3c72c8a5-bf11-44f7-9d89-cc9e09a8e207', 'ee2a2fcc-c2ca-4375-aff0-10e178787d88'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:13:29 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-853c6eac-a621-4df5-8eb7-bfc9ea6a16d2 tempest-VolumesMetadataTest-699838053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:13:29 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-853c6eac-a621-4df5-8eb7-bfc9ea6a16d2 tempest-VolumesMetadataTest-699838053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:13:29 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-853c6eac-a621-4df5-8eb7-bfc9ea6a16d2 tempest-VolumesMetadataTest-699838053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:13:29 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-853c6eac-a621-4df5-8eb7-bfc9ea6a16d2 tempest-VolumesMetadataTest-699838053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:13:29 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-853c6eac-a621-4df5-8eb7-bfc9ea6a16d2 tempest-VolumesMetadataTest-699838053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:13:29 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-853c6eac-a621-4df5-8eb7-bfc9ea6a16d2 tempest-VolumesMetadataTest-699838053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:13:29 devstack sudo[90015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:13:29 devstack sudo[90015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:13:29 devstack sudo[90015]: pam_unix(sudo:session): session closed for user root Apr 16 15:13:29 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-853c6eac-a621-4df5-8eb7-bfc9ea6a16d2 tempest-VolumesMetadataTest-699838053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.424s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:13:29 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-853c6eac-a621-4df5-8eb7-bfc9ea6a16d2 tempest-VolumesMetadataTest-699838053 None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:13:29 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-853c6eac-a621-4df5-8eb7-bfc9ea6a16d2 tempest-VolumesMetadataTest-699838053 None] Deleted volume successfully. Apr 16 15:13:29 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-853c6eac-a621-4df5-8eb7-bfc9ea6a16d2 tempest-VolumesMetadataTest-699838053 None] Lock "cinder-6b458533-b899-45a8-9292-4d3ba543a262-delete_volume" released by "delete_volume" :: held 1.605s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:13:32 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fb2c4bd-7329-4073-960a-aec289ce2479 tempest-VolumesGetTest-103301033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82756) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 15:13:32 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-8fb2c4bd-7329-4073-960a-aec289ce2479 tempest-VolumesGetTest-103301033 None] Flow 'volume_create_manager' (81e68b0d-84a9-485a-91e0-a1cdd3aaa6ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:13:32 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-8fb2c4bd-7329-4073-960a-aec289ce2479 tempest-VolumesGetTest-103301033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ad49cd3-d2b1-47d4-a9cd-db724aa1e60b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:13:32 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-8fb2c4bd-7329-4073-960a-aec289ce2479 tempest-VolumesGetTest-103301033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ad49cd3-d2b1-47d4-a9cd-db724aa1e60b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:13:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-690988630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b894ef68-917e-4d4b-ae5c-9d349c81ee4b,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='59cd21a5b90d47d2ab3ff50fc013f013',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:13:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:13:32Z,use_quota=True,user_id='6ff61eaacb734cf3b892088433167105',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:13:32 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-8fb2c4bd-7329-4073-960a-aec289ce2479 tempest-VolumesGetTest-103301033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2d68b2d-c565-430c-86c6-6f6e0d8e0760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:13:32 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-8fb2c4bd-7329-4073-960a-aec289ce2479 tempest-VolumesGetTest-103301033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2d68b2d-c565-430c-86c6-6f6e0d8e0760) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:13:32 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-8fb2c4bd-7329-4073-960a-aec289ce2479 tempest-VolumesGetTest-103301033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7932284-4db2-4c3b-adba-7ddf0af3152a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:13:32 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-8fb2c4bd-7329-4073-960a-aec289ce2479 tempest-VolumesGetTest-103301033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7932284-4db2-4c3b-adba-7ddf0af3152a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b894ef68-917e-4d4b-ae5c-9d349c81ee4b', 'volume_name': 'volume-b894ef68-917e-4d4b-ae5c-9d349c81ee4b', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:13:32 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-8fb2c4bd-7329-4073-960a-aec289ce2479 tempest-VolumesGetTest-103301033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e4e7bec-1a97-40ce-a2fd-9e99dae1f901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:13:32 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-8fb2c4bd-7329-4073-960a-aec289ce2479 tempest-VolumesGetTest-103301033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e4e7bec-1a97-40ce-a2fd-9e99dae1f901) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:13:32 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-8fb2c4bd-7329-4073-960a-aec289ce2479 tempest-VolumesGetTest-103301033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ffe26a3-9ae5-4a43-bd87-79ee85bd115b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:13:32 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-8fb2c4bd-7329-4073-960a-aec289ce2479 tempest-VolumesGetTest-103301033 None] Volume b894ef68-917e-4d4b-ae5c-9d349c81ee4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b894ef68-917e-4d4b-ae5c-9d349c81ee4b', 'volume_size': 1} Apr 16 15:13:32 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-8fb2c4bd-7329-4073-960a-aec289ce2479 tempest-VolumesGetTest-103301033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:13:32 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-8fb2c4bd-7329-4073-960a-aec289ce2479 tempest-VolumesGetTest-103301033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:13:32 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-8fb2c4bd-7329-4073-960a-aec289ce2479 tempest-VolumesGetTest-103301033 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:13:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-690988630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b894ef68-917e-4d4b-ae5c-9d349c81ee4b,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='59cd21a5b90d47d2ab3ff50fc013f013',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:13:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:13:32Z,use_quota=True,user_id='6ff61eaacb734cf3b892088433167105',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)}" {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 15:13:32 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-8fb2c4bd-7329-4073-960a-aec289ce2479 tempest-VolumesGetTest-103301033 None] Creating volume b894ef68-917e-4d4b-ae5c-9d349c81ee4b {{(pid=82756) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 15:13:32 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-8fb2c4bd-7329-4073-960a-aec289ce2479 tempest-VolumesGetTest-103301033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:13:32 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-8fb2c4bd-7329-4073-960a-aec289ce2479 tempest-VolumesGetTest-103301033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:13:32 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-8fb2c4bd-7329-4073-960a-aec289ce2479 tempest-VolumesGetTest-103301033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:13:32 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-8fb2c4bd-7329-4073-960a-aec289ce2479 tempest-VolumesGetTest-103301033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:13:32 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-8fb2c4bd-7329-4073-960a-aec289ce2479 tempest-VolumesGetTest-103301033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:13:32 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-8fb2c4bd-7329-4073-960a-aec289ce2479 tempest-VolumesGetTest-103301033 None] Selected osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 as target Quobyte volume. {{(pid=82756) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 15:13:32 devstack cinder-volume[82756]: INFO cinder.volume.drivers.remotefs [None req-8fb2c4bd-7329-4073-960a-aec289ce2479 tempest-VolumesGetTest-103301033 None] casted to osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 Apr 16 15:13:32 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-8fb2c4bd-7329-4073-960a-aec289ce2479 tempest-VolumesGetTest-103301033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b894ef68-917e-4d4b-ae5c-9d349c81ee4b 1073741824 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:13:32 devstack sudo[90018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b894ef68-917e-4d4b-ae5c-9d349c81ee4b 1073741824 Apr 16 15:13:32 devstack sudo[90018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:13:32 devstack sudo[90018]: pam_unix(sudo:session): session closed for user root Apr 16 15:13:32 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-8fb2c4bd-7329-4073-960a-aec289ce2479 tempest-VolumesGetTest-103301033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b894ef68-917e-4d4b-ae5c-9d349c81ee4b 1073741824" returned: 0 in 0.501s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:13:32 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-8fb2c4bd-7329-4073-960a-aec289ce2479 tempest-VolumesGetTest-103301033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b894ef68-917e-4d4b-ae5c-9d349c81ee4b {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:13:32 devstack sudo[90023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b894ef68-917e-4d4b-ae5c-9d349c81ee4b Apr 16 15:13:32 devstack sudo[90023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:13:33 devstack sudo[90023]: pam_unix(sudo:session): session closed for user root Apr 16 15:13:33 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-8fb2c4bd-7329-4073-960a-aec289ce2479 tempest-VolumesGetTest-103301033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b894ef68-917e-4d4b-ae5c-9d349c81ee4b" returned: 0 in 0.435s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:13:33 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-8fb2c4bd-7329-4073-960a-aec289ce2479 tempest-VolumesGetTest-103301033 None] <== create_volume: return (961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'} {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 15:13:33 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-8fb2c4bd-7329-4073-960a-aec289ce2479 tempest-VolumesGetTest-103301033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.963s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:13:33 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-8fb2c4bd-7329-4073-960a-aec289ce2479 tempest-VolumesGetTest-103301033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ffe26a3-9ae5-4a43-bd87-79ee85bd115b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b894ef68-917e-4d4b-ae5c-9d349c81ee4b', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:13:33 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-8fb2c4bd-7329-4073-960a-aec289ce2479 tempest-VolumesGetTest-103301033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f07b5c00-7c5f-41fd-aa72-67238a9ddc87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:13:33 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-8fb2c4bd-7329-4073-960a-aec289ce2479 tempest-VolumesGetTest-103301033 None] Volume volume-b894ef68-917e-4d4b-ae5c-9d349c81ee4b (b894ef68-917e-4d4b-ae5c-9d349c81ee4b): created successfully Apr 16 15:13:33 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-8fb2c4bd-7329-4073-960a-aec289ce2479 tempest-VolumesGetTest-103301033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f07b5c00-7c5f-41fd-aa72-67238a9ddc87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:13:33 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-8fb2c4bd-7329-4073-960a-aec289ce2479 tempest-VolumesGetTest-103301033 None] Flow 'volume_create_manager' (81e68b0d-84a9-485a-91e0-a1cdd3aaa6ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:13:33 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-8fb2c4bd-7329-4073-960a-aec289ce2479 tempest-VolumesGetTest-103301033 None] Created volume successfully. Apr 16 15:13:34 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [None req-99935a6e-ae7b-4051-809e-bb340612d4ba tempest-VolumesGetTest-103301033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82756) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 15:13:34 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-99935a6e-ae7b-4051-809e-bb340612d4ba tempest-VolumesGetTest-103301033 None] Flow 'volume_create_manager' (06b45672-5fe2-4b91-b1fc-d539cccca6ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:13:34 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-99935a6e-ae7b-4051-809e-bb340612d4ba tempest-VolumesGetTest-103301033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3ec8be9-ce31-46ca-b2b2-f7c77f97b234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:13:34 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-99935a6e-ae7b-4051-809e-bb340612d4ba tempest-VolumesGetTest-103301033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3ec8be9-ce31-46ca-b2b2-f7c77f97b234) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:13:35Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1051194952',display_name='tempest-VolumesGetTest-Volume-733996602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6267bf8-149f-427a-868d-ecb23edeabbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59cd21a5b90d47d2ab3ff50fc013f013',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:13:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:13:35Z,use_quota=True,user_id='6ff61eaacb734cf3b892088433167105',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:13:34 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-99935a6e-ae7b-4051-809e-bb340612d4ba tempest-VolumesGetTest-103301033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f784d55e-b519-4fe1-89e3-e8e69c82780c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:13:34 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-99935a6e-ae7b-4051-809e-bb340612d4ba tempest-VolumesGetTest-103301033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f784d55e-b519-4fe1-89e3-e8e69c82780c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:13:34 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-99935a6e-ae7b-4051-809e-bb340612d4ba tempest-VolumesGetTest-103301033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af48dbe5-c36d-451e-bab4-72fe04114be0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:13:34 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-99935a6e-ae7b-4051-809e-bb340612d4ba tempest-VolumesGetTest-103301033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af48dbe5-c36d-451e-bab4-72fe04114be0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6267bf8-149f-427a-868d-ecb23edeabbb', 'volume_name': 'volume-b6267bf8-149f-427a-868d-ecb23edeabbb', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:13:34 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-99935a6e-ae7b-4051-809e-bb340612d4ba tempest-VolumesGetTest-103301033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03174270-f8d3-4ef5-bfad-957fa9caa5b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:13:34 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-99935a6e-ae7b-4051-809e-bb340612d4ba tempest-VolumesGetTest-103301033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03174270-f8d3-4ef5-bfad-957fa9caa5b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:13:34 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-99935a6e-ae7b-4051-809e-bb340612d4ba tempest-VolumesGetTest-103301033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a7939c1-6c32-4453-b1a8-6768d9466243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:13:34 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-99935a6e-ae7b-4051-809e-bb340612d4ba tempest-VolumesGetTest-103301033 None] Volume b6267bf8-149f-427a-868d-ecb23edeabbb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6267bf8-149f-427a-868d-ecb23edeabbb', 'volume_size': 1} Apr 16 15:13:34 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-99935a6e-ae7b-4051-809e-bb340612d4ba tempest-VolumesGetTest-103301033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:13:34 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-99935a6e-ae7b-4051-809e-bb340612d4ba tempest-VolumesGetTest-103301033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:13:34 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-99935a6e-ae7b-4051-809e-bb340612d4ba tempest-VolumesGetTest-103301033 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:13:35Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1051194952',display_name='tempest-VolumesGetTest-Volume-733996602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6267bf8-149f-427a-868d-ecb23edeabbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59cd21a5b90d47d2ab3ff50fc013f013',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:13:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:13:35Z,use_quota=True,user_id='6ff61eaacb734cf3b892088433167105',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)}" {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 15:13:34 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-99935a6e-ae7b-4051-809e-bb340612d4ba tempest-VolumesGetTest-103301033 None] Creating volume b6267bf8-149f-427a-868d-ecb23edeabbb {{(pid=82756) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 15:13:34 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-99935a6e-ae7b-4051-809e-bb340612d4ba tempest-VolumesGetTest-103301033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:13:34 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-99935a6e-ae7b-4051-809e-bb340612d4ba tempest-VolumesGetTest-103301033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:13:34 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-99935a6e-ae7b-4051-809e-bb340612d4ba tempest-VolumesGetTest-103301033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:13:34 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-99935a6e-ae7b-4051-809e-bb340612d4ba tempest-VolumesGetTest-103301033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:13:34 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-99935a6e-ae7b-4051-809e-bb340612d4ba tempest-VolumesGetTest-103301033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:13:34 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-99935a6e-ae7b-4051-809e-bb340612d4ba tempest-VolumesGetTest-103301033 None] Selected osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 as target Quobyte volume. {{(pid=82756) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 15:13:34 devstack cinder-volume[82756]: INFO cinder.volume.drivers.remotefs [None req-99935a6e-ae7b-4051-809e-bb340612d4ba tempest-VolumesGetTest-103301033 None] casted to osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 Apr 16 15:13:34 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-99935a6e-ae7b-4051-809e-bb340612d4ba tempest-VolumesGetTest-103301033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b6267bf8-149f-427a-868d-ecb23edeabbb 1073741824 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:13:34 devstack sudo[90027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b6267bf8-149f-427a-868d-ecb23edeabbb 1073741824 Apr 16 15:13:34 devstack sudo[90027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:13:35 devstack sudo[90027]: pam_unix(sudo:session): session closed for user root Apr 16 15:13:35 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-99935a6e-ae7b-4051-809e-bb340612d4ba tempest-VolumesGetTest-103301033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b6267bf8-149f-427a-868d-ecb23edeabbb 1073741824" returned: 0 in 0.514s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:13:35 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-99935a6e-ae7b-4051-809e-bb340612d4ba tempest-VolumesGetTest-103301033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b6267bf8-149f-427a-868d-ecb23edeabbb {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:13:35 devstack sudo[90032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b6267bf8-149f-427a-868d-ecb23edeabbb Apr 16 15:13:35 devstack sudo[90032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:13:35 devstack sudo[90032]: pam_unix(sudo:session): session closed for user root Apr 16 15:13:35 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-99935a6e-ae7b-4051-809e-bb340612d4ba tempest-VolumesGetTest-103301033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b6267bf8-149f-427a-868d-ecb23edeabbb" returned: 0 in 0.403s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:13:35 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-99935a6e-ae7b-4051-809e-bb340612d4ba tempest-VolumesGetTest-103301033 None] <== create_volume: return (941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'} {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 15:13:35 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-99935a6e-ae7b-4051-809e-bb340612d4ba tempest-VolumesGetTest-103301033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.945s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:13:35 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-99935a6e-ae7b-4051-809e-bb340612d4ba tempest-VolumesGetTest-103301033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a7939c1-6c32-4453-b1a8-6768d9466243) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6267bf8-149f-427a-868d-ecb23edeabbb', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:13:35 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-99935a6e-ae7b-4051-809e-bb340612d4ba tempest-VolumesGetTest-103301033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbca3dac-b86b-411b-8368-eb24ba430d91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:13:35 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-99935a6e-ae7b-4051-809e-bb340612d4ba tempest-VolumesGetTest-103301033 None] Volume volume-b6267bf8-149f-427a-868d-ecb23edeabbb (b6267bf8-149f-427a-868d-ecb23edeabbb): created successfully Apr 16 15:13:35 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-99935a6e-ae7b-4051-809e-bb340612d4ba tempest-VolumesGetTest-103301033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbca3dac-b86b-411b-8368-eb24ba430d91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:13:35 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-99935a6e-ae7b-4051-809e-bb340612d4ba tempest-VolumesGetTest-103301033 None] Flow 'volume_create_manager' (06b45672-5fe2-4b91-b1fc-d539cccca6ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:13:35 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-99935a6e-ae7b-4051-809e-bb340612d4ba tempest-VolumesGetTest-103301033 None] Created volume successfully. Apr 16 15:13:37 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-0417cca5-63df-424f-a401-3e2a51040917 tempest-VolumesGetTest-103301033 None] Acquiring lock "cinder-b6267bf8-149f-427a-868d-ecb23edeabbb-delete_volume" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:13:37 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-0417cca5-63df-424f-a401-3e2a51040917 tempest-VolumesGetTest-103301033 None] Lock "cinder-b6267bf8-149f-427a-868d-ecb23edeabbb-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:13:37 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-0417cca5-63df-424f-a401-3e2a51040917 tempest-VolumesGetTest-103301033 None] Acquiring lock "cinder-quobyte-b6267bf8-149f-427a-868d-ecb23edeabbb" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:13:37 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-0417cca5-63df-424f-a401-3e2a51040917 tempest-VolumesGetTest-103301033 None] Lock "cinder-quobyte-b6267bf8-149f-427a-868d-ecb23edeabbb" acquired by "delete_volume" :: waited 0.008s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:13:37 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d4d37af-2c3a-4c67-a334-9f2d3e0d9fa8]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:13:37 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-0417cca5-63df-424f-a401-3e2a51040917 tempest-VolumesGetTest-103301033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b6267bf8-149f-427a-868d-ecb23edeabbb {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:13:37 devstack sudo[90035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b6267bf8-149f-427a-868d-ecb23edeabbb Apr 16 15:13:37 devstack sudo[90035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:13:37 devstack sudo[90035]: pam_unix(sudo:session): session closed for user root Apr 16 15:13:37 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-0417cca5-63df-424f-a401-3e2a51040917 tempest-VolumesGetTest-103301033 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b6267bf8-149f-427a-868d-ecb23edeabbb" returned: 0 in 0.477s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:13:37 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-0417cca5-63df-424f-a401-3e2a51040917 tempest-VolumesGetTest-103301033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b6267bf8-149f-427a-868d-ecb23edeabbb {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:13:37 devstack sudo[90040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b6267bf8-149f-427a-868d-ecb23edeabbb Apr 16 15:13:37 devstack sudo[90040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:13:38 devstack sudo[90040]: pam_unix(sudo:session): session closed for user root Apr 16 15:13:38 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-0417cca5-63df-424f-a401-3e2a51040917 tempest-VolumesGetTest-103301033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b6267bf8-149f-427a-868d-ecb23edeabbb" returned: 0 in 0.436s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:13:38 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-0417cca5-63df-424f-a401-3e2a51040917 tempest-VolumesGetTest-103301033 None] Lock "cinder-quobyte-b6267bf8-149f-427a-868d-ecb23edeabbb" released by "delete_volume" :: held 0.940s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:13:38 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-0417cca5-63df-424f-a401-3e2a51040917 tempest-VolumesGetTest-103301033 None] Created reservations ['739fc22e-4b98-47a6-b3c4-5b107896f0d5', 'a71aa804-03aa-4194-b4fb-193f71eabb22', '655fbbb4-526a-4102-839b-06fd73555a67', '55044a38-1331-4713-9eb2-f8bc1067c9d2'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:13:38 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-0417cca5-63df-424f-a401-3e2a51040917 tempest-VolumesGetTest-103301033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:13:38 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-0417cca5-63df-424f-a401-3e2a51040917 tempest-VolumesGetTest-103301033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:13:38 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-0417cca5-63df-424f-a401-3e2a51040917 tempest-VolumesGetTest-103301033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:13:38 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-0417cca5-63df-424f-a401-3e2a51040917 tempest-VolumesGetTest-103301033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:13:38 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-0417cca5-63df-424f-a401-3e2a51040917 tempest-VolumesGetTest-103301033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:13:38 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-0417cca5-63df-424f-a401-3e2a51040917 tempest-VolumesGetTest-103301033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:13:38 devstack sudo[90043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:13:38 devstack sudo[90043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:13:38 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-3f4e4450-11ce-4934-9dbb-e64d5549bb44 tempest-VolumesGetTest-103301033 None] Acquiring lock "cinder-b894ef68-917e-4d4b-ae5c-9d349c81ee4b-delete_volume" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:13:38 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-3f4e4450-11ce-4934-9dbb-e64d5549bb44 tempest-VolumesGetTest-103301033 None] Lock "cinder-b894ef68-917e-4d4b-ae5c-9d349c81ee4b-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:13:38 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-3f4e4450-11ce-4934-9dbb-e64d5549bb44 tempest-VolumesGetTest-103301033 None] Acquiring lock "cinder-quobyte-b894ef68-917e-4d4b-ae5c-9d349c81ee4b" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:13:38 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-3f4e4450-11ce-4934-9dbb-e64d5549bb44 tempest-VolumesGetTest-103301033 None] Lock "cinder-quobyte-b894ef68-917e-4d4b-ae5c-9d349c81ee4b" acquired by "delete_volume" :: waited 0.008s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:13:38 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[7db52ad9-3f7f-4e07-a10d-9c712c23da38]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:13:38 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-3f4e4450-11ce-4934-9dbb-e64d5549bb44 tempest-VolumesGetTest-103301033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b894ef68-917e-4d4b-ae5c-9d349c81ee4b {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:13:38 devstack sudo[90045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b894ef68-917e-4d4b-ae5c-9d349c81ee4b Apr 16 15:13:38 devstack sudo[90045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:13:38 devstack sudo[90043]: pam_unix(sudo:session): session closed for user root Apr 16 15:13:38 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-0417cca5-63df-424f-a401-3e2a51040917 tempest-VolumesGetTest-103301033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.477s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:13:38 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-0417cca5-63df-424f-a401-3e2a51040917 tempest-VolumesGetTest-103301033 None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:13:38 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-0417cca5-63df-424f-a401-3e2a51040917 tempest-VolumesGetTest-103301033 None] Deleted volume successfully. Apr 16 15:13:38 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-0417cca5-63df-424f-a401-3e2a51040917 tempest-VolumesGetTest-103301033 None] Lock "cinder-b6267bf8-149f-427a-868d-ecb23edeabbb-delete_volume" released by "delete_volume" :: held 1.538s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:13:38 devstack sudo[90045]: pam_unix(sudo:session): session closed for user root Apr 16 15:13:38 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-3f4e4450-11ce-4934-9dbb-e64d5549bb44 tempest-VolumesGetTest-103301033 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b894ef68-917e-4d4b-ae5c-9d349c81ee4b" returned: 0 in 0.491s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:13:38 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-3f4e4450-11ce-4934-9dbb-e64d5549bb44 tempest-VolumesGetTest-103301033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b894ef68-917e-4d4b-ae5c-9d349c81ee4b {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:13:38 devstack sudo[90051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b894ef68-917e-4d4b-ae5c-9d349c81ee4b Apr 16 15:13:38 devstack sudo[90051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:13:39 devstack sudo[90051]: pam_unix(sudo:session): session closed for user root Apr 16 15:13:39 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-3f4e4450-11ce-4934-9dbb-e64d5549bb44 tempest-VolumesGetTest-103301033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b894ef68-917e-4d4b-ae5c-9d349c81ee4b" returned: 0 in 0.396s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:13:39 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-3f4e4450-11ce-4934-9dbb-e64d5549bb44 tempest-VolumesGetTest-103301033 None] Lock "cinder-quobyte-b894ef68-917e-4d4b-ae5c-9d349c81ee4b" released by "delete_volume" :: held 0.908s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:13:39 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-3f4e4450-11ce-4934-9dbb-e64d5549bb44 tempest-VolumesGetTest-103301033 None] Created reservations ['0df082d3-662b-4377-9485-f52723a1cbad', '51cb4fad-0a70-4caf-8985-e4969b575610', 'ea082848-e483-42f9-8947-71247fcea917', '9edf50e2-8a37-452b-947b-d0ecd950baf2'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:13:39 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-3f4e4450-11ce-4934-9dbb-e64d5549bb44 tempest-VolumesGetTest-103301033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:13:39 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-3f4e4450-11ce-4934-9dbb-e64d5549bb44 tempest-VolumesGetTest-103301033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:13:39 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-3f4e4450-11ce-4934-9dbb-e64d5549bb44 tempest-VolumesGetTest-103301033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:13:39 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-3f4e4450-11ce-4934-9dbb-e64d5549bb44 tempest-VolumesGetTest-103301033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:13:39 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-3f4e4450-11ce-4934-9dbb-e64d5549bb44 tempest-VolumesGetTest-103301033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:13:39 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-3f4e4450-11ce-4934-9dbb-e64d5549bb44 tempest-VolumesGetTest-103301033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:13:39 devstack sudo[90054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:13:39 devstack sudo[90054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:13:39 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [None req-902f0607-c5b1-49fe-9598-cd146d31a424 tempest-VolumesGetTest-103301033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82756) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 15:13:39 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-902f0607-c5b1-49fe-9598-cd146d31a424 tempest-VolumesGetTest-103301033 None] Flow 'volume_create_manager' (95f80fac-9093-47a7-a79a-5df1c8fd1f28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:13:39 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-902f0607-c5b1-49fe-9598-cd146d31a424 tempest-VolumesGetTest-103301033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cc8e4e4-f0eb-4d1a-b66a-ad2ab6c98a16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:13:39 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-902f0607-c5b1-49fe-9598-cd146d31a424 tempest-VolumesGetTest-103301033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cc8e4e4-f0eb-4d1a-b66a-ad2ab6c98a16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:13:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1974315276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9941c26-4f32-4343-aac7-caeb19e30d79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59cd21a5b90d47d2ab3ff50fc013f013',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:13:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:13:40Z,use_quota=True,user_id='6ff61eaacb734cf3b892088433167105',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:13:39 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-902f0607-c5b1-49fe-9598-cd146d31a424 tempest-VolumesGetTest-103301033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18361eae-e707-4ff8-a3f5-1cd84835eaad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:13:39 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-902f0607-c5b1-49fe-9598-cd146d31a424 tempest-VolumesGetTest-103301033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18361eae-e707-4ff8-a3f5-1cd84835eaad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:13:39 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-902f0607-c5b1-49fe-9598-cd146d31a424 tempest-VolumesGetTest-103301033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae1b752d-8df4-44db-a315-12abc68cf13e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:13:39 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-902f0607-c5b1-49fe-9598-cd146d31a424 tempest-VolumesGetTest-103301033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae1b752d-8df4-44db-a315-12abc68cf13e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9941c26-4f32-4343-aac7-caeb19e30d79', 'volume_name': 'volume-b9941c26-4f32-4343-aac7-caeb19e30d79', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:13:39 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-902f0607-c5b1-49fe-9598-cd146d31a424 tempest-VolumesGetTest-103301033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3c4971f-db3b-4e8b-baca-cfa718ad827e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:13:39 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-902f0607-c5b1-49fe-9598-cd146d31a424 tempest-VolumesGetTest-103301033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3c4971f-db3b-4e8b-baca-cfa718ad827e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:13:39 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-902f0607-c5b1-49fe-9598-cd146d31a424 tempest-VolumesGetTest-103301033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f61ac1b0-8e5f-42ae-95e3-4dd61ef0c8be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:13:39 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-902f0607-c5b1-49fe-9598-cd146d31a424 tempest-VolumesGetTest-103301033 None] Volume b9941c26-4f32-4343-aac7-caeb19e30d79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9941c26-4f32-4343-aac7-caeb19e30d79', 'volume_size': 1} Apr 16 15:13:39 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-902f0607-c5b1-49fe-9598-cd146d31a424 tempest-VolumesGetTest-103301033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:13:39 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-902f0607-c5b1-49fe-9598-cd146d31a424 tempest-VolumesGetTest-103301033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:13:39 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-902f0607-c5b1-49fe-9598-cd146d31a424 tempest-VolumesGetTest-103301033 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:13:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1974315276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9941c26-4f32-4343-aac7-caeb19e30d79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59cd21a5b90d47d2ab3ff50fc013f013',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:13:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:13:40Z,use_quota=True,user_id='6ff61eaacb734cf3b892088433167105',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)}" {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 15:13:39 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-902f0607-c5b1-49fe-9598-cd146d31a424 tempest-VolumesGetTest-103301033 None] Creating volume b9941c26-4f32-4343-aac7-caeb19e30d79 {{(pid=82756) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 15:13:39 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-902f0607-c5b1-49fe-9598-cd146d31a424 tempest-VolumesGetTest-103301033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:13:39 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-902f0607-c5b1-49fe-9598-cd146d31a424 tempest-VolumesGetTest-103301033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:13:39 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-902f0607-c5b1-49fe-9598-cd146d31a424 tempest-VolumesGetTest-103301033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:13:39 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-902f0607-c5b1-49fe-9598-cd146d31a424 tempest-VolumesGetTest-103301033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:13:39 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-902f0607-c5b1-49fe-9598-cd146d31a424 tempest-VolumesGetTest-103301033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:13:39 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-902f0607-c5b1-49fe-9598-cd146d31a424 tempest-VolumesGetTest-103301033 None] Selected osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 as target Quobyte volume. {{(pid=82756) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 15:13:39 devstack cinder-volume[82756]: INFO cinder.volume.drivers.remotefs [None req-902f0607-c5b1-49fe-9598-cd146d31a424 tempest-VolumesGetTest-103301033 None] casted to osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 Apr 16 15:13:39 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-902f0607-c5b1-49fe-9598-cd146d31a424 tempest-VolumesGetTest-103301033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b9941c26-4f32-4343-aac7-caeb19e30d79 1073741824 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:13:39 devstack sudo[90057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b9941c26-4f32-4343-aac7-caeb19e30d79 1073741824 Apr 16 15:13:39 devstack sudo[90057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:13:39 devstack sudo[90054]: pam_unix(sudo:session): session closed for user root Apr 16 15:13:39 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-3f4e4450-11ce-4934-9dbb-e64d5549bb44 tempest-VolumesGetTest-103301033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.531s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:13:39 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-3f4e4450-11ce-4934-9dbb-e64d5549bb44 tempest-VolumesGetTest-103301033 None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:13:39 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-3f4e4450-11ce-4934-9dbb-e64d5549bb44 tempest-VolumesGetTest-103301033 None] Deleted volume successfully. Apr 16 15:13:39 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-3f4e4450-11ce-4934-9dbb-e64d5549bb44 tempest-VolumesGetTest-103301033 None] Lock "cinder-b894ef68-917e-4d4b-ae5c-9d349c81ee4b-delete_volume" released by "delete_volume" :: held 1.557s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:13:40 devstack sudo[90057]: pam_unix(sudo:session): session closed for user root Apr 16 15:13:40 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-902f0607-c5b1-49fe-9598-cd146d31a424 tempest-VolumesGetTest-103301033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b9941c26-4f32-4343-aac7-caeb19e30d79 1073741824" returned: 0 in 0.536s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:13:40 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-902f0607-c5b1-49fe-9598-cd146d31a424 tempest-VolumesGetTest-103301033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b9941c26-4f32-4343-aac7-caeb19e30d79 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:13:40 devstack sudo[90062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b9941c26-4f32-4343-aac7-caeb19e30d79 Apr 16 15:13:40 devstack sudo[90062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:13:40 devstack sudo[90062]: pam_unix(sudo:session): session closed for user root Apr 16 15:13:40 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-902f0607-c5b1-49fe-9598-cd146d31a424 tempest-VolumesGetTest-103301033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b9941c26-4f32-4343-aac7-caeb19e30d79" returned: 0 in 0.397s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:13:40 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-902f0607-c5b1-49fe-9598-cd146d31a424 tempest-VolumesGetTest-103301033 None] <== create_volume: return (956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'} {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 15:13:40 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-902f0607-c5b1-49fe-9598-cd146d31a424 tempest-VolumesGetTest-103301033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.959s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:13:40 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-902f0607-c5b1-49fe-9598-cd146d31a424 tempest-VolumesGetTest-103301033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f61ac1b0-8e5f-42ae-95e3-4dd61ef0c8be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9941c26-4f32-4343-aac7-caeb19e30d79', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:13:40 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-902f0607-c5b1-49fe-9598-cd146d31a424 tempest-VolumesGetTest-103301033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46e2585f-3926-46db-98ed-afd06025dde3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:13:40 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-902f0607-c5b1-49fe-9598-cd146d31a424 tempest-VolumesGetTest-103301033 None] Volume volume-b9941c26-4f32-4343-aac7-caeb19e30d79 (b9941c26-4f32-4343-aac7-caeb19e30d79): created successfully Apr 16 15:13:40 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-902f0607-c5b1-49fe-9598-cd146d31a424 tempest-VolumesGetTest-103301033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46e2585f-3926-46db-98ed-afd06025dde3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:13:40 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-902f0607-c5b1-49fe-9598-cd146d31a424 tempest-VolumesGetTest-103301033 None] Flow 'volume_create_manager' (95f80fac-9093-47a7-a79a-5df1c8fd1f28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:13:40 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-902f0607-c5b1-49fe-9598-cd146d31a424 tempest-VolumesGetTest-103301033 None] Created volume successfully. Apr 16 15:13:41 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [None req-63f66760-bac0-4308-8666-babd4df29e3d tempest-VolumesGetTest-103301033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82756) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 15:13:41 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-63f66760-bac0-4308-8666-babd4df29e3d tempest-VolumesGetTest-103301033 None] Flow 'volume_create_manager' (b5174d58-34cc-40e2-9a24-77b874191d7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:13:41 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-63f66760-bac0-4308-8666-babd4df29e3d tempest-VolumesGetTest-103301033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f31cb66c-b481-447c-9e2b-b1d16978e115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:13:42 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-63f66760-bac0-4308-8666-babd4df29e3d tempest-VolumesGetTest-103301033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f31cb66c-b481-447c-9e2b-b1d16978e115) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:13:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-914632733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e083bc68-6856-4e16-bf79-7121cbe284bc,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='59cd21a5b90d47d2ab3ff50fc013f013',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:13:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=b9941c26-4f32-4343-aac7-caeb19e30d79,status='creating',terminated_at=None,updated_at=2026-04-16T13:13:42Z,use_quota=True,user_id='6ff61eaacb734cf3b892088433167105',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:13:42 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-63f66760-bac0-4308-8666-babd4df29e3d tempest-VolumesGetTest-103301033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a12fb962-7119-40f6-b118-88b3f86a4630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:13:42 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-63f66760-bac0-4308-8666-babd4df29e3d tempest-VolumesGetTest-103301033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a12fb962-7119-40f6-b118-88b3f86a4630) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:13:42 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-63f66760-bac0-4308-8666-babd4df29e3d tempest-VolumesGetTest-103301033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfa99374-8f45-4b7e-93fb-e7cc10832e39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:13:42 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-63f66760-bac0-4308-8666-babd4df29e3d tempest-VolumesGetTest-103301033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfa99374-8f45-4b7e-93fb-e7cc10832e39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'e083bc68-6856-4e16-bf79-7121cbe284bc', 'volume_name': 'volume-e083bc68-6856-4e16-bf79-7121cbe284bc', 'volume_size': 1, 'source_volid': 'b9941c26-4f32-4343-aac7-caeb19e30d79', 'source_volstatus': 'available'}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:13:42 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-63f66760-bac0-4308-8666-babd4df29e3d tempest-VolumesGetTest-103301033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86d01f1a-a9d3-4789-8ff6-6dfa93722014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:13:42 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-63f66760-bac0-4308-8666-babd4df29e3d tempest-VolumesGetTest-103301033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86d01f1a-a9d3-4789-8ff6-6dfa93722014) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:13:42 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-63f66760-bac0-4308-8666-babd4df29e3d tempest-VolumesGetTest-103301033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f79bc72e-6769-42fb-b051-073ca8fe17f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:13:42 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-63f66760-bac0-4308-8666-babd4df29e3d tempest-VolumesGetTest-103301033 None] Volume e083bc68-6856-4e16-bf79-7121cbe284bc: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-e083bc68-6856-4e16-bf79-7121cbe284bc', 'volume_size': 1, 'source_volid': 'b9941c26-4f32-4343-aac7-caeb19e30d79', 'source_volstatus': 'available'} Apr 16 15:13:42 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-63f66760-bac0-4308-8666-babd4df29e3d tempest-VolumesGetTest-103301033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:13:42 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-63f66760-bac0-4308-8666-babd4df29e3d tempest-VolumesGetTest-103301033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:13:42 devstack cinder-volume[82756]: INFO cinder.volume.drivers.remotefs [None req-63f66760-bac0-4308-8666-babd4df29e3d tempest-VolumesGetTest-103301033 None] Cloning volume b9941c26-4f32-4343-aac7-caeb19e30d79 to volume e083bc68-6856-4e16-bf79-7121cbe284bc Apr 16 15:13:42 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-63f66760-bac0-4308-8666-babd4df29e3d tempest-VolumesGetTest-103301033 None] Creating offline snapshot 06d7c18a-4212-4290-85aa-37a54bdf1f55 of volume b9941c26-4f32-4343-aac7-caeb19e30d79 {{(pid=82756) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 16 15:13:42 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[5619b158-5bb4-4297-b3fa-0d23bb4ed90f]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:13:42 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-63f66760-bac0-4308-8666-babd4df29e3d tempest-VolumesGetTest-103301033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b9941c26-4f32-4343-aac7-caeb19e30d79 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:13:42 devstack sudo[90065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b9941c26-4f32-4343-aac7-caeb19e30d79 Apr 16 15:13:42 devstack sudo[90065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:13:42 devstack sudo[90065]: pam_unix(sudo:session): session closed for user root Apr 16 15:13:42 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-63f66760-bac0-4308-8666-babd4df29e3d tempest-VolumesGetTest-103301033 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b9941c26-4f32-4343-aac7-caeb19e30d79" returned: 0 in 0.456s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:13:42 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-63f66760-bac0-4308-8666-babd4df29e3d tempest-VolumesGetTest-103301033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b9941c26-4f32-4343-aac7-caeb19e30d79,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b9941c26-4f32-4343-aac7-caeb19e30d79.06d7c18a-4212-4290-85aa-37a54bdf1f55 1G {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:13:42 devstack sudo[90070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b9941c26-4f32-4343-aac7-caeb19e30d79,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b9941c26-4f32-4343-aac7-caeb19e30d79.06d7c18a-4212-4290-85aa-37a54bdf1f55 1G Apr 16 15:13:42 devstack sudo[90070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:13:43 devstack sudo[90070]: pam_unix(sudo:session): session closed for user root Apr 16 15:13:43 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-63f66760-bac0-4308-8666-babd4df29e3d tempest-VolumesGetTest-103301033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b9941c26-4f32-4343-aac7-caeb19e30d79,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b9941c26-4f32-4343-aac7-caeb19e30d79.06d7c18a-4212-4290-85aa-37a54bdf1f55 1G" returned: 0 in 0.470s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:13:43 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-63f66760-bac0-4308-8666-babd4df29e3d tempest-VolumesGetTest-103301033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9941c26-4f32-4343-aac7-caeb19e30d79 -F qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b9941c26-4f32-4343-aac7-caeb19e30d79.06d7c18a-4212-4290-85aa-37a54bdf1f55 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:13:43 devstack sudo[90075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9941c26-4f32-4343-aac7-caeb19e30d79 -F qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b9941c26-4f32-4343-aac7-caeb19e30d79.06d7c18a-4212-4290-85aa-37a54bdf1f55 Apr 16 15:13:43 devstack sudo[90075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:13:43 devstack sudo[90075]: pam_unix(sudo:session): session closed for user root Apr 16 15:13:43 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-63f66760-bac0-4308-8666-babd4df29e3d tempest-VolumesGetTest-103301033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9941c26-4f32-4343-aac7-caeb19e30d79 -F qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b9941c26-4f32-4343-aac7-caeb19e30d79.06d7c18a-4212-4290-85aa-37a54bdf1f55" returned: 0 in 0.455s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:13:43 devstack cinder-volume[82756]: WARNING cinder.volume.drivers.remotefs [None req-63f66760-bac0-4308-8666-babd4df29e3d tempest-VolumesGetTest-103301033 None] /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b9941c26-4f32-4343-aac7-caeb19e30d79.06d7c18a-4212-4290-85aa-37a54bdf1f55 is being set with open permissions: ugo+rw Apr 16 15:13:43 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-63f66760-bac0-4308-8666-babd4df29e3d tempest-VolumesGetTest-103301033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b9941c26-4f32-4343-aac7-caeb19e30d79.06d7c18a-4212-4290-85aa-37a54bdf1f55 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:13:43 devstack sudo[90081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b9941c26-4f32-4343-aac7-caeb19e30d79.06d7c18a-4212-4290-85aa-37a54bdf1f55 Apr 16 15:13:43 devstack sudo[90081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:13:43 devstack sudo[90081]: pam_unix(sudo:session): session closed for user root Apr 16 15:13:43 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-63f66760-bac0-4308-8666-babd4df29e3d tempest-VolumesGetTest-103301033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b9941c26-4f32-4343-aac7-caeb19e30d79.06d7c18a-4212-4290-85aa-37a54bdf1f55" returned: 0 in 0.446s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:13:43 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-63f66760-bac0-4308-8666-babd4df29e3d tempest-VolumesGetTest-103301033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b9941c26-4f32-4343-aac7-caeb19e30d79.info {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:13:44 devstack sudo[90084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b9941c26-4f32-4343-aac7-caeb19e30d79.info Apr 16 15:13:44 devstack sudo[90084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:13:44 devstack sudo[90084]: pam_unix(sudo:session): session closed for user root Apr 16 15:13:44 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-63f66760-bac0-4308-8666-babd4df29e3d tempest-VolumesGetTest-103301033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b9941c26-4f32-4343-aac7-caeb19e30d79.info" returned: 0 in 0.425s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:13:44 devstack cinder-volume[82756]: WARNING cinder.volume.drivers.remotefs [None req-63f66760-bac0-4308-8666-babd4df29e3d tempest-VolumesGetTest-103301033 None] /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b9941c26-4f32-4343-aac7-caeb19e30d79.info is being set with open permissions: ugo+rw Apr 16 15:13:44 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-63f66760-bac0-4308-8666-babd4df29e3d tempest-VolumesGetTest-103301033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b9941c26-4f32-4343-aac7-caeb19e30d79.info {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:13:44 devstack sudo[90087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b9941c26-4f32-4343-aac7-caeb19e30d79.info Apr 16 15:13:44 devstack sudo[90087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:13:44 devstack sudo[90087]: pam_unix(sudo:session): session closed for user root Apr 16 15:13:44 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-63f66760-bac0-4308-8666-babd4df29e3d tempest-VolumesGetTest-103301033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b9941c26-4f32-4343-aac7-caeb19e30d79.info" returned: 0 in 0.407s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:13:44 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-63f66760-bac0-4308-8666-babd4df29e3d tempest-VolumesGetTest-103301033 None] Acquiring lock "cinder-quobyte-e083bc68-6856-4e16-bf79-7121cbe284bc" by "_copy_volume_from_snapshot" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:13:44 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-63f66760-bac0-4308-8666-babd4df29e3d tempest-VolumesGetTest-103301033 None] Lock "cinder-quobyte-e083bc68-6856-4e16-bf79-7121cbe284bc" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:13:44 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-63f66760-bac0-4308-8666-babd4df29e3d tempest-VolumesGetTest-103301033 None] snapshot: 06d7c18a-4212-4290-85aa-37a54bdf1f55, volume: e083bc68-6856-4e16-bf79-7121cbe284bc, {{(pid=82756) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 16 15:13:44 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-63f66760-bac0-4308-8666-babd4df29e3d tempest-VolumesGetTest-103301033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:13:44 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-63f66760-bac0-4308-8666-babd4df29e3d tempest-VolumesGetTest-103301033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:13:44 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-63f66760-bac0-4308-8666-babd4df29e3d tempest-VolumesGetTest-103301033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:13:44 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-63f66760-bac0-4308-8666-babd4df29e3d tempest-VolumesGetTest-103301033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:13:44 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-63f66760-bac0-4308-8666-babd4df29e3d tempest-VolumesGetTest-103301033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:13:44 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[72ba63a1-7f6b-4ceb-8d4b-1f63726e34b3]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:13:44 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-63f66760-bac0-4308-8666-babd4df29e3d tempest-VolumesGetTest-103301033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b9941c26-4f32-4343-aac7-caeb19e30d79.06d7c18a-4212-4290-85aa-37a54bdf1f55 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:13:44 devstack sudo[90090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b9941c26-4f32-4343-aac7-caeb19e30d79.06d7c18a-4212-4290-85aa-37a54bdf1f55 Apr 16 15:13:44 devstack sudo[90090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:13:45 devstack sudo[90090]: pam_unix(sudo:session): session closed for user root Apr 16 15:13:45 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-63f66760-bac0-4308-8666-babd4df29e3d tempest-VolumesGetTest-103301033 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b9941c26-4f32-4343-aac7-caeb19e30d79.06d7c18a-4212-4290-85aa-37a54bdf1f55" returned: 0 in 0.449s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:13:45 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-63f66760-bac0-4308-8666-babd4df29e3d tempest-VolumesGetTest-103301033 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b9941c26-4f32-4343-aac7-caeb19e30d79(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82756) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 15:13:45 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-63f66760-bac0-4308-8666-babd4df29e3d tempest-VolumesGetTest-103301033 None] will copy from snapshot at /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b9941c26-4f32-4343-aac7-caeb19e30d79 {{(pid=82756) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 16 15:13:45 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-63f66760-bac0-4308-8666-babd4df29e3d tempest-VolumesGetTest-103301033 None] Creating direct copy from snapshot {{(pid=82756) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 16 15:13:45 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[76eb6bc1-37a7-4843-ab26-7a0d03cc6d83]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:13:45 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-63f66760-bac0-4308-8666-babd4df29e3d tempest-VolumesGetTest-103301033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b9941c26-4f32-4343-aac7-caeb19e30d79 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:13:45 devstack sudo[90095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b9941c26-4f32-4343-aac7-caeb19e30d79 Apr 16 15:13:45 devstack sudo[90095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:13:45 devstack sudo[90095]: pam_unix(sudo:session): session closed for user root Apr 16 15:13:45 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-63f66760-bac0-4308-8666-babd4df29e3d tempest-VolumesGetTest-103301033 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b9941c26-4f32-4343-aac7-caeb19e30d79" returned: 0 in 0.452s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:13:45 devstack cinder-volume[82756]: DEBUG cinder.utils [None req-63f66760-bac0-4308-8666-babd4df29e3d tempest-VolumesGetTest-103301033 None] Path /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-e083bc68-6856-4e16-bf79-7121cbe284bc not found in is_blk_device check {{(pid=82756) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 16 15:13:45 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-63f66760-bac0-4308-8666-babd4df29e3d tempest-VolumesGetTest-103301033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b9941c26-4f32-4343-aac7-caeb19e30d79 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-e083bc68-6856-4e16-bf79-7121cbe284bc {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:13:45 devstack sudo[90100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b9941c26-4f32-4343-aac7-caeb19e30d79 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-e083bc68-6856-4e16-bf79-7121cbe284bc Apr 16 15:13:45 devstack sudo[90100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:13:47 devstack sudo[90100]: pam_unix(sudo:session): session closed for user root Apr 16 15:13:47 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-63f66760-bac0-4308-8666-babd4df29e3d tempest-VolumesGetTest-103301033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b9941c26-4f32-4343-aac7-caeb19e30d79 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-e083bc68-6856-4e16-bf79-7121cbe284bc" returned: 0 in 2.065s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:13:47 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[575d6bac-6b03-4bcd-9df3-c43749a39569]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:13:47 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-63f66760-bac0-4308-8666-babd4df29e3d tempest-VolumesGetTest-103301033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b9941c26-4f32-4343-aac7-caeb19e30d79 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:13:47 devstack sudo[90112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b9941c26-4f32-4343-aac7-caeb19e30d79 Apr 16 15:13:47 devstack sudo[90112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:13:48 devstack sudo[90112]: pam_unix(sudo:session): session closed for user root Apr 16 15:13:48 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-63f66760-bac0-4308-8666-babd4df29e3d tempest-VolumesGetTest-103301033 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b9941c26-4f32-4343-aac7-caeb19e30d79" returned: 0 in 0.653s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:13:48 devstack cinder-volume[82756]: DEBUG cinder.image.image_utils [None req-63f66760-bac0-4308-8666-babd4df29e3d tempest-VolumesGetTest-103301033 None] Image conversion details: src /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b9941c26-4f32-4343-aac7-caeb19e30d79, size 1024.00 MB, duration 2.07 sec, destination /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-e083bc68-6856-4e16-bf79-7121cbe284bc {{(pid=82756) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 15:13:48 devstack cinder-volume[82756]: INFO cinder.image.image_utils [None req-63f66760-bac0-4308-8666-babd4df29e3d tempest-VolumesGetTest-103301033 None] Converted 1024.00 MB image at 495.63 MB/s Apr 16 15:13:48 devstack cinder-volume[82756]: WARNING cinder.volume.drivers.remotefs [None req-63f66760-bac0-4308-8666-babd4df29e3d tempest-VolumesGetTest-103301033 None] /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-e083bc68-6856-4e16-bf79-7121cbe284bc is being set with open permissions: ugo+rw Apr 16 15:13:48 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-63f66760-bac0-4308-8666-babd4df29e3d tempest-VolumesGetTest-103301033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-e083bc68-6856-4e16-bf79-7121cbe284bc {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:13:48 devstack sudo[90117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-e083bc68-6856-4e16-bf79-7121cbe284bc Apr 16 15:13:48 devstack sudo[90117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:13:48 devstack sudo[90117]: pam_unix(sudo:session): session closed for user root Apr 16 15:13:48 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-63f66760-bac0-4308-8666-babd4df29e3d tempest-VolumesGetTest-103301033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-e083bc68-6856-4e16-bf79-7121cbe284bc" returned: 0 in 0.464s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:13:48 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-63f66760-bac0-4308-8666-babd4df29e3d tempest-VolumesGetTest-103301033 None] Lock "cinder-quobyte-e083bc68-6856-4e16-bf79-7121cbe284bc" released by "_copy_volume_from_snapshot" :: held 4.123s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:13:48 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-63f66760-bac0-4308-8666-babd4df29e3d tempest-VolumesGetTest-103301033 None] Acquiring lock "cinder-quobyte-06d7c18a-4212-4290-85aa-37a54bdf1f55" by "_delete_snapshot" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:13:48 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-63f66760-bac0-4308-8666-babd4df29e3d tempest-VolumesGetTest-103301033 None] Lock "cinder-quobyte-06d7c18a-4212-4290-85aa-37a54bdf1f55" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:13:48 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-63f66760-bac0-4308-8666-babd4df29e3d tempest-VolumesGetTest-103301033 None] Deleting offline snapshot 06d7c18a-4212-4290-85aa-37a54bdf1f55 of volume b9941c26-4f32-4343-aac7-caeb19e30d79 {{(pid=82756) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 15:13:48 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-63f66760-bac0-4308-8666-babd4df29e3d tempest-VolumesGetTest-103301033 None] snapshot_file for this snap is: volume-b9941c26-4f32-4343-aac7-caeb19e30d79.06d7c18a-4212-4290-85aa-37a54bdf1f55 {{(pid=82756) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 15:13:48 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[076be7ee-cc3a-455a-ba18-10c88797ed95]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:13:48 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-63f66760-bac0-4308-8666-babd4df29e3d tempest-VolumesGetTest-103301033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b9941c26-4f32-4343-aac7-caeb19e30d79.06d7c18a-4212-4290-85aa-37a54bdf1f55 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:13:49 devstack sudo[90120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b9941c26-4f32-4343-aac7-caeb19e30d79.06d7c18a-4212-4290-85aa-37a54bdf1f55 Apr 16 15:13:49 devstack sudo[90120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:13:49 devstack sudo[90120]: pam_unix(sudo:session): session closed for user root Apr 16 15:13:49 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-63f66760-bac0-4308-8666-babd4df29e3d tempest-VolumesGetTest-103301033 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b9941c26-4f32-4343-aac7-caeb19e30d79.06d7c18a-4212-4290-85aa-37a54bdf1f55" returned: 0 in 0.510s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:13:49 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-63f66760-bac0-4308-8666-babd4df29e3d tempest-VolumesGetTest-103301033 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b9941c26-4f32-4343-aac7-caeb19e30d79(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82756) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 15:13:49 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc723d1a-3591-4bcf-88e9-eb294f2c6c8d]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:13:49 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-63f66760-bac0-4308-8666-babd4df29e3d tempest-VolumesGetTest-103301033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b9941c26-4f32-4343-aac7-caeb19e30d79 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:13:49 devstack sudo[90125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b9941c26-4f32-4343-aac7-caeb19e30d79 Apr 16 15:13:49 devstack sudo[90125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:13:50 devstack sudo[90125]: pam_unix(sudo:session): session closed for user root Apr 16 15:13:50 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-63f66760-bac0-4308-8666-babd4df29e3d tempest-VolumesGetTest-103301033 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b9941c26-4f32-4343-aac7-caeb19e30d79" returned: 0 in 0.544s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:13:50 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-63f66760-bac0-4308-8666-babd4df29e3d tempest-VolumesGetTest-103301033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b9941c26-4f32-4343-aac7-caeb19e30d79.06d7c18a-4212-4290-85aa-37a54bdf1f55 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:13:50 devstack sudo[90130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b9941c26-4f32-4343-aac7-caeb19e30d79.06d7c18a-4212-4290-85aa-37a54bdf1f55 Apr 16 15:13:50 devstack sudo[90130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:13:50 devstack sudo[90130]: pam_unix(sudo:session): session closed for user root Apr 16 15:13:50 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-63f66760-bac0-4308-8666-babd4df29e3d tempest-VolumesGetTest-103301033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b9941c26-4f32-4343-aac7-caeb19e30d79.06d7c18a-4212-4290-85aa-37a54bdf1f55" returned: 0 in 0.485s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:13:50 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-63f66760-bac0-4308-8666-babd4df29e3d tempest-VolumesGetTest-103301033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b9941c26-4f32-4343-aac7-caeb19e30d79.06d7c18a-4212-4290-85aa-37a54bdf1f55 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:13:50 devstack sudo[90135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b9941c26-4f32-4343-aac7-caeb19e30d79.06d7c18a-4212-4290-85aa-37a54bdf1f55 Apr 16 15:13:50 devstack sudo[90135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:13:50 devstack sudo[90135]: pam_unix(sudo:session): session closed for user root Apr 16 15:13:50 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-63f66760-bac0-4308-8666-babd4df29e3d tempest-VolumesGetTest-103301033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b9941c26-4f32-4343-aac7-caeb19e30d79.06d7c18a-4212-4290-85aa-37a54bdf1f55" returned: 0 in 0.398s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:13:50 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-63f66760-bac0-4308-8666-babd4df29e3d tempest-VolumesGetTest-103301033 None] Lock "cinder-quobyte-06d7c18a-4212-4290-85aa-37a54bdf1f55" released by "_delete_snapshot" :: held 1.982s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:13:50 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-63f66760-bac0-4308-8666-babd4df29e3d tempest-VolumesGetTest-103301033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 8.868s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:13:50 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-63f66760-bac0-4308-8666-babd4df29e3d tempest-VolumesGetTest-103301033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f79bc72e-6769-42fb-b051-073ca8fe17f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e083bc68-6856-4e16-bf79-7121cbe284bc', 'volume_size': 1, 'source_volid': 'b9941c26-4f32-4343-aac7-caeb19e30d79', 'source_volstatus': 'available'}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:13:50 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-63f66760-bac0-4308-8666-babd4df29e3d tempest-VolumesGetTest-103301033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (290ca589-3042-41a1-b18b-dabf41a823c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:13:50 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-63f66760-bac0-4308-8666-babd4df29e3d tempest-VolumesGetTest-103301033 None] Volume volume-e083bc68-6856-4e16-bf79-7121cbe284bc (e083bc68-6856-4e16-bf79-7121cbe284bc): created successfully Apr 16 15:13:50 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-63f66760-bac0-4308-8666-babd4df29e3d tempest-VolumesGetTest-103301033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (290ca589-3042-41a1-b18b-dabf41a823c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:13:50 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-63f66760-bac0-4308-8666-babd4df29e3d tempest-VolumesGetTest-103301033 None] Flow 'volume_create_manager' (b5174d58-34cc-40e2-9a24-77b874191d7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:13:51 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-63f66760-bac0-4308-8666-babd4df29e3d tempest-VolumesGetTest-103301033 None] Created volume successfully. Apr 16 15:13:51 devstack cinder-volume[82756]: DEBUG oslo_service.periodic_task [None req-9570f02d-5ef9-412b-993f-520a9e5bfa81 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82756) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 16 15:13:51 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-9570f02d-5ef9-412b-993f-520a9e5bfa81 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:13:51 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-9570f02d-5ef9-412b-993f-520a9e5bfa81 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:13:51 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-9570f02d-5ef9-412b-993f-520a9e5bfa81 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:13:51 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-9570f02d-5ef9-412b-993f-520a9e5bfa81 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:13:51 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-9570f02d-5ef9-412b-993f-520a9e5bfa81 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:13:51 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-9570f02d-5ef9-412b-993f-520a9e5bfa81 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:13:51 devstack sudo[90138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:13:51 devstack sudo[90138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:13:51 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [None req-18af3f9a-a2bb-491e-9cc1-ccb77f60d6fc tempest-VolumesGetTest-103301033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82756) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 15:13:51 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-18af3f9a-a2bb-491e-9cc1-ccb77f60d6fc tempest-VolumesGetTest-103301033 None] Flow 'volume_create_manager' (e51634f5-a646-47bb-824c-03c28e1b9610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:13:51 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-18af3f9a-a2bb-491e-9cc1-ccb77f60d6fc tempest-VolumesGetTest-103301033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8a0a80a-4842-4d12-8123-3369239632db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:13:51 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-18af3f9a-a2bb-491e-9cc1-ccb77f60d6fc tempest-VolumesGetTest-103301033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8a0a80a-4842-4d12-8123-3369239632db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:13:52Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-863807983',display_name='tempest-VolumesGetTest-Volume-1941779910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd072b22-432a-4d18-8be0-317a03c4363e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59cd21a5b90d47d2ab3ff50fc013f013',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:13:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:13:52Z,use_quota=True,user_id='6ff61eaacb734cf3b892088433167105',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:13:51 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-18af3f9a-a2bb-491e-9cc1-ccb77f60d6fc tempest-VolumesGetTest-103301033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83478053-66c2-4977-b918-a5939b51105f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:13:51 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-18af3f9a-a2bb-491e-9cc1-ccb77f60d6fc tempest-VolumesGetTest-103301033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83478053-66c2-4977-b918-a5939b51105f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:13:51 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-18af3f9a-a2bb-491e-9cc1-ccb77f60d6fc tempest-VolumesGetTest-103301033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20000023-a72c-4346-a47c-4054cb3dca30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:13:51 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-18af3f9a-a2bb-491e-9cc1-ccb77f60d6fc tempest-VolumesGetTest-103301033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20000023-a72c-4346-a47c-4054cb3dca30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd072b22-432a-4d18-8be0-317a03c4363e', 'volume_name': 'volume-bd072b22-432a-4d18-8be0-317a03c4363e', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:13:51 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-18af3f9a-a2bb-491e-9cc1-ccb77f60d6fc tempest-VolumesGetTest-103301033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3355c264-8fd4-4a22-a411-b9de73550d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:13:51 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-18af3f9a-a2bb-491e-9cc1-ccb77f60d6fc tempest-VolumesGetTest-103301033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3355c264-8fd4-4a22-a411-b9de73550d66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:13:51 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-18af3f9a-a2bb-491e-9cc1-ccb77f60d6fc tempest-VolumesGetTest-103301033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f133840-c998-4b35-bc63-a124362418fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:13:51 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-18af3f9a-a2bb-491e-9cc1-ccb77f60d6fc tempest-VolumesGetTest-103301033 None] Volume bd072b22-432a-4d18-8be0-317a03c4363e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd072b22-432a-4d18-8be0-317a03c4363e', 'volume_size': 1} Apr 16 15:13:51 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-18af3f9a-a2bb-491e-9cc1-ccb77f60d6fc tempest-VolumesGetTest-103301033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:13:51 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-18af3f9a-a2bb-491e-9cc1-ccb77f60d6fc tempest-VolumesGetTest-103301033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:13:51 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-18af3f9a-a2bb-491e-9cc1-ccb77f60d6fc tempest-VolumesGetTest-103301033 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:13:52Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-863807983',display_name='tempest-VolumesGetTest-Volume-1941779910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd072b22-432a-4d18-8be0-317a03c4363e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59cd21a5b90d47d2ab3ff50fc013f013',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:13:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:13:52Z,use_quota=True,user_id='6ff61eaacb734cf3b892088433167105',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)}" {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 15:13:51 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-18af3f9a-a2bb-491e-9cc1-ccb77f60d6fc tempest-VolumesGetTest-103301033 None] Creating volume bd072b22-432a-4d18-8be0-317a03c4363e {{(pid=82756) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 15:13:51 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-18af3f9a-a2bb-491e-9cc1-ccb77f60d6fc tempest-VolumesGetTest-103301033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:13:51 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-18af3f9a-a2bb-491e-9cc1-ccb77f60d6fc tempest-VolumesGetTest-103301033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:13:51 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-18af3f9a-a2bb-491e-9cc1-ccb77f60d6fc tempest-VolumesGetTest-103301033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:13:51 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-18af3f9a-a2bb-491e-9cc1-ccb77f60d6fc tempest-VolumesGetTest-103301033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:13:51 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-18af3f9a-a2bb-491e-9cc1-ccb77f60d6fc tempest-VolumesGetTest-103301033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:13:51 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-18af3f9a-a2bb-491e-9cc1-ccb77f60d6fc tempest-VolumesGetTest-103301033 None] Selected osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 as target Quobyte volume. {{(pid=82756) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 15:13:51 devstack cinder-volume[82756]: INFO cinder.volume.drivers.remotefs [None req-18af3f9a-a2bb-491e-9cc1-ccb77f60d6fc tempest-VolumesGetTest-103301033 None] casted to osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 Apr 16 15:13:51 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-18af3f9a-a2bb-491e-9cc1-ccb77f60d6fc tempest-VolumesGetTest-103301033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-bd072b22-432a-4d18-8be0-317a03c4363e 1073741824 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:13:51 devstack sudo[90140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-bd072b22-432a-4d18-8be0-317a03c4363e 1073741824 Apr 16 15:13:51 devstack sudo[90140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:13:52 devstack sudo[90138]: pam_unix(sudo:session): session closed for user root Apr 16 15:13:52 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-9570f02d-5ef9-412b-993f-520a9e5bfa81 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.408s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:13:52 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-9570f02d-5ef9-412b-993f-520a9e5bfa81 None None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:13:52 devstack sudo[90140]: pam_unix(sudo:session): session closed for user root Apr 16 15:13:52 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-18af3f9a-a2bb-491e-9cc1-ccb77f60d6fc tempest-VolumesGetTest-103301033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-bd072b22-432a-4d18-8be0-317a03c4363e 1073741824" returned: 0 in 0.496s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:13:52 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-18af3f9a-a2bb-491e-9cc1-ccb77f60d6fc tempest-VolumesGetTest-103301033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-bd072b22-432a-4d18-8be0-317a03c4363e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:13:52 devstack sudo[90146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-bd072b22-432a-4d18-8be0-317a03c4363e Apr 16 15:13:52 devstack sudo[90146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:13:52 devstack sudo[90146]: pam_unix(sudo:session): session closed for user root Apr 16 15:13:52 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-18af3f9a-a2bb-491e-9cc1-ccb77f60d6fc tempest-VolumesGetTest-103301033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-bd072b22-432a-4d18-8be0-317a03c4363e" returned: 0 in 0.439s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:13:52 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-18af3f9a-a2bb-491e-9cc1-ccb77f60d6fc tempest-VolumesGetTest-103301033 None] <== create_volume: return (959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'} {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 15:13:52 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-18af3f9a-a2bb-491e-9cc1-ccb77f60d6fc tempest-VolumesGetTest-103301033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.961s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:13:52 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-18af3f9a-a2bb-491e-9cc1-ccb77f60d6fc tempest-VolumesGetTest-103301033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f133840-c998-4b35-bc63-a124362418fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd072b22-432a-4d18-8be0-317a03c4363e', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:13:52 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-18af3f9a-a2bb-491e-9cc1-ccb77f60d6fc tempest-VolumesGetTest-103301033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d82fb9d-5f37-4ac7-90e0-37a12e069f1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:13:52 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-18af3f9a-a2bb-491e-9cc1-ccb77f60d6fc tempest-VolumesGetTest-103301033 None] Volume volume-bd072b22-432a-4d18-8be0-317a03c4363e (bd072b22-432a-4d18-8be0-317a03c4363e): created successfully Apr 16 15:13:52 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-18af3f9a-a2bb-491e-9cc1-ccb77f60d6fc tempest-VolumesGetTest-103301033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d82fb9d-5f37-4ac7-90e0-37a12e069f1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:13:52 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-18af3f9a-a2bb-491e-9cc1-ccb77f60d6fc tempest-VolumesGetTest-103301033 None] Flow 'volume_create_manager' (e51634f5-a646-47bb-824c-03c28e1b9610) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:13:52 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-18af3f9a-a2bb-491e-9cc1-ccb77f60d6fc tempest-VolumesGetTest-103301033 None] Created volume successfully. Apr 16 15:13:54 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-d6537b1c-2893-4be5-b46e-7f70acedfd6c tempest-VolumesGetTest-103301033 None] Acquiring lock "cinder-bd072b22-432a-4d18-8be0-317a03c4363e-delete_volume" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:13:54 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-d6537b1c-2893-4be5-b46e-7f70acedfd6c tempest-VolumesGetTest-103301033 None] Lock "cinder-bd072b22-432a-4d18-8be0-317a03c4363e-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:13:54 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-d6537b1c-2893-4be5-b46e-7f70acedfd6c tempest-VolumesGetTest-103301033 None] Acquiring lock "cinder-quobyte-bd072b22-432a-4d18-8be0-317a03c4363e" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:13:54 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-d6537b1c-2893-4be5-b46e-7f70acedfd6c tempest-VolumesGetTest-103301033 None] Lock "cinder-quobyte-bd072b22-432a-4d18-8be0-317a03c4363e" acquired by "delete_volume" :: waited 0.008s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:13:54 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f0787e0-ac0f-4f20-aa0d-469731c9313f]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:13:54 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-d6537b1c-2893-4be5-b46e-7f70acedfd6c tempest-VolumesGetTest-103301033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-bd072b22-432a-4d18-8be0-317a03c4363e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:13:54 devstack sudo[90150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-bd072b22-432a-4d18-8be0-317a03c4363e Apr 16 15:13:54 devstack sudo[90150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:13:54 devstack sudo[90150]: pam_unix(sudo:session): session closed for user root Apr 16 15:13:54 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-d6537b1c-2893-4be5-b46e-7f70acedfd6c tempest-VolumesGetTest-103301033 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-bd072b22-432a-4d18-8be0-317a03c4363e" returned: 0 in 0.449s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:13:54 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-d6537b1c-2893-4be5-b46e-7f70acedfd6c tempest-VolumesGetTest-103301033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-bd072b22-432a-4d18-8be0-317a03c4363e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:13:54 devstack sudo[90155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-bd072b22-432a-4d18-8be0-317a03c4363e Apr 16 15:13:54 devstack sudo[90155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:13:54 devstack sudo[90155]: pam_unix(sudo:session): session closed for user root Apr 16 15:13:54 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-d6537b1c-2893-4be5-b46e-7f70acedfd6c tempest-VolumesGetTest-103301033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-bd072b22-432a-4d18-8be0-317a03c4363e" returned: 0 in 0.394s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:13:54 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-d6537b1c-2893-4be5-b46e-7f70acedfd6c tempest-VolumesGetTest-103301033 None] Lock "cinder-quobyte-bd072b22-432a-4d18-8be0-317a03c4363e" released by "delete_volume" :: held 0.869s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:13:54 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-d6537b1c-2893-4be5-b46e-7f70acedfd6c tempest-VolumesGetTest-103301033 None] Created reservations ['e6e90193-0b1f-49f4-8232-2fec91759fa2', '469044ce-d252-4918-a1bc-03f5575e498a', '9640d83a-e554-41e1-8675-d6635f1f6cbe', 'e1688c9c-b032-4607-96c9-32decd171f54'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:13:55 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-d6537b1c-2893-4be5-b46e-7f70acedfd6c tempest-VolumesGetTest-103301033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:13:55 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-d6537b1c-2893-4be5-b46e-7f70acedfd6c tempest-VolumesGetTest-103301033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:13:55 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-d6537b1c-2893-4be5-b46e-7f70acedfd6c tempest-VolumesGetTest-103301033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:13:55 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-d6537b1c-2893-4be5-b46e-7f70acedfd6c tempest-VolumesGetTest-103301033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:13:55 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-d6537b1c-2893-4be5-b46e-7f70acedfd6c tempest-VolumesGetTest-103301033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:13:55 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-d6537b1c-2893-4be5-b46e-7f70acedfd6c tempest-VolumesGetTest-103301033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:13:55 devstack sudo[90158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:13:55 devstack sudo[90158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:13:55 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-3414de85-9410-48dc-b78d-6fef182359d9 tempest-VolumesGetTest-103301033 None] Acquiring lock "cinder-e083bc68-6856-4e16-bf79-7121cbe284bc-delete_volume" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:13:55 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-3414de85-9410-48dc-b78d-6fef182359d9 tempest-VolumesGetTest-103301033 None] Lock "cinder-e083bc68-6856-4e16-bf79-7121cbe284bc-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:13:55 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-3414de85-9410-48dc-b78d-6fef182359d9 tempest-VolumesGetTest-103301033 None] Acquiring lock "cinder-quobyte-e083bc68-6856-4e16-bf79-7121cbe284bc" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:13:55 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-3414de85-9410-48dc-b78d-6fef182359d9 tempest-VolumesGetTest-103301033 None] Lock "cinder-quobyte-e083bc68-6856-4e16-bf79-7121cbe284bc" acquired by "delete_volume" :: waited 0.010s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:13:55 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[38296143-4800-4b6e-920a-9b97fbd5f3a1]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:13:55 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-3414de85-9410-48dc-b78d-6fef182359d9 tempest-VolumesGetTest-103301033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-e083bc68-6856-4e16-bf79-7121cbe284bc {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:13:55 devstack sudo[90160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-e083bc68-6856-4e16-bf79-7121cbe284bc Apr 16 15:13:55 devstack sudo[90160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:13:55 devstack sudo[90158]: pam_unix(sudo:session): session closed for user root Apr 16 15:13:55 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-d6537b1c-2893-4be5-b46e-7f70acedfd6c tempest-VolumesGetTest-103301033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.448s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:13:55 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-d6537b1c-2893-4be5-b46e-7f70acedfd6c tempest-VolumesGetTest-103301033 None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:13:55 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-d6537b1c-2893-4be5-b46e-7f70acedfd6c tempest-VolumesGetTest-103301033 None] Deleted volume successfully. Apr 16 15:13:55 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-d6537b1c-2893-4be5-b46e-7f70acedfd6c tempest-VolumesGetTest-103301033 None] Lock "cinder-bd072b22-432a-4d18-8be0-317a03c4363e-delete_volume" released by "delete_volume" :: held 1.445s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:13:55 devstack sudo[90160]: pam_unix(sudo:session): session closed for user root Apr 16 15:13:55 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-3414de85-9410-48dc-b78d-6fef182359d9 tempest-VolumesGetTest-103301033 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-e083bc68-6856-4e16-bf79-7121cbe284bc" returned: 0 in 0.460s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:13:55 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-3414de85-9410-48dc-b78d-6fef182359d9 tempest-VolumesGetTest-103301033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-e083bc68-6856-4e16-bf79-7121cbe284bc {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:13:55 devstack sudo[90166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-e083bc68-6856-4e16-bf79-7121cbe284bc Apr 16 15:13:55 devstack sudo[90166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:13:56 devstack sudo[90166]: pam_unix(sudo:session): session closed for user root Apr 16 15:13:56 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-3414de85-9410-48dc-b78d-6fef182359d9 tempest-VolumesGetTest-103301033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-e083bc68-6856-4e16-bf79-7121cbe284bc" returned: 0 in 0.391s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:13:56 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-3414de85-9410-48dc-b78d-6fef182359d9 tempest-VolumesGetTest-103301033 None] Lock "cinder-quobyte-e083bc68-6856-4e16-bf79-7121cbe284bc" released by "delete_volume" :: held 0.878s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:13:56 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-3414de85-9410-48dc-b78d-6fef182359d9 tempest-VolumesGetTest-103301033 None] Created reservations ['9b8cee58-6cab-4e34-b681-1513b2b87276', 'ff0de235-ea4e-41c2-92c8-8f0716d065da', '83819fcb-31a2-44bd-b1bc-21e28dbd5b28', 'b051157a-1f77-4b95-9c09-5ae4b9f972a2'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:13:56 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-3414de85-9410-48dc-b78d-6fef182359d9 tempest-VolumesGetTest-103301033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:13:56 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-3414de85-9410-48dc-b78d-6fef182359d9 tempest-VolumesGetTest-103301033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:13:56 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-3414de85-9410-48dc-b78d-6fef182359d9 tempest-VolumesGetTest-103301033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:13:56 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-3414de85-9410-48dc-b78d-6fef182359d9 tempest-VolumesGetTest-103301033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:13:56 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-3414de85-9410-48dc-b78d-6fef182359d9 tempest-VolumesGetTest-103301033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:13:56 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-3414de85-9410-48dc-b78d-6fef182359d9 tempest-VolumesGetTest-103301033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:13:56 devstack sudo[90169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:13:56 devstack sudo[90169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:13:56 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-7453b6b2-713b-4f72-9b73-586d7140a3f5 tempest-VolumesGetTest-103301033 None] Acquiring lock "cinder-b9941c26-4f32-4343-aac7-caeb19e30d79-delete_volume" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:13:56 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-7453b6b2-713b-4f72-9b73-586d7140a3f5 tempest-VolumesGetTest-103301033 None] Lock "cinder-b9941c26-4f32-4343-aac7-caeb19e30d79-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:13:56 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-7453b6b2-713b-4f72-9b73-586d7140a3f5 tempest-VolumesGetTest-103301033 None] Acquiring lock "cinder-quobyte-b9941c26-4f32-4343-aac7-caeb19e30d79" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:13:56 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-7453b6b2-713b-4f72-9b73-586d7140a3f5 tempest-VolumesGetTest-103301033 None] Lock "cinder-quobyte-b9941c26-4f32-4343-aac7-caeb19e30d79" acquired by "delete_volume" :: waited 0.009s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:13:56 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[388218ca-2977-4a5c-91d4-ed408c55eead]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:13:56 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-7453b6b2-713b-4f72-9b73-586d7140a3f5 tempest-VolumesGetTest-103301033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b9941c26-4f32-4343-aac7-caeb19e30d79 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:13:56 devstack sudo[90171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b9941c26-4f32-4343-aac7-caeb19e30d79 Apr 16 15:13:56 devstack sudo[90171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:13:56 devstack sudo[90169]: pam_unix(sudo:session): session closed for user root Apr 16 15:13:56 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-3414de85-9410-48dc-b78d-6fef182359d9 tempest-VolumesGetTest-103301033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.414s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:13:56 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-3414de85-9410-48dc-b78d-6fef182359d9 tempest-VolumesGetTest-103301033 None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:13:56 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-3414de85-9410-48dc-b78d-6fef182359d9 tempest-VolumesGetTest-103301033 None] Deleted volume successfully. Apr 16 15:13:56 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-3414de85-9410-48dc-b78d-6fef182359d9 tempest-VolumesGetTest-103301033 None] Lock "cinder-e083bc68-6856-4e16-bf79-7121cbe284bc-delete_volume" released by "delete_volume" :: held 1.435s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:13:57 devstack sudo[90171]: pam_unix(sudo:session): session closed for user root Apr 16 15:13:57 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-7453b6b2-713b-4f72-9b73-586d7140a3f5 tempest-VolumesGetTest-103301033 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b9941c26-4f32-4343-aac7-caeb19e30d79" returned: 0 in 0.475s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:13:57 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-7453b6b2-713b-4f72-9b73-586d7140a3f5 tempest-VolumesGetTest-103301033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b9941c26-4f32-4343-aac7-caeb19e30d79 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:13:57 devstack sudo[90177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b9941c26-4f32-4343-aac7-caeb19e30d79 Apr 16 15:13:57 devstack sudo[90177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:13:57 devstack sudo[90177]: pam_unix(sudo:session): session closed for user root Apr 16 15:13:57 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-7453b6b2-713b-4f72-9b73-586d7140a3f5 tempest-VolumesGetTest-103301033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-b9941c26-4f32-4343-aac7-caeb19e30d79" returned: 0 in 0.395s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:13:57 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-7453b6b2-713b-4f72-9b73-586d7140a3f5 tempest-VolumesGetTest-103301033 None] Lock "cinder-quobyte-b9941c26-4f32-4343-aac7-caeb19e30d79" released by "delete_volume" :: held 0.909s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:13:57 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-7453b6b2-713b-4f72-9b73-586d7140a3f5 tempest-VolumesGetTest-103301033 None] Created reservations ['d84d79ca-5a19-4622-80a7-0ba30fb4ccfa', '926c1574-1527-4423-b306-83054d0d11d4', 'e0363136-6ed3-4dbd-b08b-df791ac71139', 'c2f10b3e-eff2-47c2-8bec-5d582d7dfdb1'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:13:57 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-7453b6b2-713b-4f72-9b73-586d7140a3f5 tempest-VolumesGetTest-103301033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:13:57 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-7453b6b2-713b-4f72-9b73-586d7140a3f5 tempest-VolumesGetTest-103301033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:13:57 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-7453b6b2-713b-4f72-9b73-586d7140a3f5 tempest-VolumesGetTest-103301033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:13:57 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-7453b6b2-713b-4f72-9b73-586d7140a3f5 tempest-VolumesGetTest-103301033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:13:57 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-7453b6b2-713b-4f72-9b73-586d7140a3f5 tempest-VolumesGetTest-103301033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:13:57 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-7453b6b2-713b-4f72-9b73-586d7140a3f5 tempest-VolumesGetTest-103301033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:13:57 devstack sudo[90180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:13:57 devstack sudo[90180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:13:57 devstack sudo[90180]: pam_unix(sudo:session): session closed for user root Apr 16 15:13:57 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-7453b6b2-713b-4f72-9b73-586d7140a3f5 tempest-VolumesGetTest-103301033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.419s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:13:57 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-7453b6b2-713b-4f72-9b73-586d7140a3f5 tempest-VolumesGetTest-103301033 None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:13:57 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-7453b6b2-713b-4f72-9b73-586d7140a3f5 tempest-VolumesGetTest-103301033 None] Deleted volume successfully. Apr 16 15:13:57 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-7453b6b2-713b-4f72-9b73-586d7140a3f5 tempest-VolumesGetTest-103301033 None] Lock "cinder-b9941c26-4f32-4343-aac7-caeb19e30d79-delete_volume" released by "delete_volume" :: held 1.463s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:13:58 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b8ac507-2ca4-4784-98a9-24975a500754 tempest-VolumesGetTest-103301033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82756) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 15:13:58 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-1b8ac507-2ca4-4784-98a9-24975a500754 tempest-VolumesGetTest-103301033 None] Flow 'volume_create_manager' (a47b9fe1-91f2-4487-9af0-8548e2d3fe15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:13:58 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-1b8ac507-2ca4-4784-98a9-24975a500754 tempest-VolumesGetTest-103301033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53c49d52-b85c-43a4-88ca-894032036cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:13:58 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-1b8ac507-2ca4-4784-98a9-24975a500754 tempest-VolumesGetTest-103301033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53c49d52-b85c-43a4-88ca-894032036cb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:13:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-729397613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ebd56e3-1f6f-4aeb-a623-17403a48a7e0,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='59cd21a5b90d47d2ab3ff50fc013f013',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:13:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:13:58Z,use_quota=True,user_id='6ff61eaacb734cf3b892088433167105',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:13:58 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-1b8ac507-2ca4-4784-98a9-24975a500754 tempest-VolumesGetTest-103301033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd930b4e-66df-42dc-a0c4-f73fd899de35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:13:58 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-1b8ac507-2ca4-4784-98a9-24975a500754 tempest-VolumesGetTest-103301033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd930b4e-66df-42dc-a0c4-f73fd899de35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:13:58 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-1b8ac507-2ca4-4784-98a9-24975a500754 tempest-VolumesGetTest-103301033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19fb7ebe-46dc-4f6d-a7e3-b99a0b39ad6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:13:58 devstack cinder-volume[82756]: DEBUG cinder.image.glance [None req-1b8ac507-2ca4-4784-98a9-24975a500754 tempest-VolumesGetTest-103301033 None] Creating Keystone auth plugin from conf {{(pid=82756) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 16 15:13:58 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-1b8ac507-2ca4-4784-98a9-24975a500754 tempest-VolumesGetTest-103301033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19fb7ebe-46dc-4f6d-a7e3-b99a0b39ad6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9ebd56e3-1f6f-4aeb-a623-17403a48a7e0', 'volume_name': 'volume-9ebd56e3-1f6f-4aeb-a623-17403a48a7e0', 'volume_size': 1, 'image_id': 'b5f01913-4ea7-4cdb-8c76-10fda64d06e5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b5f01913-4ea7-4cdb-8c76-10fda64d06e5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '42394d2631114f428489519b24c78a03', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b5f01913-4ea7-4cdb-8c76-10fda64d06e5', 'created_at': datetime.datetime(2026, 4, 16, 13, 0, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 16, 13, 0, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b5f01913-4ea7-4cdb-8c76-10fda64d06e5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:13:58 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-1b8ac507-2ca4-4784-98a9-24975a500754 tempest-VolumesGetTest-103301033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d37a17a9-3bd2-44c2-9e33-37996f05101c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:13:58 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-1b8ac507-2ca4-4784-98a9-24975a500754 tempest-VolumesGetTest-103301033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d37a17a9-3bd2-44c2-9e33-37996f05101c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:13:58 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-1b8ac507-2ca4-4784-98a9-24975a500754 tempest-VolumesGetTest-103301033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba57b85c-4be1-4fa4-8457-53d9cf9baba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:13:58 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-1b8ac507-2ca4-4784-98a9-24975a500754 tempest-VolumesGetTest-103301033 None] Volume 9ebd56e3-1f6f-4aeb-a623-17403a48a7e0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9ebd56e3-1f6f-4aeb-a623-17403a48a7e0', 'volume_size': 1, 'image_id': 'b5f01913-4ea7-4cdb-8c76-10fda64d06e5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b5f01913-4ea7-4cdb-8c76-10fda64d06e5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '42394d2631114f428489519b24c78a03', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b5f01913-4ea7-4cdb-8c76-10fda64d06e5', 'created_at': datetime.datetime(2026, 4, 16, 13, 0, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 16, 13, 0, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b5f01913-4ea7-4cdb-8c76-10fda64d06e5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 16 15:13:58 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b8ac507-2ca4-4784-98a9-24975a500754 tempest-VolumesGetTest-103301033 None] Trying to clone 9ebd56e3-1f6f-4aeb-a623-17403a48a7e0 from image b5f01913-4ea7-4cdb-8c76-10fda64d06e5 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b5f01913-4ea7-4cdb-8c76-10fda64d06e5', 'metadata': {}}]). {{(pid=82756) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 16 15:13:58 devstack cinder-volume[82756]: DEBUG cinder.image.image_utils [None req-1b8ac507-2ca4-4784-98a9-24975a500754 tempest-VolumesGetTest-103301033 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b5f01913-4ea7-4cdb-8c76-10fda64d06e5_bi9ld5x5devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82756) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 16 15:13:58 devstack cinder-volume[82756]: INFO cinder.image.image_utils [None req-1b8ac507-2ca4-4784-98a9-24975a500754 tempest-VolumesGetTest-103301033 None] Image download 20.69 MB at 20.69 MB/s Apr 16 15:13:58 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[99882dce-5b1c-4574-b819-9622bc356685]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:13:58 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-1b8ac507-2ca4-4784-98a9-24975a500754 tempest-VolumesGetTest-103301033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5f01913-4ea7-4cdb-8c76-10fda64d06e5_bi9ld5x5devstack@QuobyteHD {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:13:58 devstack sudo[90184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5f01913-4ea7-4cdb-8c76-10fda64d06e5_bi9ld5x5devstack@QuobyteHD Apr 16 15:13:58 devstack sudo[90184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:13:58 devstack sudo[90184]: pam_unix(sudo:session): session closed for user root Apr 16 15:13:58 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-1b8ac507-2ca4-4784-98a9-24975a500754 tempest-VolumesGetTest-103301033 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5f01913-4ea7-4cdb-8c76-10fda64d06e5_bi9ld5x5devstack@QuobyteHD" returned: 0 in 0.441s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:13:58 devstack cinder-volume[82756]: DEBUG cinder.image.image_utils [None req-1b8ac507-2ca4-4784-98a9-24975a500754 tempest-VolumesGetTest-103301033 None] Temporary image b5f01913-4ea7-4cdb-8c76-10fda64d06e5 is fetched for user 6ff61eaacb734cf3b892088433167105. {{(pid=82756) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 16 15:13:58 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a3672c1-f7df-4d8b-aa30-acce7678e936]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:13:58 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-1b8ac507-2ca4-4784-98a9-24975a500754 tempest-VolumesGetTest-103301033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5f01913-4ea7-4cdb-8c76-10fda64d06e5_bi9ld5x5devstack@QuobyteHD {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:13:59 devstack sudo[90189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5f01913-4ea7-4cdb-8c76-10fda64d06e5_bi9ld5x5devstack@QuobyteHD Apr 16 15:13:59 devstack sudo[90189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:13:59 devstack sudo[90189]: pam_unix(sudo:session): session closed for user root Apr 16 15:13:59 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-1b8ac507-2ca4-4784-98a9-24975a500754 tempest-VolumesGetTest-103301033 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5f01913-4ea7-4cdb-8c76-10fda64d06e5_bi9ld5x5devstack@QuobyteHD" returned: 0 in 0.526s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:13:59 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-1b8ac507-2ca4-4784-98a9-24975a500754 tempest-VolumesGetTest-103301033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:13:59 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-1b8ac507-2ca4-4784-98a9-24975a500754 tempest-VolumesGetTest-103301033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:13:59 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-1b8ac507-2ca4-4784-98a9-24975a500754 tempest-VolumesGetTest-103301033 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:13:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-729397613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ebd56e3-1f6f-4aeb-a623-17403a48a7e0,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='59cd21a5b90d47d2ab3ff50fc013f013',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:13:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:13:58Z,use_quota=True,user_id='6ff61eaacb734cf3b892088433167105',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)}" {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 15:13:59 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-1b8ac507-2ca4-4784-98a9-24975a500754 tempest-VolumesGetTest-103301033 None] Creating volume 9ebd56e3-1f6f-4aeb-a623-17403a48a7e0 {{(pid=82756) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 15:13:59 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-1b8ac507-2ca4-4784-98a9-24975a500754 tempest-VolumesGetTest-103301033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:13:59 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-1b8ac507-2ca4-4784-98a9-24975a500754 tempest-VolumesGetTest-103301033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:13:59 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-1b8ac507-2ca4-4784-98a9-24975a500754 tempest-VolumesGetTest-103301033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:13:59 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-1b8ac507-2ca4-4784-98a9-24975a500754 tempest-VolumesGetTest-103301033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:13:59 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-1b8ac507-2ca4-4784-98a9-24975a500754 tempest-VolumesGetTest-103301033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:13:59 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-1b8ac507-2ca4-4784-98a9-24975a500754 tempest-VolumesGetTest-103301033 None] Selected osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 as target Quobyte volume. {{(pid=82756) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 15:13:59 devstack cinder-volume[82756]: INFO cinder.volume.drivers.remotefs [None req-1b8ac507-2ca4-4784-98a9-24975a500754 tempest-VolumesGetTest-103301033 None] casted to osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 Apr 16 15:13:59 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-1b8ac507-2ca4-4784-98a9-24975a500754 tempest-VolumesGetTest-103301033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-9ebd56e3-1f6f-4aeb-a623-17403a48a7e0 1073741824 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:13:59 devstack sudo[90196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-9ebd56e3-1f6f-4aeb-a623-17403a48a7e0 1073741824 Apr 16 15:13:59 devstack sudo[90196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:14:00 devstack sudo[90196]: pam_unix(sudo:session): session closed for user root Apr 16 15:14:00 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-1b8ac507-2ca4-4784-98a9-24975a500754 tempest-VolumesGetTest-103301033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-9ebd56e3-1f6f-4aeb-a623-17403a48a7e0 1073741824" returned: 0 in 0.558s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:14:00 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-1b8ac507-2ca4-4784-98a9-24975a500754 tempest-VolumesGetTest-103301033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-9ebd56e3-1f6f-4aeb-a623-17403a48a7e0 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:14:00 devstack sudo[90201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-9ebd56e3-1f6f-4aeb-a623-17403a48a7e0 Apr 16 15:14:00 devstack sudo[90201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:14:00 devstack sudo[90201]: pam_unix(sudo:session): session closed for user root Apr 16 15:14:00 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-1b8ac507-2ca4-4784-98a9-24975a500754 tempest-VolumesGetTest-103301033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-9ebd56e3-1f6f-4aeb-a623-17403a48a7e0" returned: 0 in 0.471s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:14:00 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-1b8ac507-2ca4-4784-98a9-24975a500754 tempest-VolumesGetTest-103301033 None] <== create_volume: return (1063ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'} {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 15:14:00 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-1b8ac507-2ca4-4784-98a9-24975a500754 tempest-VolumesGetTest-103301033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.066s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:14:00 devstack cinder-volume[82756]: DEBUG cinder.volume.volume_utils [None req-1b8ac507-2ca4-4784-98a9-24975a500754 tempest-VolumesGetTest-103301033 None] Attempting download of b5f01913-4ea7-4cdb-8c76-10fda64d06e5 ((None, [{'url': 'file:///opt/stack/data/glance/images/b5f01913-4ea7-4cdb-8c76-10fda64d06e5', 'metadata': {}}])) to volume 9ebd56e3-1f6f-4aeb-a623-17403a48a7e0. {{(pid=82756) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 16 15:14:00 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f396ff4-12ad-40b3-bb93-f1463a0034d7]: (4, 'raw') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:14:00 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-1b8ac507-2ca4-4784-98a9-24975a500754 tempest-VolumesGetTest-103301033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b5f01913-4ea7-4cdb-8c76-10fda64d06e5_wqmqdna_ {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:14:00 devstack sudo[90204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b5f01913-4ea7-4cdb-8c76-10fda64d06e5_wqmqdna_ Apr 16 15:14:00 devstack sudo[90204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:14:01 devstack sudo[90204]: pam_unix(sudo:session): session closed for user root Apr 16 15:14:01 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-1b8ac507-2ca4-4784-98a9-24975a500754 tempest-VolumesGetTest-103301033 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b5f01913-4ea7-4cdb-8c76-10fda64d06e5_wqmqdna_" returned: 0 in 0.481s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:14:01 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-1b8ac507-2ca4-4784-98a9-24975a500754 tempest-VolumesGetTest-103301033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5f01913-4ea7-4cdb-8c76-10fda64d06e5_wqmqdna_ {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:14:01 devstack sudo[90208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5f01913-4ea7-4cdb-8c76-10fda64d06e5_wqmqdna_ Apr 16 15:14:01 devstack sudo[90208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:14:01 devstack sudo[90208]: pam_unix(sudo:session): session closed for user root Apr 16 15:14:01 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-1b8ac507-2ca4-4784-98a9-24975a500754 tempest-VolumesGetTest-103301033 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5f01913-4ea7-4cdb-8c76-10fda64d06e5_wqmqdna_" returned: 1 in 0.479s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:14:01 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-1b8ac507-2ca4-4784-98a9-24975a500754 tempest-VolumesGetTest-103301033 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5f01913-4ea7-4cdb-8c76-10fda64d06e5_wqmqdna_' failed. Not Retrying. {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 16 15:14:01 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[76f98714-cbfe-405a-8ae7-fe9972416173]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:14:01 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-1b8ac507-2ca4-4784-98a9-24975a500754 tempest-VolumesGetTest-103301033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5f01913-4ea7-4cdb-8c76-10fda64d06e5_bi9ld5x5devstack@QuobyteHD {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:14:01 devstack sudo[90218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5f01913-4ea7-4cdb-8c76-10fda64d06e5_bi9ld5x5devstack@QuobyteHD Apr 16 15:14:01 devstack sudo[90218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:14:02 devstack sudo[90218]: pam_unix(sudo:session): session closed for user root Apr 16 15:14:02 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-1b8ac507-2ca4-4784-98a9-24975a500754 tempest-VolumesGetTest-103301033 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5f01913-4ea7-4cdb-8c76-10fda64d06e5_bi9ld5x5devstack@QuobyteHD" returned: 0 in 0.486s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:14:02 devstack cinder-volume[82756]: DEBUG cinder.image.image_utils [None req-1b8ac507-2ca4-4784-98a9-24975a500754 tempest-VolumesGetTest-103301033 None] b5f01913-4ea7-4cdb-8c76-10fda64d06e5 was qcow2, converting to raw {{(pid=82756) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 16 15:14:02 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-1b8ac507-2ca4-4784-98a9-24975a500754 tempest-VolumesGetTest-103301033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b5f01913-4ea7-4cdb-8c76-10fda64d06e5_bi9ld5x5devstack@QuobyteHD /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-9ebd56e3-1f6f-4aeb-a623-17403a48a7e0 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:14:02 devstack sudo[90235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b5f01913-4ea7-4cdb-8c76-10fda64d06e5_bi9ld5x5devstack@QuobyteHD /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-9ebd56e3-1f6f-4aeb-a623-17403a48a7e0 Apr 16 15:14:02 devstack sudo[90235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:14:02 devstack sudo[90235]: pam_unix(sudo:session): session closed for user root Apr 16 15:14:02 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-1b8ac507-2ca4-4784-98a9-24975a500754 tempest-VolumesGetTest-103301033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b5f01913-4ea7-4cdb-8c76-10fda64d06e5_bi9ld5x5devstack@QuobyteHD /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-9ebd56e3-1f6f-4aeb-a623-17403a48a7e0" returned: 0 in 0.861s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:14:02 devstack cinder-volume[82756]: DEBUG cinder.image.image_utils [None req-1b8ac507-2ca4-4784-98a9-24975a500754 tempest-VolumesGetTest-103301033 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b5f01913-4ea7-4cdb-8c76-10fda64d06e5_bi9ld5x5devstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-9ebd56e3-1f6f-4aeb-a623-17403a48a7e0 {{(pid=82756) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 15:14:02 devstack cinder-volume[82756]: INFO cinder.image.image_utils [None req-1b8ac507-2ca4-4784-98a9-24975a500754 tempest-VolumesGetTest-103301033 None] Converted 112.00 MB image at 112.00 MB/s Apr 16 15:14:02 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-1b8ac507-2ca4-4784-98a9-24975a500754 tempest-VolumesGetTest-103301033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-9ebd56e3-1f6f-4aeb-a623-17403a48a7e0 1G {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:14:02 devstack sudo[90274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-9ebd56e3-1f6f-4aeb-a623-17403a48a7e0 1G Apr 16 15:14:02 devstack sudo[90274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:14:03 devstack sudo[90274]: pam_unix(sudo:session): session closed for user root Apr 16 15:14:03 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-1b8ac507-2ca4-4784-98a9-24975a500754 tempest-VolumesGetTest-103301033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-9ebd56e3-1f6f-4aeb-a623-17403a48a7e0 1G" returned: 0 in 0.465s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:14:03 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[885493a3-b67a-4035-89a3-d735d59c520a]: (4, 'raw') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:14:03 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-1b8ac507-2ca4-4784-98a9-24975a500754 tempest-VolumesGetTest-103301033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-9ebd56e3-1f6f-4aeb-a623-17403a48a7e0 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:14:03 devstack sudo[90279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-9ebd56e3-1f6f-4aeb-a623-17403a48a7e0 Apr 16 15:14:03 devstack sudo[90279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:14:03 devstack sudo[90279]: pam_unix(sudo:session): session closed for user root Apr 16 15:14:03 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-1b8ac507-2ca4-4784-98a9-24975a500754 tempest-VolumesGetTest-103301033 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-9ebd56e3-1f6f-4aeb-a623-17403a48a7e0" returned: 0 in 0.494s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:14:03 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-1b8ac507-2ca4-4784-98a9-24975a500754 tempest-VolumesGetTest-103301033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-9ebd56e3-1f6f-4aeb-a623-17403a48a7e0 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:14:04 devstack sudo[90284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-9ebd56e3-1f6f-4aeb-a623-17403a48a7e0 Apr 16 15:14:04 devstack sudo[90284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:14:04 devstack sudo[90284]: pam_unix(sudo:session): session closed for user root Apr 16 15:14:04 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-1b8ac507-2ca4-4784-98a9-24975a500754 tempest-VolumesGetTest-103301033 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-9ebd56e3-1f6f-4aeb-a623-17403a48a7e0" returned: 1 in 0.464s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:14:04 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-1b8ac507-2ca4-4784-98a9-24975a500754 tempest-VolumesGetTest-103301033 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-9ebd56e3-1f6f-4aeb-a623-17403a48a7e0' failed. Not Retrying. {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 16 15:14:04 devstack cinder-volume[82756]: DEBUG cinder.volume.volume_utils [None req-1b8ac507-2ca4-4784-98a9-24975a500754 tempest-VolumesGetTest-103301033 None] Downloaded image b5f01913-4ea7-4cdb-8c76-10fda64d06e5 ((None, [{'url': 'file:///opt/stack/data/glance/images/b5f01913-4ea7-4cdb-8c76-10fda64d06e5', 'metadata': {}}])) to volume 9ebd56e3-1f6f-4aeb-a623-17403a48a7e0 successfully. {{(pid=82756) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 16 15:14:04 devstack cinder-volume[82756]: DEBUG cinder.image.image_utils [None req-1b8ac507-2ca4-4784-98a9-24975a500754 tempest-VolumesGetTest-103301033 None] Temporary image b5f01913-4ea7-4cdb-8c76-10fda64d06e5 for user 6ff61eaacb734cf3b892088433167105 is deleted. {{(pid=82756) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 16 15:14:04 devstack cinder-volume[82756]: DEBUG cinder.volume.volume_utils [None req-1b8ac507-2ca4-4784-98a9-24975a500754 tempest-VolumesGetTest-103301033 None] Marking volume 9ebd56e3-1f6f-4aeb-a623-17403a48a7e0 as bootable. {{(pid=82756) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 16 15:14:04 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b8ac507-2ca4-4784-98a9-24975a500754 tempest-VolumesGetTest-103301033 None] Copying metadata from image b5f01913-4ea7-4cdb-8c76-10fda64d06e5 to 9ebd56e3-1f6f-4aeb-a623-17403a48a7e0. {{(pid=82756) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 16 15:14:04 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b8ac507-2ca4-4784-98a9-24975a500754 tempest-VolumesGetTest-103301033 None] Creating volume glance metadata for volume 9ebd56e3-1f6f-4aeb-a623-17403a48a7e0 backed by image b5f01913-4ea7-4cdb-8c76-10fda64d06e5 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b5f01913-4ea7-4cdb-8c76-10fda64d06e5', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82756) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 16 15:14:04 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-1b8ac507-2ca4-4784-98a9-24975a500754 tempest-VolumesGetTest-103301033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba57b85c-4be1-4fa4-8457-53d9cf9baba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ebd56e3-1f6f-4aeb-a623-17403a48a7e0', 'volume_size': 1, 'image_id': 'b5f01913-4ea7-4cdb-8c76-10fda64d06e5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b5f01913-4ea7-4cdb-8c76-10fda64d06e5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '42394d2631114f428489519b24c78a03', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b5f01913-4ea7-4cdb-8c76-10fda64d06e5', 'created_at': datetime.datetime(2026, 4, 16, 13, 0, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 16, 13, 0, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b5f01913-4ea7-4cdb-8c76-10fda64d06e5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:14:04 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-1b8ac507-2ca4-4784-98a9-24975a500754 tempest-VolumesGetTest-103301033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (058f2ce4-f521-444a-bd70-eaea4cd99e69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:14:04 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-1b8ac507-2ca4-4784-98a9-24975a500754 tempest-VolumesGetTest-103301033 None] Volume volume-9ebd56e3-1f6f-4aeb-a623-17403a48a7e0 (9ebd56e3-1f6f-4aeb-a623-17403a48a7e0): created successfully Apr 16 15:14:04 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-1b8ac507-2ca4-4784-98a9-24975a500754 tempest-VolumesGetTest-103301033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (058f2ce4-f521-444a-bd70-eaea4cd99e69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:14:04 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-1b8ac507-2ca4-4784-98a9-24975a500754 tempest-VolumesGetTest-103301033 None] Flow 'volume_create_manager' (a47b9fe1-91f2-4487-9af0-8548e2d3fe15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:14:04 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-1b8ac507-2ca4-4784-98a9-24975a500754 tempest-VolumesGetTest-103301033 None] Created volume successfully. Apr 16 15:14:05 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [None req-63d5d5d1-b5c9-41ae-878f-582dbfb5f14f tempest-VolumesGetTest-103301033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82756) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 15:14:05 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-63d5d5d1-b5c9-41ae-878f-582dbfb5f14f tempest-VolumesGetTest-103301033 None] Flow 'volume_create_manager' (6136aa4d-d82b-42a2-b12b-bbb9c4f312cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:14:05 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-63d5d5d1-b5c9-41ae-878f-582dbfb5f14f tempest-VolumesGetTest-103301033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5b09589-64bc-4160-9093-f7eb48010945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:14:05 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-63d5d5d1-b5c9-41ae-878f-582dbfb5f14f tempest-VolumesGetTest-103301033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5b09589-64bc-4160-9093-f7eb48010945) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:14:06Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1039955177',display_name='tempest-VolumesGetTest-Volume-546292658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a162809-2492-422e-8a36-417d0314ef3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59cd21a5b90d47d2ab3ff50fc013f013',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:14:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:14:06Z,use_quota=True,user_id='6ff61eaacb734cf3b892088433167105',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:14:05 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-63d5d5d1-b5c9-41ae-878f-582dbfb5f14f tempest-VolumesGetTest-103301033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7df0c2ff-1353-453d-a1c9-7875d2856405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:14:05 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-63d5d5d1-b5c9-41ae-878f-582dbfb5f14f tempest-VolumesGetTest-103301033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7df0c2ff-1353-453d-a1c9-7875d2856405) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:14:05 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-63d5d5d1-b5c9-41ae-878f-582dbfb5f14f tempest-VolumesGetTest-103301033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80788b0d-5d3e-44f0-9e11-844391f101cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:14:05 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-63d5d5d1-b5c9-41ae-878f-582dbfb5f14f tempest-VolumesGetTest-103301033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80788b0d-5d3e-44f0-9e11-844391f101cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a162809-2492-422e-8a36-417d0314ef3e', 'volume_name': 'volume-8a162809-2492-422e-8a36-417d0314ef3e', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:14:05 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-63d5d5d1-b5c9-41ae-878f-582dbfb5f14f tempest-VolumesGetTest-103301033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60024e55-b1b2-4eb2-9c4f-ed5386dbb09b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:14:05 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-63d5d5d1-b5c9-41ae-878f-582dbfb5f14f tempest-VolumesGetTest-103301033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60024e55-b1b2-4eb2-9c4f-ed5386dbb09b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:14:06 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-63d5d5d1-b5c9-41ae-878f-582dbfb5f14f tempest-VolumesGetTest-103301033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19a9bd22-2cde-4ffd-99a9-990b54ba1c62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:14:06 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-63d5d5d1-b5c9-41ae-878f-582dbfb5f14f tempest-VolumesGetTest-103301033 None] Volume 8a162809-2492-422e-8a36-417d0314ef3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a162809-2492-422e-8a36-417d0314ef3e', 'volume_size': 1} Apr 16 15:14:06 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-63d5d5d1-b5c9-41ae-878f-582dbfb5f14f tempest-VolumesGetTest-103301033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:14:06 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-63d5d5d1-b5c9-41ae-878f-582dbfb5f14f tempest-VolumesGetTest-103301033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:14:06 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-63d5d5d1-b5c9-41ae-878f-582dbfb5f14f tempest-VolumesGetTest-103301033 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:14:06Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1039955177',display_name='tempest-VolumesGetTest-Volume-546292658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a162809-2492-422e-8a36-417d0314ef3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59cd21a5b90d47d2ab3ff50fc013f013',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:14:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:14:06Z,use_quota=True,user_id='6ff61eaacb734cf3b892088433167105',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)}" {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 15:14:06 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-63d5d5d1-b5c9-41ae-878f-582dbfb5f14f tempest-VolumesGetTest-103301033 None] Creating volume 8a162809-2492-422e-8a36-417d0314ef3e {{(pid=82756) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 15:14:06 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-63d5d5d1-b5c9-41ae-878f-582dbfb5f14f tempest-VolumesGetTest-103301033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:14:06 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-63d5d5d1-b5c9-41ae-878f-582dbfb5f14f tempest-VolumesGetTest-103301033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:14:06 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-63d5d5d1-b5c9-41ae-878f-582dbfb5f14f tempest-VolumesGetTest-103301033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:14:06 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-63d5d5d1-b5c9-41ae-878f-582dbfb5f14f tempest-VolumesGetTest-103301033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:14:06 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-63d5d5d1-b5c9-41ae-878f-582dbfb5f14f tempest-VolumesGetTest-103301033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:14:06 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-63d5d5d1-b5c9-41ae-878f-582dbfb5f14f tempest-VolumesGetTest-103301033 None] Selected osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 as target Quobyte volume. {{(pid=82756) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 15:14:06 devstack cinder-volume[82756]: INFO cinder.volume.drivers.remotefs [None req-63d5d5d1-b5c9-41ae-878f-582dbfb5f14f tempest-VolumesGetTest-103301033 None] casted to osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 Apr 16 15:14:06 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-63d5d5d1-b5c9-41ae-878f-582dbfb5f14f tempest-VolumesGetTest-103301033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-8a162809-2492-422e-8a36-417d0314ef3e 1073741824 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:14:06 devstack sudo[90289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-8a162809-2492-422e-8a36-417d0314ef3e 1073741824 Apr 16 15:14:06 devstack sudo[90289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:14:06 devstack sudo[90289]: pam_unix(sudo:session): session closed for user root Apr 16 15:14:06 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-63d5d5d1-b5c9-41ae-878f-582dbfb5f14f tempest-VolumesGetTest-103301033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-8a162809-2492-422e-8a36-417d0314ef3e 1073741824" returned: 0 in 0.531s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:14:06 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-63d5d5d1-b5c9-41ae-878f-582dbfb5f14f tempest-VolumesGetTest-103301033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-8a162809-2492-422e-8a36-417d0314ef3e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:14:06 devstack sudo[90294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-8a162809-2492-422e-8a36-417d0314ef3e Apr 16 15:14:06 devstack sudo[90294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:14:07 devstack sudo[90294]: pam_unix(sudo:session): session closed for user root Apr 16 15:14:07 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-63d5d5d1-b5c9-41ae-878f-582dbfb5f14f tempest-VolumesGetTest-103301033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-8a162809-2492-422e-8a36-417d0314ef3e" returned: 0 in 0.444s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:14:07 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-63d5d5d1-b5c9-41ae-878f-582dbfb5f14f tempest-VolumesGetTest-103301033 None] <== create_volume: return (1002ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'} {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 15:14:07 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-63d5d5d1-b5c9-41ae-878f-582dbfb5f14f tempest-VolumesGetTest-103301033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.005s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:14:07 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-63d5d5d1-b5c9-41ae-878f-582dbfb5f14f tempest-VolumesGetTest-103301033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19a9bd22-2cde-4ffd-99a9-990b54ba1c62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a162809-2492-422e-8a36-417d0314ef3e', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:14:07 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-63d5d5d1-b5c9-41ae-878f-582dbfb5f14f tempest-VolumesGetTest-103301033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca96c234-8b96-4f13-a4f4-8b092e052455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:14:07 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-63d5d5d1-b5c9-41ae-878f-582dbfb5f14f tempest-VolumesGetTest-103301033 None] Volume volume-8a162809-2492-422e-8a36-417d0314ef3e (8a162809-2492-422e-8a36-417d0314ef3e): created successfully Apr 16 15:14:07 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-63d5d5d1-b5c9-41ae-878f-582dbfb5f14f tempest-VolumesGetTest-103301033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca96c234-8b96-4f13-a4f4-8b092e052455) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:14:07 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-63d5d5d1-b5c9-41ae-878f-582dbfb5f14f tempest-VolumesGetTest-103301033 None] Flow 'volume_create_manager' (6136aa4d-d82b-42a2-b12b-bbb9c4f312cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:14:07 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-63d5d5d1-b5c9-41ae-878f-582dbfb5f14f tempest-VolumesGetTest-103301033 None] Created volume successfully. Apr 16 15:14:08 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-51bd66b4-f586-4459-8e1a-4637bc9f1848 tempest-VolumesGetTest-103301033 None] Acquiring lock "cinder-8a162809-2492-422e-8a36-417d0314ef3e-delete_volume" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:14:08 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-51bd66b4-f586-4459-8e1a-4637bc9f1848 tempest-VolumesGetTest-103301033 None] Lock "cinder-8a162809-2492-422e-8a36-417d0314ef3e-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:14:08 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-51bd66b4-f586-4459-8e1a-4637bc9f1848 tempest-VolumesGetTest-103301033 None] Acquiring lock "cinder-quobyte-8a162809-2492-422e-8a36-417d0314ef3e" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:14:08 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-51bd66b4-f586-4459-8e1a-4637bc9f1848 tempest-VolumesGetTest-103301033 None] Lock "cinder-quobyte-8a162809-2492-422e-8a36-417d0314ef3e" acquired by "delete_volume" :: waited 0.008s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:14:08 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[943c281b-fe9b-442e-a95d-d0d28b36ed42]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:14:08 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-51bd66b4-f586-4459-8e1a-4637bc9f1848 tempest-VolumesGetTest-103301033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-8a162809-2492-422e-8a36-417d0314ef3e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:14:08 devstack sudo[90297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-8a162809-2492-422e-8a36-417d0314ef3e Apr 16 15:14:08 devstack sudo[90297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:14:08 devstack sudo[90297]: pam_unix(sudo:session): session closed for user root Apr 16 15:14:08 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-51bd66b4-f586-4459-8e1a-4637bc9f1848 tempest-VolumesGetTest-103301033 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-8a162809-2492-422e-8a36-417d0314ef3e" returned: 0 in 0.498s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:14:08 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-51bd66b4-f586-4459-8e1a-4637bc9f1848 tempest-VolumesGetTest-103301033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-8a162809-2492-422e-8a36-417d0314ef3e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:14:08 devstack sudo[90302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-8a162809-2492-422e-8a36-417d0314ef3e Apr 16 15:14:08 devstack sudo[90302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:14:09 devstack sudo[90302]: pam_unix(sudo:session): session closed for user root Apr 16 15:14:09 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-51bd66b4-f586-4459-8e1a-4637bc9f1848 tempest-VolumesGetTest-103301033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-8a162809-2492-422e-8a36-417d0314ef3e" returned: 0 in 0.444s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:14:09 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-51bd66b4-f586-4459-8e1a-4637bc9f1848 tempest-VolumesGetTest-103301033 None] Lock "cinder-quobyte-8a162809-2492-422e-8a36-417d0314ef3e" released by "delete_volume" :: held 0.966s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:14:09 devstack cinder-volume[82756]: DEBUG dbcounter [-] [82756] Writing DB stats cinder:SELECT=93,cinder:UPDATE=129,cinder:DELETE=13,cinder:INSERT=32 {{(pid=82756) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 15:14:09 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-51bd66b4-f586-4459-8e1a-4637bc9f1848 tempest-VolumesGetTest-103301033 None] Created reservations ['6b1251b6-556d-46f7-bfd8-d45befbcc0cc', 'fdcafabc-4102-424a-a064-993b11b238fc', 'aadb68f9-2bc1-423d-af37-daa7add199de', '4ddea10d-15cc-497f-9b27-64ab5bfcd1b5'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:14:09 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-51bd66b4-f586-4459-8e1a-4637bc9f1848 tempest-VolumesGetTest-103301033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:14:09 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-51bd66b4-f586-4459-8e1a-4637bc9f1848 tempest-VolumesGetTest-103301033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:14:09 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-51bd66b4-f586-4459-8e1a-4637bc9f1848 tempest-VolumesGetTest-103301033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:14:09 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-51bd66b4-f586-4459-8e1a-4637bc9f1848 tempest-VolumesGetTest-103301033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:14:09 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-51bd66b4-f586-4459-8e1a-4637bc9f1848 tempest-VolumesGetTest-103301033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:14:09 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-51bd66b4-f586-4459-8e1a-4637bc9f1848 tempest-VolumesGetTest-103301033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:14:09 devstack sudo[90305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:14:09 devstack sudo[90305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:14:09 devstack sudo[90305]: pam_unix(sudo:session): session closed for user root Apr 16 15:14:09 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-51bd66b4-f586-4459-8e1a-4637bc9f1848 tempest-VolumesGetTest-103301033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.450s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:14:09 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-51bd66b4-f586-4459-8e1a-4637bc9f1848 tempest-VolumesGetTest-103301033 None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:14:09 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-51bd66b4-f586-4459-8e1a-4637bc9f1848 tempest-VolumesGetTest-103301033 None] Deleted volume successfully. Apr 16 15:14:09 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-51bd66b4-f586-4459-8e1a-4637bc9f1848 tempest-VolumesGetTest-103301033 None] Lock "cinder-8a162809-2492-422e-8a36-417d0314ef3e-delete_volume" released by "delete_volume" :: held 1.571s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:14:10 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-0eb2e2f7-6e13-40fb-b0fc-83a7da862daf tempest-VolumesGetTest-103301033 None] Acquiring lock "cinder-9ebd56e3-1f6f-4aeb-a623-17403a48a7e0-delete_volume" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:14:10 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-0eb2e2f7-6e13-40fb-b0fc-83a7da862daf tempest-VolumesGetTest-103301033 None] Lock "cinder-9ebd56e3-1f6f-4aeb-a623-17403a48a7e0-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:14:10 devstack cinder-volume[82756]: DEBUG dbcounter [-] [82756] Writing DB stats cinder:UPDATE=117,cinder:SELECT=86,cinder:INSERT=36,cinder:DELETE=9 {{(pid=82756) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 15:14:10 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-0eb2e2f7-6e13-40fb-b0fc-83a7da862daf tempest-VolumesGetTest-103301033 None] Acquiring lock "cinder-quobyte-9ebd56e3-1f6f-4aeb-a623-17403a48a7e0" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:14:10 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-0eb2e2f7-6e13-40fb-b0fc-83a7da862daf tempest-VolumesGetTest-103301033 None] Lock "cinder-quobyte-9ebd56e3-1f6f-4aeb-a623-17403a48a7e0" acquired by "delete_volume" :: waited 0.008s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:14:10 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[6148ce77-1181-45d4-9f94-4a8bcd2dccd4]: (4, 'raw') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:14:10 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-0eb2e2f7-6e13-40fb-b0fc-83a7da862daf tempest-VolumesGetTest-103301033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-9ebd56e3-1f6f-4aeb-a623-17403a48a7e0 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:14:10 devstack sudo[90308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-9ebd56e3-1f6f-4aeb-a623-17403a48a7e0 Apr 16 15:14:10 devstack sudo[90308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:14:10 devstack sudo[90308]: pam_unix(sudo:session): session closed for user root Apr 16 15:14:10 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-0eb2e2f7-6e13-40fb-b0fc-83a7da862daf tempest-VolumesGetTest-103301033 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-9ebd56e3-1f6f-4aeb-a623-17403a48a7e0" returned: 0 in 0.459s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:14:10 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-0eb2e2f7-6e13-40fb-b0fc-83a7da862daf tempest-VolumesGetTest-103301033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-9ebd56e3-1f6f-4aeb-a623-17403a48a7e0 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:14:10 devstack sudo[90312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-9ebd56e3-1f6f-4aeb-a623-17403a48a7e0 Apr 16 15:14:10 devstack sudo[90312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:14:11 devstack sudo[90312]: pam_unix(sudo:session): session closed for user root Apr 16 15:14:11 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-0eb2e2f7-6e13-40fb-b0fc-83a7da862daf tempest-VolumesGetTest-103301033 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-9ebd56e3-1f6f-4aeb-a623-17403a48a7e0" returned: 1 in 0.446s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:14:11 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-0eb2e2f7-6e13-40fb-b0fc-83a7da862daf tempest-VolumesGetTest-103301033 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-9ebd56e3-1f6f-4aeb-a623-17403a48a7e0' failed. Not Retrying. {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 16 15:14:11 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-0eb2e2f7-6e13-40fb-b0fc-83a7da862daf tempest-VolumesGetTest-103301033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-9ebd56e3-1f6f-4aeb-a623-17403a48a7e0 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:14:11 devstack sudo[90317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-9ebd56e3-1f6f-4aeb-a623-17403a48a7e0 Apr 16 15:14:11 devstack sudo[90317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:14:11 devstack sudo[90317]: pam_unix(sudo:session): session closed for user root Apr 16 15:14:11 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-0eb2e2f7-6e13-40fb-b0fc-83a7da862daf tempest-VolumesGetTest-103301033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-9ebd56e3-1f6f-4aeb-a623-17403a48a7e0" returned: 0 in 0.440s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:14:11 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-0eb2e2f7-6e13-40fb-b0fc-83a7da862daf tempest-VolumesGetTest-103301033 None] Lock "cinder-quobyte-9ebd56e3-1f6f-4aeb-a623-17403a48a7e0" released by "delete_volume" :: held 1.393s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:14:11 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-0eb2e2f7-6e13-40fb-b0fc-83a7da862daf tempest-VolumesGetTest-103301033 None] Created reservations ['bf6ea9af-e7cd-4d5a-947b-baac3741d783', '522c87ae-04c2-4845-9347-a1b35449b5c3', 'beea5d8c-7c75-4c9c-a265-093d31773a66', 'b931beaa-1275-418e-af91-6fc6af78fd89'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:14:11 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-0eb2e2f7-6e13-40fb-b0fc-83a7da862daf tempest-VolumesGetTest-103301033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:14:11 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-0eb2e2f7-6e13-40fb-b0fc-83a7da862daf tempest-VolumesGetTest-103301033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:14:11 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-0eb2e2f7-6e13-40fb-b0fc-83a7da862daf tempest-VolumesGetTest-103301033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:14:11 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-0eb2e2f7-6e13-40fb-b0fc-83a7da862daf tempest-VolumesGetTest-103301033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:14:11 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-0eb2e2f7-6e13-40fb-b0fc-83a7da862daf tempest-VolumesGetTest-103301033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:14:11 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-0eb2e2f7-6e13-40fb-b0fc-83a7da862daf tempest-VolumesGetTest-103301033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:14:11 devstack sudo[90320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:14:11 devstack sudo[90320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:14:12 devstack sudo[90320]: pam_unix(sudo:session): session closed for user root Apr 16 15:14:12 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-0eb2e2f7-6e13-40fb-b0fc-83a7da862daf tempest-VolumesGetTest-103301033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.449s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:14:12 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-0eb2e2f7-6e13-40fb-b0fc-83a7da862daf tempest-VolumesGetTest-103301033 None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:14:12 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-0eb2e2f7-6e13-40fb-b0fc-83a7da862daf tempest-VolumesGetTest-103301033 None] Deleted volume successfully. Apr 16 15:14:12 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-0eb2e2f7-6e13-40fb-b0fc-83a7da862daf tempest-VolumesGetTest-103301033 None] Lock "cinder-9ebd56e3-1f6f-4aeb-a623-17403a48a7e0-delete_volume" released by "delete_volume" :: held 1.986s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:14:14 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [None req-22c0b07c-83e8-4636-ad48-5615d7b3f2ee tempest-VolumesSnapshotNegativeTestJSON-197834191 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82756) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 15:14:14 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-22c0b07c-83e8-4636-ad48-5615d7b3f2ee tempest-VolumesSnapshotNegativeTestJSON-197834191 None] Flow 'volume_create_manager' (b48b477a-fb16-4cc2-af8c-e0b0815cfe13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:14:14 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-22c0b07c-83e8-4636-ad48-5615d7b3f2ee tempest-VolumesSnapshotNegativeTestJSON-197834191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (984c0c96-ffe4-4533-bc38-b26c3f55f075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:14:14 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-22c0b07c-83e8-4636-ad48-5615d7b3f2ee tempest-VolumesSnapshotNegativeTestJSON-197834191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (984c0c96-ffe4-4533-bc38-b26c3f55f075) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:14:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-801976545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ee1fe39-90f2-4390-8b31-af3404b18c35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c867d99f8684625bacbb2dfaf267271',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:14:14Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:14:14Z,use_quota=True,user_id='da04372312134613b15ec25fb2b7be5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:14:14 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-22c0b07c-83e8-4636-ad48-5615d7b3f2ee tempest-VolumesSnapshotNegativeTestJSON-197834191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (624c76c7-5868-413f-b23e-3500590322ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:14:14 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-22c0b07c-83e8-4636-ad48-5615d7b3f2ee tempest-VolumesSnapshotNegativeTestJSON-197834191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (624c76c7-5868-413f-b23e-3500590322ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:14:14 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-22c0b07c-83e8-4636-ad48-5615d7b3f2ee tempest-VolumesSnapshotNegativeTestJSON-197834191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05fdfb5b-0ae3-4cb5-b577-0f060d329cae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:14:14 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-22c0b07c-83e8-4636-ad48-5615d7b3f2ee tempest-VolumesSnapshotNegativeTestJSON-197834191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05fdfb5b-0ae3-4cb5-b577-0f060d329cae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ee1fe39-90f2-4390-8b31-af3404b18c35', 'volume_name': 'volume-4ee1fe39-90f2-4390-8b31-af3404b18c35', 'volume_size': 2}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:14:14 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-22c0b07c-83e8-4636-ad48-5615d7b3f2ee tempest-VolumesSnapshotNegativeTestJSON-197834191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a733648-75a9-497d-81b0-11a2faeba3c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:14:14 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-22c0b07c-83e8-4636-ad48-5615d7b3f2ee tempest-VolumesSnapshotNegativeTestJSON-197834191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a733648-75a9-497d-81b0-11a2faeba3c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:14:14 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-22c0b07c-83e8-4636-ad48-5615d7b3f2ee tempest-VolumesSnapshotNegativeTestJSON-197834191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5db1e44d-aa7a-4d4b-8d84-6e87abfe35b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:14:14 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-22c0b07c-83e8-4636-ad48-5615d7b3f2ee tempest-VolumesSnapshotNegativeTestJSON-197834191 None] Volume 4ee1fe39-90f2-4390-8b31-af3404b18c35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ee1fe39-90f2-4390-8b31-af3404b18c35', 'volume_size': 2} Apr 16 15:14:14 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-22c0b07c-83e8-4636-ad48-5615d7b3f2ee tempest-VolumesSnapshotNegativeTestJSON-197834191 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:14:14 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-22c0b07c-83e8-4636-ad48-5615d7b3f2ee tempest-VolumesSnapshotNegativeTestJSON-197834191 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:14:14 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-22c0b07c-83e8-4636-ad48-5615d7b3f2ee tempest-VolumesSnapshotNegativeTestJSON-197834191 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:14:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-801976545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ee1fe39-90f2-4390-8b31-af3404b18c35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c867d99f8684625bacbb2dfaf267271',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:14:14Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:14:14Z,use_quota=True,user_id='da04372312134613b15ec25fb2b7be5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)}" {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 15:14:14 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-22c0b07c-83e8-4636-ad48-5615d7b3f2ee tempest-VolumesSnapshotNegativeTestJSON-197834191 None] Creating volume 4ee1fe39-90f2-4390-8b31-af3404b18c35 {{(pid=82756) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 15:14:14 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-22c0b07c-83e8-4636-ad48-5615d7b3f2ee tempest-VolumesSnapshotNegativeTestJSON-197834191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:14:14 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-22c0b07c-83e8-4636-ad48-5615d7b3f2ee tempest-VolumesSnapshotNegativeTestJSON-197834191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:14:14 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-22c0b07c-83e8-4636-ad48-5615d7b3f2ee tempest-VolumesSnapshotNegativeTestJSON-197834191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:14:14 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-22c0b07c-83e8-4636-ad48-5615d7b3f2ee tempest-VolumesSnapshotNegativeTestJSON-197834191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:14:14 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-22c0b07c-83e8-4636-ad48-5615d7b3f2ee tempest-VolumesSnapshotNegativeTestJSON-197834191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:14:14 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-22c0b07c-83e8-4636-ad48-5615d7b3f2ee tempest-VolumesSnapshotNegativeTestJSON-197834191 None] Selected osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 as target Quobyte volume. {{(pid=82756) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 15:14:14 devstack cinder-volume[82756]: INFO cinder.volume.drivers.remotefs [None req-22c0b07c-83e8-4636-ad48-5615d7b3f2ee tempest-VolumesSnapshotNegativeTestJSON-197834191 None] casted to osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 Apr 16 15:14:14 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-22c0b07c-83e8-4636-ad48-5615d7b3f2ee tempest-VolumesSnapshotNegativeTestJSON-197834191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-4ee1fe39-90f2-4390-8b31-af3404b18c35 2147483648 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:14:14 devstack sudo[90325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-4ee1fe39-90f2-4390-8b31-af3404b18c35 2147483648 Apr 16 15:14:14 devstack sudo[90325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:14:15 devstack sudo[90325]: pam_unix(sudo:session): session closed for user root Apr 16 15:14:15 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-22c0b07c-83e8-4636-ad48-5615d7b3f2ee tempest-VolumesSnapshotNegativeTestJSON-197834191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-4ee1fe39-90f2-4390-8b31-af3404b18c35 2147483648" returned: 0 in 0.575s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:14:15 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-22c0b07c-83e8-4636-ad48-5615d7b3f2ee tempest-VolumesSnapshotNegativeTestJSON-197834191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-4ee1fe39-90f2-4390-8b31-af3404b18c35 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:14:15 devstack sudo[90331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-4ee1fe39-90f2-4390-8b31-af3404b18c35 Apr 16 15:14:15 devstack sudo[90331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:14:15 devstack sudo[90331]: pam_unix(sudo:session): session closed for user root Apr 16 15:14:15 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-22c0b07c-83e8-4636-ad48-5615d7b3f2ee tempest-VolumesSnapshotNegativeTestJSON-197834191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-4ee1fe39-90f2-4390-8b31-af3404b18c35" returned: 0 in 0.453s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:14:15 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-22c0b07c-83e8-4636-ad48-5615d7b3f2ee tempest-VolumesSnapshotNegativeTestJSON-197834191 None] <== create_volume: return (1054ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'} {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 15:14:15 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-22c0b07c-83e8-4636-ad48-5615d7b3f2ee tempest-VolumesSnapshotNegativeTestJSON-197834191 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.056s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:14:15 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-22c0b07c-83e8-4636-ad48-5615d7b3f2ee tempest-VolumesSnapshotNegativeTestJSON-197834191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5db1e44d-aa7a-4d4b-8d84-6e87abfe35b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ee1fe39-90f2-4390-8b31-af3404b18c35', 'volume_size': 2}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:14:15 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-22c0b07c-83e8-4636-ad48-5615d7b3f2ee tempest-VolumesSnapshotNegativeTestJSON-197834191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07820cbc-2288-48e2-b2be-61965b55a463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:14:15 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-22c0b07c-83e8-4636-ad48-5615d7b3f2ee tempest-VolumesSnapshotNegativeTestJSON-197834191 None] Volume volume-4ee1fe39-90f2-4390-8b31-af3404b18c35 (4ee1fe39-90f2-4390-8b31-af3404b18c35): created successfully Apr 16 15:14:15 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-22c0b07c-83e8-4636-ad48-5615d7b3f2ee tempest-VolumesSnapshotNegativeTestJSON-197834191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07820cbc-2288-48e2-b2be-61965b55a463) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:14:15 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-22c0b07c-83e8-4636-ad48-5615d7b3f2ee tempest-VolumesSnapshotNegativeTestJSON-197834191 None] Flow 'volume_create_manager' (b48b477a-fb16-4cc2-af8c-e0b0815cfe13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:14:15 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-22c0b07c-83e8-4636-ad48-5615d7b3f2ee tempest-VolumesSnapshotNegativeTestJSON-197834191 None] Created volume successfully. Apr 16 15:14:16 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-e0b518b4-a781-4023-a875-38ec238f48a0 tempest-VolumesSnapshotNegativeTestJSON-197834191 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:14:16 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-e0b518b4-a781-4023-a875-38ec238f48a0 tempest-VolumesSnapshotNegativeTestJSON-197834191 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:14:16 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-e0b518b4-a781-4023-a875-38ec238f48a0 tempest-VolumesSnapshotNegativeTestJSON-197834191 None] Creating offline snapshot 114c6213-5b97-4441-bf79-01d78ed34614 of volume 4ee1fe39-90f2-4390-8b31-af3404b18c35 {{(pid=82756) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 16 15:14:16 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca286423-5f05-410a-9636-0ab935fdd2e9]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:14:16 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-e0b518b4-a781-4023-a875-38ec238f48a0 tempest-VolumesSnapshotNegativeTestJSON-197834191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-4ee1fe39-90f2-4390-8b31-af3404b18c35 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:14:16 devstack sudo[90334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-4ee1fe39-90f2-4390-8b31-af3404b18c35 Apr 16 15:14:16 devstack sudo[90334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:14:17 devstack sudo[90334]: pam_unix(sudo:session): session closed for user root Apr 16 15:14:17 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-e0b518b4-a781-4023-a875-38ec238f48a0 tempest-VolumesSnapshotNegativeTestJSON-197834191 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-4ee1fe39-90f2-4390-8b31-af3404b18c35" returned: 0 in 0.532s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:14:17 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-e0b518b4-a781-4023-a875-38ec238f48a0 tempest-VolumesSnapshotNegativeTestJSON-197834191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-4ee1fe39-90f2-4390-8b31-af3404b18c35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-4ee1fe39-90f2-4390-8b31-af3404b18c35.114c6213-5b97-4441-bf79-01d78ed34614 2G {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:14:17 devstack sudo[90339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-4ee1fe39-90f2-4390-8b31-af3404b18c35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-4ee1fe39-90f2-4390-8b31-af3404b18c35.114c6213-5b97-4441-bf79-01d78ed34614 2G Apr 16 15:14:17 devstack sudo[90339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:14:17 devstack sudo[90339]: pam_unix(sudo:session): session closed for user root Apr 16 15:14:17 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-e0b518b4-a781-4023-a875-38ec238f48a0 tempest-VolumesSnapshotNegativeTestJSON-197834191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-4ee1fe39-90f2-4390-8b31-af3404b18c35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-4ee1fe39-90f2-4390-8b31-af3404b18c35.114c6213-5b97-4441-bf79-01d78ed34614 2G" returned: 0 in 0.564s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:14:17 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-e0b518b4-a781-4023-a875-38ec238f48a0 tempest-VolumesSnapshotNegativeTestJSON-197834191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ee1fe39-90f2-4390-8b31-af3404b18c35 -F qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-4ee1fe39-90f2-4390-8b31-af3404b18c35.114c6213-5b97-4441-bf79-01d78ed34614 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:14:17 devstack sudo[90344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ee1fe39-90f2-4390-8b31-af3404b18c35 -F qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-4ee1fe39-90f2-4390-8b31-af3404b18c35.114c6213-5b97-4441-bf79-01d78ed34614 Apr 16 15:14:17 devstack sudo[90344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:14:18 devstack sudo[90344]: pam_unix(sudo:session): session closed for user root Apr 16 15:14:18 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-e0b518b4-a781-4023-a875-38ec238f48a0 tempest-VolumesSnapshotNegativeTestJSON-197834191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ee1fe39-90f2-4390-8b31-af3404b18c35 -F qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-4ee1fe39-90f2-4390-8b31-af3404b18c35.114c6213-5b97-4441-bf79-01d78ed34614" returned: 0 in 0.420s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:14:18 devstack cinder-volume[82756]: WARNING cinder.volume.drivers.remotefs [None req-e0b518b4-a781-4023-a875-38ec238f48a0 tempest-VolumesSnapshotNegativeTestJSON-197834191 None] /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-4ee1fe39-90f2-4390-8b31-af3404b18c35.114c6213-5b97-4441-bf79-01d78ed34614 is being set with open permissions: ugo+rw Apr 16 15:14:18 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-e0b518b4-a781-4023-a875-38ec238f48a0 tempest-VolumesSnapshotNegativeTestJSON-197834191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-4ee1fe39-90f2-4390-8b31-af3404b18c35.114c6213-5b97-4441-bf79-01d78ed34614 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:14:18 devstack sudo[90349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-4ee1fe39-90f2-4390-8b31-af3404b18c35.114c6213-5b97-4441-bf79-01d78ed34614 Apr 16 15:14:18 devstack sudo[90349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:14:18 devstack sudo[90349]: pam_unix(sudo:session): session closed for user root Apr 16 15:14:18 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-e0b518b4-a781-4023-a875-38ec238f48a0 tempest-VolumesSnapshotNegativeTestJSON-197834191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-4ee1fe39-90f2-4390-8b31-af3404b18c35.114c6213-5b97-4441-bf79-01d78ed34614" returned: 0 in 0.422s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:14:18 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-e0b518b4-a781-4023-a875-38ec238f48a0 tempest-VolumesSnapshotNegativeTestJSON-197834191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-4ee1fe39-90f2-4390-8b31-af3404b18c35.info {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:14:18 devstack sudo[90352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-4ee1fe39-90f2-4390-8b31-af3404b18c35.info Apr 16 15:14:18 devstack sudo[90352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:14:19 devstack sudo[90352]: pam_unix(sudo:session): session closed for user root Apr 16 15:14:19 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-e0b518b4-a781-4023-a875-38ec238f48a0 tempest-VolumesSnapshotNegativeTestJSON-197834191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-4ee1fe39-90f2-4390-8b31-af3404b18c35.info" returned: 0 in 0.451s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:14:19 devstack cinder-volume[82756]: WARNING cinder.volume.drivers.remotefs [None req-e0b518b4-a781-4023-a875-38ec238f48a0 tempest-VolumesSnapshotNegativeTestJSON-197834191 None] /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-4ee1fe39-90f2-4390-8b31-af3404b18c35.info is being set with open permissions: ugo+rw Apr 16 15:14:19 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-e0b518b4-a781-4023-a875-38ec238f48a0 tempest-VolumesSnapshotNegativeTestJSON-197834191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-4ee1fe39-90f2-4390-8b31-af3404b18c35.info {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:14:19 devstack sudo[90355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-4ee1fe39-90f2-4390-8b31-af3404b18c35.info Apr 16 15:14:19 devstack sudo[90355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:14:19 devstack sudo[90355]: pam_unix(sudo:session): session closed for user root Apr 16 15:14:19 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-e0b518b4-a781-4023-a875-38ec238f48a0 tempest-VolumesSnapshotNegativeTestJSON-197834191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-4ee1fe39-90f2-4390-8b31-af3404b18c35.info" returned: 0 in 0.392s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:14:19 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-e0b518b4-a781-4023-a875-38ec238f48a0 tempest-VolumesSnapshotNegativeTestJSON-197834191 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.847s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:14:19 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-e0b518b4-a781-4023-a875-38ec238f48a0 tempest-VolumesSnapshotNegativeTestJSON-197834191 None] Create snapshot completed successfully Apr 16 15:14:19 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-677830fc-4996-448d-96b7-64bed102ec0f tempest-VolumesSnapshotNegativeTestJSON-197834191 None] Acquiring lock "cinder-114c6213-5b97-4441-bf79-01d78ed34614-delete_snapshot" by "delete_snapshot" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:14:19 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-677830fc-4996-448d-96b7-64bed102ec0f tempest-VolumesSnapshotNegativeTestJSON-197834191 None] Lock "cinder-114c6213-5b97-4441-bf79-01d78ed34614-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:14:19 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-677830fc-4996-448d-96b7-64bed102ec0f tempest-VolumesSnapshotNegativeTestJSON-197834191 None] Acquiring lock "cinder-quobyte-4ee1fe39-90f2-4390-8b31-af3404b18c35" by "delete_snapshot" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:14:19 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-677830fc-4996-448d-96b7-64bed102ec0f tempest-VolumesSnapshotNegativeTestJSON-197834191 None] Lock "cinder-quobyte-4ee1fe39-90f2-4390-8b31-af3404b18c35" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:14:19 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-677830fc-4996-448d-96b7-64bed102ec0f tempest-VolumesSnapshotNegativeTestJSON-197834191 None] Acquiring lock "cinder-quobyte-114c6213-5b97-4441-bf79-01d78ed34614" by "_delete_snapshot" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:14:19 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-677830fc-4996-448d-96b7-64bed102ec0f tempest-VolumesSnapshotNegativeTestJSON-197834191 None] Lock "cinder-quobyte-114c6213-5b97-4441-bf79-01d78ed34614" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:14:19 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-677830fc-4996-448d-96b7-64bed102ec0f tempest-VolumesSnapshotNegativeTestJSON-197834191 None] Deleting offline snapshot 114c6213-5b97-4441-bf79-01d78ed34614 of volume 4ee1fe39-90f2-4390-8b31-af3404b18c35 {{(pid=82756) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 15:14:19 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-677830fc-4996-448d-96b7-64bed102ec0f tempest-VolumesSnapshotNegativeTestJSON-197834191 None] snapshot_file for this snap is: volume-4ee1fe39-90f2-4390-8b31-af3404b18c35.114c6213-5b97-4441-bf79-01d78ed34614 {{(pid=82756) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 15:14:19 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[a573eae2-c619-403b-bc60-0bd8fa6dcc91]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:14:19 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-677830fc-4996-448d-96b7-64bed102ec0f tempest-VolumesSnapshotNegativeTestJSON-197834191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-4ee1fe39-90f2-4390-8b31-af3404b18c35.114c6213-5b97-4441-bf79-01d78ed34614 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:14:20 devstack sudo[90358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-4ee1fe39-90f2-4390-8b31-af3404b18c35.114c6213-5b97-4441-bf79-01d78ed34614 Apr 16 15:14:20 devstack sudo[90358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:14:20 devstack sudo[90358]: pam_unix(sudo:session): session closed for user root Apr 16 15:14:20 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-677830fc-4996-448d-96b7-64bed102ec0f tempest-VolumesSnapshotNegativeTestJSON-197834191 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-4ee1fe39-90f2-4390-8b31-af3404b18c35.114c6213-5b97-4441-bf79-01d78ed34614" returned: 0 in 0.459s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:14:20 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-677830fc-4996-448d-96b7-64bed102ec0f tempest-VolumesSnapshotNegativeTestJSON-197834191 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ee1fe39-90f2-4390-8b31-af3404b18c35(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82756) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 15:14:20 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1895716-2db6-49d8-a6d6-b81f13ddcc2d]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:14:20 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-677830fc-4996-448d-96b7-64bed102ec0f tempest-VolumesSnapshotNegativeTestJSON-197834191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-4ee1fe39-90f2-4390-8b31-af3404b18c35 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:14:20 devstack sudo[90363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-4ee1fe39-90f2-4390-8b31-af3404b18c35 Apr 16 15:14:20 devstack sudo[90363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:14:20 devstack sudo[90363]: pam_unix(sudo:session): session closed for user root Apr 16 15:14:20 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-677830fc-4996-448d-96b7-64bed102ec0f tempest-VolumesSnapshotNegativeTestJSON-197834191 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-4ee1fe39-90f2-4390-8b31-af3404b18c35" returned: 0 in 0.464s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:14:20 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-677830fc-4996-448d-96b7-64bed102ec0f tempest-VolumesSnapshotNegativeTestJSON-197834191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-4ee1fe39-90f2-4390-8b31-af3404b18c35.114c6213-5b97-4441-bf79-01d78ed34614 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:14:20 devstack sudo[90368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-4ee1fe39-90f2-4390-8b31-af3404b18c35.114c6213-5b97-4441-bf79-01d78ed34614 Apr 16 15:14:20 devstack sudo[90368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:14:21 devstack sudo[90368]: pam_unix(sudo:session): session closed for user root Apr 16 15:14:21 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-677830fc-4996-448d-96b7-64bed102ec0f tempest-VolumesSnapshotNegativeTestJSON-197834191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-4ee1fe39-90f2-4390-8b31-af3404b18c35.114c6213-5b97-4441-bf79-01d78ed34614" returned: 0 in 0.511s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:14:21 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-677830fc-4996-448d-96b7-64bed102ec0f tempest-VolumesSnapshotNegativeTestJSON-197834191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-4ee1fe39-90f2-4390-8b31-af3404b18c35.114c6213-5b97-4441-bf79-01d78ed34614 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:14:21 devstack sudo[90373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-4ee1fe39-90f2-4390-8b31-af3404b18c35.114c6213-5b97-4441-bf79-01d78ed34614 Apr 16 15:14:21 devstack sudo[90373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:14:21 devstack sudo[90373]: pam_unix(sudo:session): session closed for user root Apr 16 15:14:21 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-677830fc-4996-448d-96b7-64bed102ec0f tempest-VolumesSnapshotNegativeTestJSON-197834191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-4ee1fe39-90f2-4390-8b31-af3404b18c35.114c6213-5b97-4441-bf79-01d78ed34614" returned: 0 in 0.435s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:14:21 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-677830fc-4996-448d-96b7-64bed102ec0f tempest-VolumesSnapshotNegativeTestJSON-197834191 None] Lock "cinder-quobyte-114c6213-5b97-4441-bf79-01d78ed34614" released by "_delete_snapshot" :: held 1.931s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:14:21 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-677830fc-4996-448d-96b7-64bed102ec0f tempest-VolumesSnapshotNegativeTestJSON-197834191 None] Lock "cinder-quobyte-4ee1fe39-90f2-4390-8b31-af3404b18c35" released by "delete_snapshot" :: held 1.945s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:14:21 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-677830fc-4996-448d-96b7-64bed102ec0f tempest-VolumesSnapshotNegativeTestJSON-197834191 None] Created reservations ['0322a3ee-12a3-46c9-85de-3091b89d293f', '984ddc74-cd84-4207-b2d7-f6f45448d102', '8357eeed-861a-4f78-b8cc-c49746249f35', 'ca0afb3c-b01c-42db-9f86-f23e7a69e91e'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:14:21 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-677830fc-4996-448d-96b7-64bed102ec0f tempest-VolumesSnapshotNegativeTestJSON-197834191 None] Delete snapshot completed successfully. Apr 16 15:14:21 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-677830fc-4996-448d-96b7-64bed102ec0f tempest-VolumesSnapshotNegativeTestJSON-197834191 None] Lock "cinder-114c6213-5b97-4441-bf79-01d78ed34614-delete_snapshot" released by "delete_snapshot" :: held 2.027s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:14:22 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-7194173e-674d-4f4d-ae72-5e6528a5deaa tempest-VolumesSnapshotNegativeTestJSON-197834191 None] Acquiring lock "cinder-4ee1fe39-90f2-4390-8b31-af3404b18c35-delete_volume" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:14:22 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-7194173e-674d-4f4d-ae72-5e6528a5deaa tempest-VolumesSnapshotNegativeTestJSON-197834191 None] Lock "cinder-4ee1fe39-90f2-4390-8b31-af3404b18c35-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:14:22 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-7194173e-674d-4f4d-ae72-5e6528a5deaa tempest-VolumesSnapshotNegativeTestJSON-197834191 None] Acquiring lock "cinder-quobyte-4ee1fe39-90f2-4390-8b31-af3404b18c35" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:14:22 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-7194173e-674d-4f4d-ae72-5e6528a5deaa tempest-VolumesSnapshotNegativeTestJSON-197834191 None] Lock "cinder-quobyte-4ee1fe39-90f2-4390-8b31-af3404b18c35" acquired by "delete_volume" :: waited 0.006s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:14:22 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[3018549f-5d7a-4d69-9de3-db14549ed494]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:14:22 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-7194173e-674d-4f4d-ae72-5e6528a5deaa tempest-VolumesSnapshotNegativeTestJSON-197834191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-4ee1fe39-90f2-4390-8b31-af3404b18c35 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:14:22 devstack sudo[90376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-4ee1fe39-90f2-4390-8b31-af3404b18c35 Apr 16 15:14:22 devstack sudo[90376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:14:22 devstack sudo[90376]: pam_unix(sudo:session): session closed for user root Apr 16 15:14:22 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-7194173e-674d-4f4d-ae72-5e6528a5deaa tempest-VolumesSnapshotNegativeTestJSON-197834191 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-4ee1fe39-90f2-4390-8b31-af3404b18c35" returned: 0 in 0.469s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:14:22 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-7194173e-674d-4f4d-ae72-5e6528a5deaa tempest-VolumesSnapshotNegativeTestJSON-197834191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-4ee1fe39-90f2-4390-8b31-af3404b18c35 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:14:22 devstack sudo[90381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-4ee1fe39-90f2-4390-8b31-af3404b18c35 Apr 16 15:14:22 devstack sudo[90381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:14:23 devstack sudo[90381]: pam_unix(sudo:session): session closed for user root Apr 16 15:14:23 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-7194173e-674d-4f4d-ae72-5e6528a5deaa tempest-VolumesSnapshotNegativeTestJSON-197834191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-4ee1fe39-90f2-4390-8b31-af3404b18c35" returned: 0 in 0.413s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:14:23 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-7194173e-674d-4f4d-ae72-5e6528a5deaa tempest-VolumesSnapshotNegativeTestJSON-197834191 None] Lock "cinder-quobyte-4ee1fe39-90f2-4390-8b31-af3404b18c35" released by "delete_volume" :: held 0.922s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:14:23 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-7194173e-674d-4f4d-ae72-5e6528a5deaa tempest-VolumesSnapshotNegativeTestJSON-197834191 None] Created reservations ['1b0eb860-7ae2-43ec-993a-6d54f9a1acd8', 'aac672ce-997a-4cf6-8030-a64fa52e6846', 'cfe2b73f-ec06-4378-a575-504025dd7305', 'bc32d8c4-2561-4902-8cd5-95824fc63024'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:14:23 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-7194173e-674d-4f4d-ae72-5e6528a5deaa tempest-VolumesSnapshotNegativeTestJSON-197834191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:14:23 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-7194173e-674d-4f4d-ae72-5e6528a5deaa tempest-VolumesSnapshotNegativeTestJSON-197834191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:14:23 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-7194173e-674d-4f4d-ae72-5e6528a5deaa tempest-VolumesSnapshotNegativeTestJSON-197834191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:14:23 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-7194173e-674d-4f4d-ae72-5e6528a5deaa tempest-VolumesSnapshotNegativeTestJSON-197834191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:14:23 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-7194173e-674d-4f4d-ae72-5e6528a5deaa tempest-VolumesSnapshotNegativeTestJSON-197834191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:14:23 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-7194173e-674d-4f4d-ae72-5e6528a5deaa tempest-VolumesSnapshotNegativeTestJSON-197834191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:14:23 devstack sudo[90384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:14:23 devstack sudo[90384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:14:23 devstack sudo[90384]: pam_unix(sudo:session): session closed for user root Apr 16 15:14:23 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-7194173e-674d-4f4d-ae72-5e6528a5deaa tempest-VolumesSnapshotNegativeTestJSON-197834191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.477s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:14:23 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-7194173e-674d-4f4d-ae72-5e6528a5deaa tempest-VolumesSnapshotNegativeTestJSON-197834191 None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:14:23 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-7194173e-674d-4f4d-ae72-5e6528a5deaa tempest-VolumesSnapshotNegativeTestJSON-197834191 None] Deleted volume successfully. Apr 16 15:14:23 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-7194173e-674d-4f4d-ae72-5e6528a5deaa tempest-VolumesSnapshotNegativeTestJSON-197834191 None] Lock "cinder-4ee1fe39-90f2-4390-8b31-af3404b18c35-delete_volume" released by "delete_volume" :: held 1.547s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:14:24 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c5e891c-20fb-4304-a54c-f892843f1a2e tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82756) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 15:14:24 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-6c5e891c-20fb-4304-a54c-f892843f1a2e tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Flow 'volume_create_manager' (f2d68765-ef7f-4828-8108-ae2ca8d04880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:14:24 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-6c5e891c-20fb-4304-a54c-f892843f1a2e tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65d2e133-efd2-49b4-bd8e-9ec1693ba6e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:14:24 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-6c5e891c-20fb-4304-a54c-f892843f1a2e tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65d2e133-efd2-49b4-bd8e-9ec1693ba6e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:14:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1185784641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4248fce0-5f2b-4a7c-8aa2-7354a1289b84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eac57a26747f4755840bba65171bf337',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:14:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:14:25Z,use_quota=True,user_id='dee0b38d85b04e2dbd3dffe114e7d911',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:14:24 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-6c5e891c-20fb-4304-a54c-f892843f1a2e tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb4d500b-9752-4865-8c95-4a61ac93d656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:14:24 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-6c5e891c-20fb-4304-a54c-f892843f1a2e tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb4d500b-9752-4865-8c95-4a61ac93d656) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:14:24 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-6c5e891c-20fb-4304-a54c-f892843f1a2e tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23066a24-b03a-49d0-a584-da2176ee0125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:14:24 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-6c5e891c-20fb-4304-a54c-f892843f1a2e tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23066a24-b03a-49d0-a584-da2176ee0125) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4248fce0-5f2b-4a7c-8aa2-7354a1289b84', 'volume_name': 'volume-4248fce0-5f2b-4a7c-8aa2-7354a1289b84', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:14:24 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-6c5e891c-20fb-4304-a54c-f892843f1a2e tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc826418-da18-4d3b-9448-c5e708f0701f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:14:24 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-6c5e891c-20fb-4304-a54c-f892843f1a2e tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc826418-da18-4d3b-9448-c5e708f0701f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:14:24 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-6c5e891c-20fb-4304-a54c-f892843f1a2e tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c526b00-ca55-4bbf-bc29-17b63e5aab4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:14:24 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-6c5e891c-20fb-4304-a54c-f892843f1a2e tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Volume 4248fce0-5f2b-4a7c-8aa2-7354a1289b84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4248fce0-5f2b-4a7c-8aa2-7354a1289b84', 'volume_size': 1} Apr 16 15:14:24 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-6c5e891c-20fb-4304-a54c-f892843f1a2e tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:14:24 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-6c5e891c-20fb-4304-a54c-f892843f1a2e tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:14:24 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-6c5e891c-20fb-4304-a54c-f892843f1a2e tempest-CreateVolumesFromSourceVolumeTest-372490148 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:14:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1185784641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4248fce0-5f2b-4a7c-8aa2-7354a1289b84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eac57a26747f4755840bba65171bf337',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:14:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:14:25Z,use_quota=True,user_id='dee0b38d85b04e2dbd3dffe114e7d911',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)}" {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 15:14:24 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-6c5e891c-20fb-4304-a54c-f892843f1a2e tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Creating volume 4248fce0-5f2b-4a7c-8aa2-7354a1289b84 {{(pid=82756) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 15:14:24 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-6c5e891c-20fb-4304-a54c-f892843f1a2e tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:14:24 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-6c5e891c-20fb-4304-a54c-f892843f1a2e tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:14:24 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-6c5e891c-20fb-4304-a54c-f892843f1a2e tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:14:24 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-6c5e891c-20fb-4304-a54c-f892843f1a2e tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:14:25 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-6c5e891c-20fb-4304-a54c-f892843f1a2e tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:14:25 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-6c5e891c-20fb-4304-a54c-f892843f1a2e tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Selected osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 as target Quobyte volume. {{(pid=82756) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 15:14:25 devstack cinder-volume[82756]: INFO cinder.volume.drivers.remotefs [None req-6c5e891c-20fb-4304-a54c-f892843f1a2e tempest-CreateVolumesFromSourceVolumeTest-372490148 None] casted to osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 Apr 16 15:14:25 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-6c5e891c-20fb-4304-a54c-f892843f1a2e tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-4248fce0-5f2b-4a7c-8aa2-7354a1289b84 1073741824 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:14:25 devstack sudo[90388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-4248fce0-5f2b-4a7c-8aa2-7354a1289b84 1073741824 Apr 16 15:14:25 devstack sudo[90388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:14:25 devstack sudo[90388]: pam_unix(sudo:session): session closed for user root Apr 16 15:14:25 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-6c5e891c-20fb-4304-a54c-f892843f1a2e tempest-CreateVolumesFromSourceVolumeTest-372490148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-4248fce0-5f2b-4a7c-8aa2-7354a1289b84 1073741824" returned: 0 in 0.470s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:14:25 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-6c5e891c-20fb-4304-a54c-f892843f1a2e tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-4248fce0-5f2b-4a7c-8aa2-7354a1289b84 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:14:25 devstack sudo[90393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-4248fce0-5f2b-4a7c-8aa2-7354a1289b84 Apr 16 15:14:25 devstack sudo[90393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:14:25 devstack sudo[90393]: pam_unix(sudo:session): session closed for user root Apr 16 15:14:25 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-6c5e891c-20fb-4304-a54c-f892843f1a2e tempest-CreateVolumesFromSourceVolumeTest-372490148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-4248fce0-5f2b-4a7c-8aa2-7354a1289b84" returned: 0 in 0.425s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:14:25 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-6c5e891c-20fb-4304-a54c-f892843f1a2e tempest-CreateVolumesFromSourceVolumeTest-372490148 None] <== create_volume: return (921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'} {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 15:14:25 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-6c5e891c-20fb-4304-a54c-f892843f1a2e tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.924s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:14:25 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-6c5e891c-20fb-4304-a54c-f892843f1a2e tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c526b00-ca55-4bbf-bc29-17b63e5aab4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4248fce0-5f2b-4a7c-8aa2-7354a1289b84', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:14:25 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-6c5e891c-20fb-4304-a54c-f892843f1a2e tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b46cee4-649f-488f-9f21-a353335aecf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:14:25 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-6c5e891c-20fb-4304-a54c-f892843f1a2e tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Volume volume-4248fce0-5f2b-4a7c-8aa2-7354a1289b84 (4248fce0-5f2b-4a7c-8aa2-7354a1289b84): created successfully Apr 16 15:14:25 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-6c5e891c-20fb-4304-a54c-f892843f1a2e tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b46cee4-649f-488f-9f21-a353335aecf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:14:25 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-6c5e891c-20fb-4304-a54c-f892843f1a2e tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Flow 'volume_create_manager' (f2d68765-ef7f-4828-8108-ae2ca8d04880) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:14:25 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-6c5e891c-20fb-4304-a54c-f892843f1a2e tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Created volume successfully. Apr 16 15:14:27 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bc9c915-df95-48a0-8e20-51a418014133 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82756) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 15:14:27 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-2bc9c915-df95-48a0-8e20-51a418014133 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Flow 'volume_create_manager' (602cb961-757e-473c-93d9-9bdf07e2087c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:14:27 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-2bc9c915-df95-48a0-8e20-51a418014133 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8ed3407-4d72-4687-8c23-0f98943b312b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:14:27 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-2bc9c915-df95-48a0-8e20-51a418014133 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8ed3407-4d72-4687-8c23-0f98943b312b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:14:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-496900322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=464fcb61-6c83-47a0-83a1-811c957b55c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eac57a26747f4755840bba65171bf337',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:14:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:14:27Z,use_quota=True,user_id='dee0b38d85b04e2dbd3dffe114e7d911',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:14:27 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-2bc9c915-df95-48a0-8e20-51a418014133 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffd77877-7c96-4f7b-a42e-c842102b187f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:14:27 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-2bc9c915-df95-48a0-8e20-51a418014133 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffd77877-7c96-4f7b-a42e-c842102b187f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:14:27 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-2bc9c915-df95-48a0-8e20-51a418014133 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e475328-81b8-4747-ba24-fe5424ca5e69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:14:27 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-2bc9c915-df95-48a0-8e20-51a418014133 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e475328-81b8-4747-ba24-fe5424ca5e69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '464fcb61-6c83-47a0-83a1-811c957b55c2', 'volume_name': 'volume-464fcb61-6c83-47a0-83a1-811c957b55c2', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:14:27 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-2bc9c915-df95-48a0-8e20-51a418014133 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13aeb37e-efb3-4ba5-a886-eb1ff91ca474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:14:27 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-2bc9c915-df95-48a0-8e20-51a418014133 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13aeb37e-efb3-4ba5-a886-eb1ff91ca474) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:14:27 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-2bc9c915-df95-48a0-8e20-51a418014133 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2010ad2b-a30f-43d7-b611-f205f9315dde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:14:27 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-2bc9c915-df95-48a0-8e20-51a418014133 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Volume 464fcb61-6c83-47a0-83a1-811c957b55c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-464fcb61-6c83-47a0-83a1-811c957b55c2', 'volume_size': 1} Apr 16 15:14:27 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-2bc9c915-df95-48a0-8e20-51a418014133 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:14:27 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-2bc9c915-df95-48a0-8e20-51a418014133 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:14:27 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-2bc9c915-df95-48a0-8e20-51a418014133 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:14:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-496900322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=464fcb61-6c83-47a0-83a1-811c957b55c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eac57a26747f4755840bba65171bf337',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:14:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:14:27Z,use_quota=True,user_id='dee0b38d85b04e2dbd3dffe114e7d911',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)}" {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 15:14:27 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-2bc9c915-df95-48a0-8e20-51a418014133 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Creating volume 464fcb61-6c83-47a0-83a1-811c957b55c2 {{(pid=82756) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 15:14:27 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-2bc9c915-df95-48a0-8e20-51a418014133 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:14:27 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-2bc9c915-df95-48a0-8e20-51a418014133 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:14:27 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-2bc9c915-df95-48a0-8e20-51a418014133 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:14:27 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-2bc9c915-df95-48a0-8e20-51a418014133 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:14:27 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-2bc9c915-df95-48a0-8e20-51a418014133 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:14:27 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-2bc9c915-df95-48a0-8e20-51a418014133 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Selected osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 as target Quobyte volume. {{(pid=82756) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 15:14:27 devstack cinder-volume[82756]: INFO cinder.volume.drivers.remotefs [None req-2bc9c915-df95-48a0-8e20-51a418014133 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] casted to osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 Apr 16 15:14:27 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-2bc9c915-df95-48a0-8e20-51a418014133 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-464fcb61-6c83-47a0-83a1-811c957b55c2 1073741824 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:14:27 devstack sudo[90396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-464fcb61-6c83-47a0-83a1-811c957b55c2 1073741824 Apr 16 15:14:27 devstack sudo[90396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:14:27 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [None req-764c292b-ed56-4002-8479-384ee95010e8 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82756) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 15:14:27 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-764c292b-ed56-4002-8479-384ee95010e8 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Flow 'volume_create_manager' (1049c48d-eb92-4e1f-8f0b-0d210e53963d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:14:27 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-764c292b-ed56-4002-8479-384ee95010e8 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efe295c7-46d8-4d17-bf7a-2fc281b7d725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:14:27 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-764c292b-ed56-4002-8479-384ee95010e8 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efe295c7-46d8-4d17-bf7a-2fc281b7d725) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:14:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1708608393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a62fae48-7fc9-40d9-ae94-6f0b99e98440,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eac57a26747f4755840bba65171bf337',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:14:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:14:27Z,use_quota=True,user_id='dee0b38d85b04e2dbd3dffe114e7d911',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:14:27 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-764c292b-ed56-4002-8479-384ee95010e8 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6a90cbc-b796-4432-91ea-ea8504bb6c2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:14:27 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-764c292b-ed56-4002-8479-384ee95010e8 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6a90cbc-b796-4432-91ea-ea8504bb6c2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:14:27 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-764c292b-ed56-4002-8479-384ee95010e8 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27ccaee2-5c82-4622-a343-4d6ab4062933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:14:27 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-764c292b-ed56-4002-8479-384ee95010e8 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27ccaee2-5c82-4622-a343-4d6ab4062933) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a62fae48-7fc9-40d9-ae94-6f0b99e98440', 'volume_name': 'volume-a62fae48-7fc9-40d9-ae94-6f0b99e98440', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:14:27 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-764c292b-ed56-4002-8479-384ee95010e8 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98974f67-c522-4aaa-83ef-0456921a0dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:14:27 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-764c292b-ed56-4002-8479-384ee95010e8 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98974f67-c522-4aaa-83ef-0456921a0dab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:14:27 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-764c292b-ed56-4002-8479-384ee95010e8 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (797ee7e4-5c34-4239-9493-104e456aa3b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:14:27 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-764c292b-ed56-4002-8479-384ee95010e8 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Volume a62fae48-7fc9-40d9-ae94-6f0b99e98440: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a62fae48-7fc9-40d9-ae94-6f0b99e98440', 'volume_size': 1} Apr 16 15:14:27 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-764c292b-ed56-4002-8479-384ee95010e8 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:14:27 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbefd9a2-6e84-4c67-a222-e75ceb13843d tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82756) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 15:14:27 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-bbefd9a2-6e84-4c67-a222-e75ceb13843d tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Flow 'volume_create_manager' (f983068b-e949-4199-94e3-ef54b82f6b36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:14:27 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-bbefd9a2-6e84-4c67-a222-e75ceb13843d tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43e24e22-c736-48be-b07f-24caebda591e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:14:27 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-bbefd9a2-6e84-4c67-a222-e75ceb13843d tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43e24e22-c736-48be-b07f-24caebda591e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:14:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1991581347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54dbc597-2d6a-4494-80b7-2054b0721912,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eac57a26747f4755840bba65171bf337',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:14:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:14:28Z,use_quota=True,user_id='dee0b38d85b04e2dbd3dffe114e7d911',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:14:27 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-bbefd9a2-6e84-4c67-a222-e75ceb13843d tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d26c6e1-bb87-49b9-98d4-dd8baca14ae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:14:27 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-bbefd9a2-6e84-4c67-a222-e75ceb13843d tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d26c6e1-bb87-49b9-98d4-dd8baca14ae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:14:27 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-bbefd9a2-6e84-4c67-a222-e75ceb13843d tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1983c15d-593c-4aef-8d1d-12230f85cdc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:14:27 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-bbefd9a2-6e84-4c67-a222-e75ceb13843d tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1983c15d-593c-4aef-8d1d-12230f85cdc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54dbc597-2d6a-4494-80b7-2054b0721912', 'volume_name': 'volume-54dbc597-2d6a-4494-80b7-2054b0721912', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:14:27 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-bbefd9a2-6e84-4c67-a222-e75ceb13843d tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8a2a942-4552-40f0-87b7-342b33754fe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:14:27 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-bbefd9a2-6e84-4c67-a222-e75ceb13843d tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8a2a942-4552-40f0-87b7-342b33754fe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:14:27 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-bbefd9a2-6e84-4c67-a222-e75ceb13843d tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb41301f-b508-47f1-beb5-fbfe97838253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:14:27 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-bbefd9a2-6e84-4c67-a222-e75ceb13843d tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Volume 54dbc597-2d6a-4494-80b7-2054b0721912: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54dbc597-2d6a-4494-80b7-2054b0721912', 'volume_size': 1} Apr 16 15:14:27 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-bbefd9a2-6e84-4c67-a222-e75ceb13843d tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:14:27 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd33a8a0-763d-4e2d-a8c3-b574fe189c8e tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82756) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 15:14:27 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-fd33a8a0-763d-4e2d-a8c3-b574fe189c8e tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Flow 'volume_create_manager' (2425d8ac-9bd3-45f0-afb4-2001b79e67b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:14:27 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-fd33a8a0-763d-4e2d-a8c3-b574fe189c8e tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34fa2570-3f04-4019-9817-e2ed0e24547c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:14:27 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-fd33a8a0-763d-4e2d-a8c3-b574fe189c8e tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34fa2570-3f04-4019-9817-e2ed0e24547c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:14:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1197686035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecf8f453-8cc4-42cb-bd2d-e49a458528f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eac57a26747f4755840bba65171bf337',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:14:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:14:28Z,use_quota=True,user_id='dee0b38d85b04e2dbd3dffe114e7d911',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:14:27 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-fd33a8a0-763d-4e2d-a8c3-b574fe189c8e tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9841f828-b7ff-4a9a-9c13-41b114c5cded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:14:27 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-fd33a8a0-763d-4e2d-a8c3-b574fe189c8e tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9841f828-b7ff-4a9a-9c13-41b114c5cded) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:14:27 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-fd33a8a0-763d-4e2d-a8c3-b574fe189c8e tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58506ea4-5700-492c-91d5-f1531f8862c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:14:27 devstack sudo[90396]: pam_unix(sudo:session): session closed for user root Apr 16 15:14:27 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-fd33a8a0-763d-4e2d-a8c3-b574fe189c8e tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58506ea4-5700-492c-91d5-f1531f8862c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ecf8f453-8cc4-42cb-bd2d-e49a458528f5', 'volume_name': 'volume-ecf8f453-8cc4-42cb-bd2d-e49a458528f5', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:14:27 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-fd33a8a0-763d-4e2d-a8c3-b574fe189c8e tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a081811-e1c1-4090-9e07-c7bf56f7058e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:14:27 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-fd33a8a0-763d-4e2d-a8c3-b574fe189c8e tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a081811-e1c1-4090-9e07-c7bf56f7058e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:14:27 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-fd33a8a0-763d-4e2d-a8c3-b574fe189c8e tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56fdaae1-f8fe-4fec-9a77-58ce6d0ad6fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:14:27 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-fd33a8a0-763d-4e2d-a8c3-b574fe189c8e tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Volume ecf8f453-8cc4-42cb-bd2d-e49a458528f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ecf8f453-8cc4-42cb-bd2d-e49a458528f5', 'volume_size': 1} Apr 16 15:14:27 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-fd33a8a0-763d-4e2d-a8c3-b574fe189c8e tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:14:27 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-2bc9c915-df95-48a0-8e20-51a418014133 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-464fcb61-6c83-47a0-83a1-811c957b55c2 1073741824" returned: 0 in 0.607s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:14:27 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-2bc9c915-df95-48a0-8e20-51a418014133 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-464fcb61-6c83-47a0-83a1-811c957b55c2 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:14:27 devstack sudo[90401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-464fcb61-6c83-47a0-83a1-811c957b55c2 Apr 16 15:14:27 devstack sudo[90401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:14:28 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f3bdc8f-120a-445e-aa87-429ec35cf55f tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82756) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 15:14:28 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-2f3bdc8f-120a-445e-aa87-429ec35cf55f tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Flow 'volume_create_manager' (378e1ad4-9792-4000-8b01-c9337cd65a47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:14:28 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-2f3bdc8f-120a-445e-aa87-429ec35cf55f tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d5eb8f8-5c7d-42a3-8933-b8e6bf9b0cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:14:28 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-2f3bdc8f-120a-445e-aa87-429ec35cf55f tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d5eb8f8-5c7d-42a3-8933-b8e6bf9b0cb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:14:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1112249273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7162565-9537-4678-aed9-022b30aebb15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eac57a26747f4755840bba65171bf337',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:14:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:14:28Z,use_quota=True,user_id='dee0b38d85b04e2dbd3dffe114e7d911',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:14:28 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-2f3bdc8f-120a-445e-aa87-429ec35cf55f tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5066f2f0-2519-4484-9ddb-2a9900050d89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:14:28 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-2f3bdc8f-120a-445e-aa87-429ec35cf55f tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5066f2f0-2519-4484-9ddb-2a9900050d89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:14:28 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-2f3bdc8f-120a-445e-aa87-429ec35cf55f tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be691269-9104-470a-a9ef-db8cc4c269b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:14:28 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-2f3bdc8f-120a-445e-aa87-429ec35cf55f tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be691269-9104-470a-a9ef-db8cc4c269b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7162565-9537-4678-aed9-022b30aebb15', 'volume_name': 'volume-e7162565-9537-4678-aed9-022b30aebb15', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:14:28 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-2f3bdc8f-120a-445e-aa87-429ec35cf55f tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22faa27b-50ef-413b-aab2-36536c1f2e18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:14:28 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-2f3bdc8f-120a-445e-aa87-429ec35cf55f tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22faa27b-50ef-413b-aab2-36536c1f2e18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:14:28 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-2f3bdc8f-120a-445e-aa87-429ec35cf55f tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6eaee479-6c9f-40fe-b022-6e9cf1b5b162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:14:28 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-2f3bdc8f-120a-445e-aa87-429ec35cf55f tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Volume e7162565-9537-4678-aed9-022b30aebb15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7162565-9537-4678-aed9-022b30aebb15', 'volume_size': 1} Apr 16 15:14:28 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-2f3bdc8f-120a-445e-aa87-429ec35cf55f tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:14:28 devstack sudo[90401]: pam_unix(sudo:session): session closed for user root Apr 16 15:14:28 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-2bc9c915-df95-48a0-8e20-51a418014133 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-464fcb61-6c83-47a0-83a1-811c957b55c2" returned: 0 in 0.457s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:14:28 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-2bc9c915-df95-48a0-8e20-51a418014133 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] <== create_volume: return (1088ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'} {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 15:14:28 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-2bc9c915-df95-48a0-8e20-51a418014133 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.090s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:14:28 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-764c292b-ed56-4002-8479-384ee95010e8 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.876s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:14:28 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-764c292b-ed56-4002-8479-384ee95010e8 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:14:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1708608393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a62fae48-7fc9-40d9-ae94-6f0b99e98440,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eac57a26747f4755840bba65171bf337',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:14:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:14:27Z,use_quota=True,user_id='dee0b38d85b04e2dbd3dffe114e7d911',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)}" {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 15:14:28 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-764c292b-ed56-4002-8479-384ee95010e8 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Creating volume a62fae48-7fc9-40d9-ae94-6f0b99e98440 {{(pid=82756) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 15:14:28 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-764c292b-ed56-4002-8479-384ee95010e8 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:14:28 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-764c292b-ed56-4002-8479-384ee95010e8 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:14:28 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-764c292b-ed56-4002-8479-384ee95010e8 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:14:28 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-764c292b-ed56-4002-8479-384ee95010e8 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:14:28 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-764c292b-ed56-4002-8479-384ee95010e8 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:14:28 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-764c292b-ed56-4002-8479-384ee95010e8 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Selected osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 as target Quobyte volume. {{(pid=82756) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 15:14:28 devstack cinder-volume[82756]: INFO cinder.volume.drivers.remotefs [None req-764c292b-ed56-4002-8479-384ee95010e8 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] casted to osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 Apr 16 15:14:28 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-764c292b-ed56-4002-8479-384ee95010e8 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-a62fae48-7fc9-40d9-ae94-6f0b99e98440 1073741824 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:14:28 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-2bc9c915-df95-48a0-8e20-51a418014133 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2010ad2b-a30f-43d7-b611-f205f9315dde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-464fcb61-6c83-47a0-83a1-811c957b55c2', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:14:28 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-2bc9c915-df95-48a0-8e20-51a418014133 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e645de9b-0a67-4dcf-a89b-dcf956b93d5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:14:28 devstack sudo[90404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-a62fae48-7fc9-40d9-ae94-6f0b99e98440 1073741824 Apr 16 15:14:28 devstack sudo[90404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:14:28 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-2bc9c915-df95-48a0-8e20-51a418014133 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Volume volume-464fcb61-6c83-47a0-83a1-811c957b55c2 (464fcb61-6c83-47a0-83a1-811c957b55c2): created successfully Apr 16 15:14:28 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-2bc9c915-df95-48a0-8e20-51a418014133 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e645de9b-0a67-4dcf-a89b-dcf956b93d5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:14:28 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-2bc9c915-df95-48a0-8e20-51a418014133 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Flow 'volume_create_manager' (602cb961-757e-473c-93d9-9bdf07e2087c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:14:28 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-2bc9c915-df95-48a0-8e20-51a418014133 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Created volume successfully. Apr 16 15:14:28 devstack sudo[90404]: pam_unix(sudo:session): session closed for user root Apr 16 15:14:28 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-764c292b-ed56-4002-8479-384ee95010e8 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-a62fae48-7fc9-40d9-ae94-6f0b99e98440 1073741824" returned: 0 in 0.561s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:14:29 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-764c292b-ed56-4002-8479-384ee95010e8 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-a62fae48-7fc9-40d9-ae94-6f0b99e98440 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:14:29 devstack sudo[90409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-a62fae48-7fc9-40d9-ae94-6f0b99e98440 Apr 16 15:14:29 devstack sudo[90409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:14:29 devstack sudo[90409]: pam_unix(sudo:session): session closed for user root Apr 16 15:14:29 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-764c292b-ed56-4002-8479-384ee95010e8 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-a62fae48-7fc9-40d9-ae94-6f0b99e98440" returned: 0 in 0.457s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:14:29 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-764c292b-ed56-4002-8479-384ee95010e8 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] <== create_volume: return (1043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'} {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 15:14:29 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-764c292b-ed56-4002-8479-384ee95010e8 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.046s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:14:29 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-bbefd9a2-6e84-4c67-a222-e75ceb13843d tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.716s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:14:29 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-bbefd9a2-6e84-4c67-a222-e75ceb13843d tempest-CreateVolumesFromSourceVolumeTest-372490148 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:14:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1991581347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54dbc597-2d6a-4494-80b7-2054b0721912,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eac57a26747f4755840bba65171bf337',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:14:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:14:28Z,use_quota=True,user_id='dee0b38d85b04e2dbd3dffe114e7d911',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)}" {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 15:14:29 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-bbefd9a2-6e84-4c67-a222-e75ceb13843d tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Creating volume 54dbc597-2d6a-4494-80b7-2054b0721912 {{(pid=82756) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 15:14:29 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-bbefd9a2-6e84-4c67-a222-e75ceb13843d tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:14:29 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-bbefd9a2-6e84-4c67-a222-e75ceb13843d tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:14:29 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-bbefd9a2-6e84-4c67-a222-e75ceb13843d tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:14:29 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-bbefd9a2-6e84-4c67-a222-e75ceb13843d tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:14:29 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-bbefd9a2-6e84-4c67-a222-e75ceb13843d tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:14:29 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-bbefd9a2-6e84-4c67-a222-e75ceb13843d tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Selected osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 as target Quobyte volume. {{(pid=82756) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 15:14:29 devstack cinder-volume[82756]: INFO cinder.volume.drivers.remotefs [None req-bbefd9a2-6e84-4c67-a222-e75ceb13843d tempest-CreateVolumesFromSourceVolumeTest-372490148 None] casted to osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 Apr 16 15:14:29 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-bbefd9a2-6e84-4c67-a222-e75ceb13843d tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-54dbc597-2d6a-4494-80b7-2054b0721912 1073741824 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:14:29 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-764c292b-ed56-4002-8479-384ee95010e8 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (797ee7e4-5c34-4239-9493-104e456aa3b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a62fae48-7fc9-40d9-ae94-6f0b99e98440', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:14:29 devstack sudo[90413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-54dbc597-2d6a-4494-80b7-2054b0721912 1073741824 Apr 16 15:14:29 devstack sudo[90413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:14:29 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-764c292b-ed56-4002-8479-384ee95010e8 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03175d5d-171a-4ee6-a24a-bb9c941c9f85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:14:29 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-764c292b-ed56-4002-8479-384ee95010e8 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Volume volume-a62fae48-7fc9-40d9-ae94-6f0b99e98440 (a62fae48-7fc9-40d9-ae94-6f0b99e98440): created successfully Apr 16 15:14:29 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-764c292b-ed56-4002-8479-384ee95010e8 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03175d5d-171a-4ee6-a24a-bb9c941c9f85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:14:29 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-764c292b-ed56-4002-8479-384ee95010e8 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Flow 'volume_create_manager' (1049c48d-eb92-4e1f-8f0b-0d210e53963d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:14:29 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-764c292b-ed56-4002-8479-384ee95010e8 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Created volume successfully. Apr 16 15:14:30 devstack sudo[90413]: pam_unix(sudo:session): session closed for user root Apr 16 15:14:30 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-bbefd9a2-6e84-4c67-a222-e75ceb13843d tempest-CreateVolumesFromSourceVolumeTest-372490148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-54dbc597-2d6a-4494-80b7-2054b0721912 1073741824" returned: 0 in 0.551s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:14:30 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-bbefd9a2-6e84-4c67-a222-e75ceb13843d tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-54dbc597-2d6a-4494-80b7-2054b0721912 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:14:30 devstack sudo[90418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-54dbc597-2d6a-4494-80b7-2054b0721912 Apr 16 15:14:30 devstack sudo[90418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:14:30 devstack sudo[90418]: pam_unix(sudo:session): session closed for user root Apr 16 15:14:30 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-bbefd9a2-6e84-4c67-a222-e75ceb13843d tempest-CreateVolumesFromSourceVolumeTest-372490148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-54dbc597-2d6a-4494-80b7-2054b0721912" returned: 0 in 0.476s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:14:30 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-bbefd9a2-6e84-4c67-a222-e75ceb13843d tempest-CreateVolumesFromSourceVolumeTest-372490148 None] <== create_volume: return (1050ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'} {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 15:14:30 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-bbefd9a2-6e84-4c67-a222-e75ceb13843d tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.053s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:14:30 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-fd33a8a0-763d-4e2d-a8c3-b574fe189c8e tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.587s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:14:30 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-fd33a8a0-763d-4e2d-a8c3-b574fe189c8e tempest-CreateVolumesFromSourceVolumeTest-372490148 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:14:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1197686035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecf8f453-8cc4-42cb-bd2d-e49a458528f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eac57a26747f4755840bba65171bf337',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:14:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:14:28Z,use_quota=True,user_id='dee0b38d85b04e2dbd3dffe114e7d911',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)}" {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 15:14:30 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-fd33a8a0-763d-4e2d-a8c3-b574fe189c8e tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Creating volume ecf8f453-8cc4-42cb-bd2d-e49a458528f5 {{(pid=82756) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 15:14:30 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-fd33a8a0-763d-4e2d-a8c3-b574fe189c8e tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:14:30 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-fd33a8a0-763d-4e2d-a8c3-b574fe189c8e tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:14:30 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-fd33a8a0-763d-4e2d-a8c3-b574fe189c8e tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:14:30 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-fd33a8a0-763d-4e2d-a8c3-b574fe189c8e tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:14:30 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-fd33a8a0-763d-4e2d-a8c3-b574fe189c8e tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:14:30 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-fd33a8a0-763d-4e2d-a8c3-b574fe189c8e tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Selected osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 as target Quobyte volume. {{(pid=82756) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 15:14:30 devstack cinder-volume[82756]: INFO cinder.volume.drivers.remotefs [None req-fd33a8a0-763d-4e2d-a8c3-b574fe189c8e tempest-CreateVolumesFromSourceVolumeTest-372490148 None] casted to osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 Apr 16 15:14:30 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-fd33a8a0-763d-4e2d-a8c3-b574fe189c8e tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-ecf8f453-8cc4-42cb-bd2d-e49a458528f5 1073741824 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:14:30 devstack sudo[90421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-ecf8f453-8cc4-42cb-bd2d-e49a458528f5 1073741824 Apr 16 15:14:30 devstack sudo[90421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:14:30 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-bbefd9a2-6e84-4c67-a222-e75ceb13843d tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb41301f-b508-47f1-beb5-fbfe97838253) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54dbc597-2d6a-4494-80b7-2054b0721912', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:14:30 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-bbefd9a2-6e84-4c67-a222-e75ceb13843d tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dcaf852-ac7e-4168-b9ed-d813a9e13476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:14:30 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-bbefd9a2-6e84-4c67-a222-e75ceb13843d tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Volume volume-54dbc597-2d6a-4494-80b7-2054b0721912 (54dbc597-2d6a-4494-80b7-2054b0721912): created successfully Apr 16 15:14:30 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-bbefd9a2-6e84-4c67-a222-e75ceb13843d tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dcaf852-ac7e-4168-b9ed-d813a9e13476) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:14:30 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-bbefd9a2-6e84-4c67-a222-e75ceb13843d tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Flow 'volume_create_manager' (f983068b-e949-4199-94e3-ef54b82f6b36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:14:30 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-bbefd9a2-6e84-4c67-a222-e75ceb13843d tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Created volume successfully. Apr 16 15:14:31 devstack sudo[90421]: pam_unix(sudo:session): session closed for user root Apr 16 15:14:31 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-fd33a8a0-763d-4e2d-a8c3-b574fe189c8e tempest-CreateVolumesFromSourceVolumeTest-372490148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-ecf8f453-8cc4-42cb-bd2d-e49a458528f5 1073741824" returned: 0 in 0.512s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:14:31 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-fd33a8a0-763d-4e2d-a8c3-b574fe189c8e tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-ecf8f453-8cc4-42cb-bd2d-e49a458528f5 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:14:31 devstack sudo[90426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-ecf8f453-8cc4-42cb-bd2d-e49a458528f5 Apr 16 15:14:31 devstack sudo[90426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:14:31 devstack sudo[90426]: pam_unix(sudo:session): session closed for user root Apr 16 15:14:31 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-fd33a8a0-763d-4e2d-a8c3-b574fe189c8e tempest-CreateVolumesFromSourceVolumeTest-372490148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-ecf8f453-8cc4-42cb-bd2d-e49a458528f5" returned: 0 in 0.392s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:14:31 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-fd33a8a0-763d-4e2d-a8c3-b574fe189c8e tempest-CreateVolumesFromSourceVolumeTest-372490148 None] <== create_volume: return (926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'} {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 15:14:31 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-fd33a8a0-763d-4e2d-a8c3-b574fe189c8e tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.929s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:14:31 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-2f3bdc8f-120a-445e-aa87-429ec35cf55f tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.357s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:14:31 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-2f3bdc8f-120a-445e-aa87-429ec35cf55f tempest-CreateVolumesFromSourceVolumeTest-372490148 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:14:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1112249273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7162565-9537-4678-aed9-022b30aebb15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eac57a26747f4755840bba65171bf337',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:14:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:14:28Z,use_quota=True,user_id='dee0b38d85b04e2dbd3dffe114e7d911',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)}" {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 15:14:31 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-2f3bdc8f-120a-445e-aa87-429ec35cf55f tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Creating volume e7162565-9537-4678-aed9-022b30aebb15 {{(pid=82756) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 15:14:31 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-2f3bdc8f-120a-445e-aa87-429ec35cf55f tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:14:31 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-2f3bdc8f-120a-445e-aa87-429ec35cf55f tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:14:31 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-2f3bdc8f-120a-445e-aa87-429ec35cf55f tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:14:31 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-2f3bdc8f-120a-445e-aa87-429ec35cf55f tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:14:31 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-2f3bdc8f-120a-445e-aa87-429ec35cf55f tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:14:31 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-2f3bdc8f-120a-445e-aa87-429ec35cf55f tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Selected osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 as target Quobyte volume. {{(pid=82756) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 15:14:31 devstack cinder-volume[82756]: INFO cinder.volume.drivers.remotefs [None req-2f3bdc8f-120a-445e-aa87-429ec35cf55f tempest-CreateVolumesFromSourceVolumeTest-372490148 None] casted to osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 Apr 16 15:14:31 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-2f3bdc8f-120a-445e-aa87-429ec35cf55f tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-e7162565-9537-4678-aed9-022b30aebb15 1073741824 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:14:31 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-fd33a8a0-763d-4e2d-a8c3-b574fe189c8e tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56fdaae1-f8fe-4fec-9a77-58ce6d0ad6fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ecf8f453-8cc4-42cb-bd2d-e49a458528f5', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:14:31 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-fd33a8a0-763d-4e2d-a8c3-b574fe189c8e tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b6b35e1-e35c-40a2-acf7-8ca2f9ea7c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:14:31 devstack sudo[90429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-e7162565-9537-4678-aed9-022b30aebb15 1073741824 Apr 16 15:14:31 devstack sudo[90429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:14:31 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-fd33a8a0-763d-4e2d-a8c3-b574fe189c8e tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Volume volume-ecf8f453-8cc4-42cb-bd2d-e49a458528f5 (ecf8f453-8cc4-42cb-bd2d-e49a458528f5): created successfully Apr 16 15:14:31 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-fd33a8a0-763d-4e2d-a8c3-b574fe189c8e tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b6b35e1-e35c-40a2-acf7-8ca2f9ea7c6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:14:31 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-fd33a8a0-763d-4e2d-a8c3-b574fe189c8e tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Flow 'volume_create_manager' (2425d8ac-9bd3-45f0-afb4-2001b79e67b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:14:31 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-fd33a8a0-763d-4e2d-a8c3-b574fe189c8e tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Created volume successfully. Apr 16 15:14:31 devstack sudo[90429]: pam_unix(sudo:session): session closed for user root Apr 16 15:14:31 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-2f3bdc8f-120a-445e-aa87-429ec35cf55f tempest-CreateVolumesFromSourceVolumeTest-372490148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-e7162565-9537-4678-aed9-022b30aebb15 1073741824" returned: 0 in 0.462s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:14:31 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-2f3bdc8f-120a-445e-aa87-429ec35cf55f tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-e7162565-9537-4678-aed9-022b30aebb15 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:14:31 devstack sudo[90434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-e7162565-9537-4678-aed9-022b30aebb15 Apr 16 15:14:31 devstack sudo[90434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:14:32 devstack sudo[90434]: pam_unix(sudo:session): session closed for user root Apr 16 15:14:32 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-2f3bdc8f-120a-445e-aa87-429ec35cf55f tempest-CreateVolumesFromSourceVolumeTest-372490148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-e7162565-9537-4678-aed9-022b30aebb15" returned: 0 in 0.387s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:14:32 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-2f3bdc8f-120a-445e-aa87-429ec35cf55f tempest-CreateVolumesFromSourceVolumeTest-372490148 None] <== create_volume: return (870ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'} {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 15:14:32 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-2f3bdc8f-120a-445e-aa87-429ec35cf55f tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.873s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:14:32 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-2f3bdc8f-120a-445e-aa87-429ec35cf55f tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6eaee479-6c9f-40fe-b022-6e9cf1b5b162) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7162565-9537-4678-aed9-022b30aebb15', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:14:32 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-2f3bdc8f-120a-445e-aa87-429ec35cf55f tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7590ff67-e936-4cc3-aee1-cf7502bedfa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:14:32 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-2f3bdc8f-120a-445e-aa87-429ec35cf55f tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Volume volume-e7162565-9537-4678-aed9-022b30aebb15 (e7162565-9537-4678-aed9-022b30aebb15): created successfully Apr 16 15:14:32 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-2f3bdc8f-120a-445e-aa87-429ec35cf55f tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7590ff67-e936-4cc3-aee1-cf7502bedfa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:14:32 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-2f3bdc8f-120a-445e-aa87-429ec35cf55f tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Flow 'volume_create_manager' (378e1ad4-9792-4000-8b01-c9337cd65a47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:14:32 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-2f3bdc8f-120a-445e-aa87-429ec35cf55f tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Created volume successfully. Apr 16 15:14:32 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-5682d309-f409-40bb-880a-e6b56b41cc04 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Acquiring lock "cinder-e7162565-9537-4678-aed9-022b30aebb15-delete_volume" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:14:32 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-5682d309-f409-40bb-880a-e6b56b41cc04 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Lock "cinder-e7162565-9537-4678-aed9-022b30aebb15-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:14:32 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-5682d309-f409-40bb-880a-e6b56b41cc04 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Acquiring lock "cinder-quobyte-e7162565-9537-4678-aed9-022b30aebb15" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:14:32 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-5682d309-f409-40bb-880a-e6b56b41cc04 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Lock "cinder-quobyte-e7162565-9537-4678-aed9-022b30aebb15" acquired by "delete_volume" :: waited 0.011s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:14:32 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[692137bd-0db2-447e-a48f-6eeb42beeded]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:14:32 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-5682d309-f409-40bb-880a-e6b56b41cc04 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-e7162565-9537-4678-aed9-022b30aebb15 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:14:32 devstack sudo[90437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-e7162565-9537-4678-aed9-022b30aebb15 Apr 16 15:14:32 devstack sudo[90437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:14:33 devstack sudo[90437]: pam_unix(sudo:session): session closed for user root Apr 16 15:14:33 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-5682d309-f409-40bb-880a-e6b56b41cc04 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-e7162565-9537-4678-aed9-022b30aebb15" returned: 0 in 0.499s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:14:33 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-5682d309-f409-40bb-880a-e6b56b41cc04 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-e7162565-9537-4678-aed9-022b30aebb15 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:14:33 devstack sudo[90442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-e7162565-9537-4678-aed9-022b30aebb15 Apr 16 15:14:33 devstack sudo[90442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:14:33 devstack sudo[90442]: pam_unix(sudo:session): session closed for user root Apr 16 15:14:33 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-5682d309-f409-40bb-880a-e6b56b41cc04 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-e7162565-9537-4678-aed9-022b30aebb15" returned: 0 in 0.424s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:14:33 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-5682d309-f409-40bb-880a-e6b56b41cc04 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Lock "cinder-quobyte-e7162565-9537-4678-aed9-022b30aebb15" released by "delete_volume" :: held 0.946s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:14:33 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-5682d309-f409-40bb-880a-e6b56b41cc04 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Created reservations ['9b310cfe-50b1-48b7-8d88-48d2b9f718ad', '0ed607f5-27b8-40d6-9036-0304a7240d7d', '18cb1c1f-a0fa-4f7b-82a6-07adfac1f47b', 'aec134c3-eafd-4e60-a887-93aafd4cf5fb'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:14:33 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-5682d309-f409-40bb-880a-e6b56b41cc04 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:14:33 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-5682d309-f409-40bb-880a-e6b56b41cc04 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:14:33 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-5682d309-f409-40bb-880a-e6b56b41cc04 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:14:33 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-5682d309-f409-40bb-880a-e6b56b41cc04 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:14:33 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-5682d309-f409-40bb-880a-e6b56b41cc04 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:14:33 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-5682d309-f409-40bb-880a-e6b56b41cc04 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:14:33 devstack sudo[90446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:14:33 devstack sudo[90446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:14:33 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-32153788-ee03-4888-ad1f-95d47ce5f9a6 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Acquiring lock "cinder-ecf8f453-8cc4-42cb-bd2d-e49a458528f5-delete_volume" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:14:33 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-32153788-ee03-4888-ad1f-95d47ce5f9a6 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Lock "cinder-ecf8f453-8cc4-42cb-bd2d-e49a458528f5-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:14:33 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-32153788-ee03-4888-ad1f-95d47ce5f9a6 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Acquiring lock "cinder-quobyte-ecf8f453-8cc4-42cb-bd2d-e49a458528f5" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:14:33 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-32153788-ee03-4888-ad1f-95d47ce5f9a6 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Lock "cinder-quobyte-ecf8f453-8cc4-42cb-bd2d-e49a458528f5" acquired by "delete_volume" :: waited 0.009s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:14:33 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[a029ecec-89f8-4c28-9266-9a33880b8e1d]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:14:33 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-32153788-ee03-4888-ad1f-95d47ce5f9a6 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-ecf8f453-8cc4-42cb-bd2d-e49a458528f5 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:14:33 devstack sudo[90448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-ecf8f453-8cc4-42cb-bd2d-e49a458528f5 Apr 16 15:14:33 devstack sudo[90448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:14:33 devstack sudo[90446]: pam_unix(sudo:session): session closed for user root Apr 16 15:14:33 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-5682d309-f409-40bb-880a-e6b56b41cc04 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.444s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:14:33 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-5682d309-f409-40bb-880a-e6b56b41cc04 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:14:33 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-5682d309-f409-40bb-880a-e6b56b41cc04 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Deleted volume successfully. Apr 16 15:14:33 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-5682d309-f409-40bb-880a-e6b56b41cc04 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Lock "cinder-e7162565-9537-4678-aed9-022b30aebb15-delete_volume" released by "delete_volume" :: held 1.509s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:14:34 devstack sudo[90448]: pam_unix(sudo:session): session closed for user root Apr 16 15:14:34 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-32153788-ee03-4888-ad1f-95d47ce5f9a6 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-ecf8f453-8cc4-42cb-bd2d-e49a458528f5" returned: 0 in 0.464s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:14:34 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-32153788-ee03-4888-ad1f-95d47ce5f9a6 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-ecf8f453-8cc4-42cb-bd2d-e49a458528f5 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:14:34 devstack sudo[90454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-ecf8f453-8cc4-42cb-bd2d-e49a458528f5 Apr 16 15:14:34 devstack sudo[90454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:14:34 devstack sudo[90454]: pam_unix(sudo:session): session closed for user root Apr 16 15:14:34 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-32153788-ee03-4888-ad1f-95d47ce5f9a6 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-ecf8f453-8cc4-42cb-bd2d-e49a458528f5" returned: 0 in 0.391s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:14:34 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-32153788-ee03-4888-ad1f-95d47ce5f9a6 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Lock "cinder-quobyte-ecf8f453-8cc4-42cb-bd2d-e49a458528f5" released by "delete_volume" :: held 0.876s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:14:34 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-32153788-ee03-4888-ad1f-95d47ce5f9a6 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Created reservations ['4f9cf72a-0c15-40bb-b1d1-9fc64cb20ba5', '51333929-2c8a-4ff9-a7eb-ee5b9249d9eb', 'f483acbb-7e69-4829-af86-072946972c73', '152af1fb-fa16-4f80-b12e-523ff8c943e0'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:14:34 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-32153788-ee03-4888-ad1f-95d47ce5f9a6 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:14:34 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-32153788-ee03-4888-ad1f-95d47ce5f9a6 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:14:34 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-32153788-ee03-4888-ad1f-95d47ce5f9a6 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:14:34 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-32153788-ee03-4888-ad1f-95d47ce5f9a6 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:14:34 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-32153788-ee03-4888-ad1f-95d47ce5f9a6 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:14:34 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-32153788-ee03-4888-ad1f-95d47ce5f9a6 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:14:34 devstack sudo[90457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:14:34 devstack sudo[90457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:14:34 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-37a9effe-a1c5-4ba4-9b7b-849e239d226a tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Acquiring lock "cinder-54dbc597-2d6a-4494-80b7-2054b0721912-delete_volume" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:14:34 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-37a9effe-a1c5-4ba4-9b7b-849e239d226a tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Lock "cinder-54dbc597-2d6a-4494-80b7-2054b0721912-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:14:34 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-37a9effe-a1c5-4ba4-9b7b-849e239d226a tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Acquiring lock "cinder-quobyte-54dbc597-2d6a-4494-80b7-2054b0721912" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:14:34 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-37a9effe-a1c5-4ba4-9b7b-849e239d226a tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Lock "cinder-quobyte-54dbc597-2d6a-4494-80b7-2054b0721912" acquired by "delete_volume" :: waited 0.007s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:14:34 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[394b4a13-89e3-4ba9-aece-29497178044f]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:14:34 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-37a9effe-a1c5-4ba4-9b7b-849e239d226a tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-54dbc597-2d6a-4494-80b7-2054b0721912 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:14:34 devstack sudo[90459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-54dbc597-2d6a-4494-80b7-2054b0721912 Apr 16 15:14:34 devstack sudo[90459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:14:35 devstack sudo[90457]: pam_unix(sudo:session): session closed for user root Apr 16 15:14:35 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-32153788-ee03-4888-ad1f-95d47ce5f9a6 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.497s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:14:35 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-32153788-ee03-4888-ad1f-95d47ce5f9a6 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:14:35 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-32153788-ee03-4888-ad1f-95d47ce5f9a6 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Deleted volume successfully. Apr 16 15:14:35 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-32153788-ee03-4888-ad1f-95d47ce5f9a6 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Lock "cinder-ecf8f453-8cc4-42cb-bd2d-e49a458528f5-delete_volume" released by "delete_volume" :: held 1.502s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:14:35 devstack sudo[90459]: pam_unix(sudo:session): session closed for user root Apr 16 15:14:35 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-37a9effe-a1c5-4ba4-9b7b-849e239d226a tempest-CreateVolumesFromSourceVolumeTest-372490148 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-54dbc597-2d6a-4494-80b7-2054b0721912" returned: 0 in 0.468s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:14:35 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-37a9effe-a1c5-4ba4-9b7b-849e239d226a tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-54dbc597-2d6a-4494-80b7-2054b0721912 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:14:35 devstack sudo[90465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-54dbc597-2d6a-4494-80b7-2054b0721912 Apr 16 15:14:35 devstack sudo[90465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:14:35 devstack sudo[90465]: pam_unix(sudo:session): session closed for user root Apr 16 15:14:35 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-37a9effe-a1c5-4ba4-9b7b-849e239d226a tempest-CreateVolumesFromSourceVolumeTest-372490148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-54dbc597-2d6a-4494-80b7-2054b0721912" returned: 0 in 0.459s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:14:35 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-37a9effe-a1c5-4ba4-9b7b-849e239d226a tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Lock "cinder-quobyte-54dbc597-2d6a-4494-80b7-2054b0721912" released by "delete_volume" :: held 0.948s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:14:35 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-37a9effe-a1c5-4ba4-9b7b-849e239d226a tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Created reservations ['9df07067-5ca8-4d4d-91ba-42691f24ca96', 'fce1aedb-4b54-40ea-9510-f0712158c65e', '64860562-f514-4de5-b8cc-1105b556c8f5', 'a3ef97ec-4d46-47f9-94c6-c3b72b3fcd94'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:14:35 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-37a9effe-a1c5-4ba4-9b7b-849e239d226a tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:14:35 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-37a9effe-a1c5-4ba4-9b7b-849e239d226a tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:14:35 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-37a9effe-a1c5-4ba4-9b7b-849e239d226a tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:14:35 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-37a9effe-a1c5-4ba4-9b7b-849e239d226a tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:14:35 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-37a9effe-a1c5-4ba4-9b7b-849e239d226a tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:14:35 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-37a9effe-a1c5-4ba4-9b7b-849e239d226a tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:14:35 devstack sudo[90468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:14:35 devstack sudo[90468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:14:35 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-5d8f21b3-183e-426c-9d9f-b295e9053a30 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Acquiring lock "cinder-a62fae48-7fc9-40d9-ae94-6f0b99e98440-delete_volume" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:14:35 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-5d8f21b3-183e-426c-9d9f-b295e9053a30 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Lock "cinder-a62fae48-7fc9-40d9-ae94-6f0b99e98440-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:14:35 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-5d8f21b3-183e-426c-9d9f-b295e9053a30 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Acquiring lock "cinder-quobyte-a62fae48-7fc9-40d9-ae94-6f0b99e98440" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:14:35 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-5d8f21b3-183e-426c-9d9f-b295e9053a30 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Lock "cinder-quobyte-a62fae48-7fc9-40d9-ae94-6f0b99e98440" acquired by "delete_volume" :: waited 0.009s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:14:35 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[216ca9e3-b9bc-49de-aa10-38c822994af0]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:14:35 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-5d8f21b3-183e-426c-9d9f-b295e9053a30 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-a62fae48-7fc9-40d9-ae94-6f0b99e98440 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:14:35 devstack sudo[90470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-a62fae48-7fc9-40d9-ae94-6f0b99e98440 Apr 16 15:14:35 devstack sudo[90470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:14:36 devstack sudo[90468]: pam_unix(sudo:session): session closed for user root Apr 16 15:14:36 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-37a9effe-a1c5-4ba4-9b7b-849e239d226a tempest-CreateVolumesFromSourceVolumeTest-372490148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.415s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:14:36 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-37a9effe-a1c5-4ba4-9b7b-849e239d226a tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:14:36 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-37a9effe-a1c5-4ba4-9b7b-849e239d226a tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Deleted volume successfully. Apr 16 15:14:36 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-37a9effe-a1c5-4ba4-9b7b-849e239d226a tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Lock "cinder-54dbc597-2d6a-4494-80b7-2054b0721912-delete_volume" released by "delete_volume" :: held 1.537s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:14:36 devstack sudo[90470]: pam_unix(sudo:session): session closed for user root Apr 16 15:14:36 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-5d8f21b3-183e-426c-9d9f-b295e9053a30 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-a62fae48-7fc9-40d9-ae94-6f0b99e98440" returned: 0 in 0.491s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:14:36 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-5d8f21b3-183e-426c-9d9f-b295e9053a30 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-a62fae48-7fc9-40d9-ae94-6f0b99e98440 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:14:36 devstack sudo[90476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-a62fae48-7fc9-40d9-ae94-6f0b99e98440 Apr 16 15:14:36 devstack sudo[90476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:14:36 devstack sudo[90476]: pam_unix(sudo:session): session closed for user root Apr 16 15:14:36 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-5d8f21b3-183e-426c-9d9f-b295e9053a30 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-a62fae48-7fc9-40d9-ae94-6f0b99e98440" returned: 0 in 0.394s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:14:36 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-5d8f21b3-183e-426c-9d9f-b295e9053a30 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Lock "cinder-quobyte-a62fae48-7fc9-40d9-ae94-6f0b99e98440" released by "delete_volume" :: held 0.911s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:14:36 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-5d8f21b3-183e-426c-9d9f-b295e9053a30 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Created reservations ['6f2d20ee-91d8-4f93-96ec-7a8c1220a894', '57198622-a732-4033-8284-16e2f2f33a5d', '827590c4-e1cc-418b-8a86-9d1e036dc6bb', '0bfa045f-8ec1-4852-88c5-d4f7e9d5c0a8'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:14:36 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-5d8f21b3-183e-426c-9d9f-b295e9053a30 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:14:36 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-5d8f21b3-183e-426c-9d9f-b295e9053a30 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:14:36 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-5d8f21b3-183e-426c-9d9f-b295e9053a30 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:14:36 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-5d8f21b3-183e-426c-9d9f-b295e9053a30 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:14:36 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-5d8f21b3-183e-426c-9d9f-b295e9053a30 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:14:36 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-5d8f21b3-183e-426c-9d9f-b295e9053a30 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:14:36 devstack sudo[90479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:14:36 devstack sudo[90479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:14:36 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-88eb18b9-0806-4a40-8b51-b5582745ac01 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Acquiring lock "cinder-464fcb61-6c83-47a0-83a1-811c957b55c2-delete_volume" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:14:36 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-88eb18b9-0806-4a40-8b51-b5582745ac01 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Lock "cinder-464fcb61-6c83-47a0-83a1-811c957b55c2-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:14:36 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-88eb18b9-0806-4a40-8b51-b5582745ac01 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Acquiring lock "cinder-quobyte-464fcb61-6c83-47a0-83a1-811c957b55c2" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:14:36 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-88eb18b9-0806-4a40-8b51-b5582745ac01 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Lock "cinder-quobyte-464fcb61-6c83-47a0-83a1-811c957b55c2" acquired by "delete_volume" :: waited 0.017s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:14:37 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[b908184e-308c-4ce0-84bc-f54b5c4a06e2]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:14:37 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-88eb18b9-0806-4a40-8b51-b5582745ac01 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-464fcb61-6c83-47a0-83a1-811c957b55c2 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:14:37 devstack sudo[90481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-464fcb61-6c83-47a0-83a1-811c957b55c2 Apr 16 15:14:37 devstack sudo[90481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:14:37 devstack sudo[90479]: pam_unix(sudo:session): session closed for user root Apr 16 15:14:37 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-5d8f21b3-183e-426c-9d9f-b295e9053a30 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.439s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:14:37 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-5d8f21b3-183e-426c-9d9f-b295e9053a30 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:14:37 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-5d8f21b3-183e-426c-9d9f-b295e9053a30 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Deleted volume successfully. Apr 16 15:14:37 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-5d8f21b3-183e-426c-9d9f-b295e9053a30 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Lock "cinder-a62fae48-7fc9-40d9-ae94-6f0b99e98440-delete_volume" released by "delete_volume" :: held 1.495s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:14:37 devstack sudo[90481]: pam_unix(sudo:session): session closed for user root Apr 16 15:14:37 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-88eb18b9-0806-4a40-8b51-b5582745ac01 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-464fcb61-6c83-47a0-83a1-811c957b55c2" returned: 0 in 0.451s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:14:37 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-88eb18b9-0806-4a40-8b51-b5582745ac01 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-464fcb61-6c83-47a0-83a1-811c957b55c2 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:14:37 devstack sudo[90487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-464fcb61-6c83-47a0-83a1-811c957b55c2 Apr 16 15:14:37 devstack sudo[90487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:14:37 devstack sudo[90487]: pam_unix(sudo:session): session closed for user root Apr 16 15:14:37 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-88eb18b9-0806-4a40-8b51-b5582745ac01 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-464fcb61-6c83-47a0-83a1-811c957b55c2" returned: 0 in 0.448s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:14:37 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-88eb18b9-0806-4a40-8b51-b5582745ac01 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Lock "cinder-quobyte-464fcb61-6c83-47a0-83a1-811c957b55c2" released by "delete_volume" :: held 0.920s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:14:37 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-88eb18b9-0806-4a40-8b51-b5582745ac01 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Created reservations ['33045852-1064-4285-a6c3-29225c58eb84', '0f5e2c40-ebc7-4ca4-9ee0-f25d58b2b26a', '14ac6ce0-3fe0-430d-9fc6-3ebbfc388792', 'ef3dc64b-0a01-40d2-92b0-88a9c0a09fc6'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:14:37 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-88eb18b9-0806-4a40-8b51-b5582745ac01 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:14:37 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-88eb18b9-0806-4a40-8b51-b5582745ac01 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:14:37 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-88eb18b9-0806-4a40-8b51-b5582745ac01 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:14:37 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-88eb18b9-0806-4a40-8b51-b5582745ac01 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:14:37 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-88eb18b9-0806-4a40-8b51-b5582745ac01 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:14:37 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-88eb18b9-0806-4a40-8b51-b5582745ac01 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:14:37 devstack sudo[90490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:14:37 devstack sudo[90490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:14:38 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-77aff2d0-b9dc-4bc6-b585-aba9e8a69074 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Acquiring lock "cinder-4248fce0-5f2b-4a7c-8aa2-7354a1289b84-delete_volume" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:14:38 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-77aff2d0-b9dc-4bc6-b585-aba9e8a69074 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Lock "cinder-4248fce0-5f2b-4a7c-8aa2-7354a1289b84-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:14:38 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-77aff2d0-b9dc-4bc6-b585-aba9e8a69074 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Acquiring lock "cinder-quobyte-4248fce0-5f2b-4a7c-8aa2-7354a1289b84" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:14:38 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-77aff2d0-b9dc-4bc6-b585-aba9e8a69074 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Lock "cinder-quobyte-4248fce0-5f2b-4a7c-8aa2-7354a1289b84" acquired by "delete_volume" :: waited 0.009s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:14:38 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dfedf29-e397-480b-826e-5a1e635c80c5]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:14:38 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-77aff2d0-b9dc-4bc6-b585-aba9e8a69074 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-4248fce0-5f2b-4a7c-8aa2-7354a1289b84 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:14:38 devstack sudo[90492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-4248fce0-5f2b-4a7c-8aa2-7354a1289b84 Apr 16 15:14:38 devstack sudo[90492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:14:38 devstack sudo[90490]: pam_unix(sudo:session): session closed for user root Apr 16 15:14:38 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-88eb18b9-0806-4a40-8b51-b5582745ac01 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.407s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:14:38 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-88eb18b9-0806-4a40-8b51-b5582745ac01 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:14:38 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-88eb18b9-0806-4a40-8b51-b5582745ac01 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Deleted volume successfully. Apr 16 15:14:38 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-88eb18b9-0806-4a40-8b51-b5582745ac01 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Lock "cinder-464fcb61-6c83-47a0-83a1-811c957b55c2-delete_volume" released by "delete_volume" :: held 1.450s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:14:38 devstack sudo[90492]: pam_unix(sudo:session): session closed for user root Apr 16 15:14:38 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-77aff2d0-b9dc-4bc6-b585-aba9e8a69074 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-4248fce0-5f2b-4a7c-8aa2-7354a1289b84" returned: 0 in 0.489s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:14:38 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-77aff2d0-b9dc-4bc6-b585-aba9e8a69074 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-4248fce0-5f2b-4a7c-8aa2-7354a1289b84 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:14:38 devstack sudo[90498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-4248fce0-5f2b-4a7c-8aa2-7354a1289b84 Apr 16 15:14:38 devstack sudo[90498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:14:39 devstack sudo[90498]: pam_unix(sudo:session): session closed for user root Apr 16 15:14:39 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-77aff2d0-b9dc-4bc6-b585-aba9e8a69074 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-4248fce0-5f2b-4a7c-8aa2-7354a1289b84" returned: 0 in 0.510s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:14:39 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-77aff2d0-b9dc-4bc6-b585-aba9e8a69074 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Lock "cinder-quobyte-4248fce0-5f2b-4a7c-8aa2-7354a1289b84" released by "delete_volume" :: held 1.023s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:14:39 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-77aff2d0-b9dc-4bc6-b585-aba9e8a69074 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Created reservations ['af9e133d-d02b-419b-a280-b9d29c5c3e39', '7fb0a3fe-f481-4746-a1cb-6273d3464761', 'd70f8235-8752-44ac-aab3-3d2bf9bc502e', 'dcbbf1f6-0f48-4387-9d14-bb618131591e'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:14:39 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-77aff2d0-b9dc-4bc6-b585-aba9e8a69074 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:14:39 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-77aff2d0-b9dc-4bc6-b585-aba9e8a69074 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:14:39 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-77aff2d0-b9dc-4bc6-b585-aba9e8a69074 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:14:39 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-77aff2d0-b9dc-4bc6-b585-aba9e8a69074 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:14:39 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-77aff2d0-b9dc-4bc6-b585-aba9e8a69074 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:14:39 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-77aff2d0-b9dc-4bc6-b585-aba9e8a69074 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:14:39 devstack sudo[90501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:14:39 devstack sudo[90501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:14:39 devstack sudo[90501]: pam_unix(sudo:session): session closed for user root Apr 16 15:14:39 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-77aff2d0-b9dc-4bc6-b585-aba9e8a69074 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.401s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:14:39 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-77aff2d0-b9dc-4bc6-b585-aba9e8a69074 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:14:39 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-77aff2d0-b9dc-4bc6-b585-aba9e8a69074 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Deleted volume successfully. Apr 16 15:14:39 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-77aff2d0-b9dc-4bc6-b585-aba9e8a69074 tempest-CreateVolumesFromSourceVolumeTest-372490148 None] Lock "cinder-4248fce0-5f2b-4a7c-8aa2-7354a1289b84-delete_volume" released by "delete_volume" :: held 1.575s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:14:47 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2cf7943-a659-4471-9f29-445120197773 tempest-VolumeDependencyTests-1769369869 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82756) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 15:14:47 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-f2cf7943-a659-4471-9f29-445120197773 tempest-VolumeDependencyTests-1769369869 None] Flow 'volume_create_manager' (107361c9-3793-4e7a-91de-5a6f62662570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:14:47 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-f2cf7943-a659-4471-9f29-445120197773 tempest-VolumeDependencyTests-1769369869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9c4a3de-dc06-4187-9c9e-9c27d27c1bbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:14:47 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-f2cf7943-a659-4471-9f29-445120197773 tempest-VolumeDependencyTests-1769369869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9c4a3de-dc06-4187-9c9e-9c27d27c1bbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:14:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1652548768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35d57e9c-82cf-4ca4-a6c7-4a0773ac88e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2465b74888c74c608190b15eb478a3e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:14:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:14:47Z,use_quota=True,user_id='bbe844468df24b8bb78f9c30c795001c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:14:47 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-f2cf7943-a659-4471-9f29-445120197773 tempest-VolumeDependencyTests-1769369869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52298434-d527-4699-9743-e34a92e83c75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:14:47 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-f2cf7943-a659-4471-9f29-445120197773 tempest-VolumeDependencyTests-1769369869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52298434-d527-4699-9743-e34a92e83c75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:14:47 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-f2cf7943-a659-4471-9f29-445120197773 tempest-VolumeDependencyTests-1769369869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dd2fb1b-660e-4f00-a7ec-abf1745fcdc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:14:47 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-f2cf7943-a659-4471-9f29-445120197773 tempest-VolumeDependencyTests-1769369869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dd2fb1b-660e-4f00-a7ec-abf1745fcdc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35d57e9c-82cf-4ca4-a6c7-4a0773ac88e4', 'volume_name': 'volume-35d57e9c-82cf-4ca4-a6c7-4a0773ac88e4', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:14:47 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-f2cf7943-a659-4471-9f29-445120197773 tempest-VolumeDependencyTests-1769369869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (781a0fa9-23e4-4361-92f2-9e31e4659cb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:14:47 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-f2cf7943-a659-4471-9f29-445120197773 tempest-VolumeDependencyTests-1769369869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (781a0fa9-23e4-4361-92f2-9e31e4659cb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:14:47 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-f2cf7943-a659-4471-9f29-445120197773 tempest-VolumeDependencyTests-1769369869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55667957-d4f6-408d-8196-767b993a7eb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:14:47 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-f2cf7943-a659-4471-9f29-445120197773 tempest-VolumeDependencyTests-1769369869 None] Volume 35d57e9c-82cf-4ca4-a6c7-4a0773ac88e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35d57e9c-82cf-4ca4-a6c7-4a0773ac88e4', 'volume_size': 1} Apr 16 15:14:47 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-f2cf7943-a659-4471-9f29-445120197773 tempest-VolumeDependencyTests-1769369869 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:14:47 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-f2cf7943-a659-4471-9f29-445120197773 tempest-VolumeDependencyTests-1769369869 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:14:47 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-f2cf7943-a659-4471-9f29-445120197773 tempest-VolumeDependencyTests-1769369869 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:14:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1652548768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35d57e9c-82cf-4ca4-a6c7-4a0773ac88e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2465b74888c74c608190b15eb478a3e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:14:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:14:47Z,use_quota=True,user_id='bbe844468df24b8bb78f9c30c795001c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)}" {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 15:14:47 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-f2cf7943-a659-4471-9f29-445120197773 tempest-VolumeDependencyTests-1769369869 None] Creating volume 35d57e9c-82cf-4ca4-a6c7-4a0773ac88e4 {{(pid=82756) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 15:14:47 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-f2cf7943-a659-4471-9f29-445120197773 tempest-VolumeDependencyTests-1769369869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:14:47 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-f2cf7943-a659-4471-9f29-445120197773 tempest-VolumeDependencyTests-1769369869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:14:47 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-f2cf7943-a659-4471-9f29-445120197773 tempest-VolumeDependencyTests-1769369869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:14:47 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-f2cf7943-a659-4471-9f29-445120197773 tempest-VolumeDependencyTests-1769369869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:14:47 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-f2cf7943-a659-4471-9f29-445120197773 tempest-VolumeDependencyTests-1769369869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:14:47 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-f2cf7943-a659-4471-9f29-445120197773 tempest-VolumeDependencyTests-1769369869 None] Selected osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 as target Quobyte volume. {{(pid=82756) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 15:14:47 devstack cinder-volume[82756]: INFO cinder.volume.drivers.remotefs [None req-f2cf7943-a659-4471-9f29-445120197773 tempest-VolumeDependencyTests-1769369869 None] casted to osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 Apr 16 15:14:47 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-f2cf7943-a659-4471-9f29-445120197773 tempest-VolumeDependencyTests-1769369869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-35d57e9c-82cf-4ca4-a6c7-4a0773ac88e4 1073741824 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:14:47 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c74ffba-74be-4cb0-a2ac-fcc498764fb7 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82756) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 15:14:47 devstack sudo[90545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-35d57e9c-82cf-4ca4-a6c7-4a0773ac88e4 1073741824 Apr 16 15:14:47 devstack sudo[90545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:14:47 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-0c74ffba-74be-4cb0-a2ac-fcc498764fb7 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Flow 'volume_create_manager' (37a99c8e-9b6f-4cdd-a05b-e268196d5318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:14:47 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-0c74ffba-74be-4cb0-a2ac-fcc498764fb7 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44cff85e-a899-489a-8881-9d3071163872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:14:47 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-0c74ffba-74be-4cb0-a2ac-fcc498764fb7 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44cff85e-a899-489a-8881-9d3071163872) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:14:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-582886727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b18bcbf-e358-4b27-b079-bff25ab2ec17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67db5101aca74e2493d47e4bf32c1892',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:14:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:14:47Z,use_quota=True,user_id='461fefe546444a57bda769f210b6858e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:14:47 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-0c74ffba-74be-4cb0-a2ac-fcc498764fb7 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9ab9c97-9efb-4086-a043-86894034cc5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:14:47 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-0c74ffba-74be-4cb0-a2ac-fcc498764fb7 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9ab9c97-9efb-4086-a043-86894034cc5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:14:47 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-0c74ffba-74be-4cb0-a2ac-fcc498764fb7 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc834c5e-df88-438a-895e-27eea84f7c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:14:47 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-0c74ffba-74be-4cb0-a2ac-fcc498764fb7 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc834c5e-df88-438a-895e-27eea84f7c3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b18bcbf-e358-4b27-b079-bff25ab2ec17', 'volume_name': 'volume-5b18bcbf-e358-4b27-b079-bff25ab2ec17', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:14:47 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-0c74ffba-74be-4cb0-a2ac-fcc498764fb7 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18df4eea-f868-46c9-a172-77366d6a40f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:14:47 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-0c74ffba-74be-4cb0-a2ac-fcc498764fb7 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18df4eea-f868-46c9-a172-77366d6a40f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:14:47 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-0c74ffba-74be-4cb0-a2ac-fcc498764fb7 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29c24195-8705-498b-b2e2-2314cf28c527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:14:47 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-0c74ffba-74be-4cb0-a2ac-fcc498764fb7 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Volume 5b18bcbf-e358-4b27-b079-bff25ab2ec17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b18bcbf-e358-4b27-b079-bff25ab2ec17', 'volume_size': 1} Apr 16 15:14:47 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-0c74ffba-74be-4cb0-a2ac-fcc498764fb7 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:14:47 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [None req-efbcfbf0-9021-4fe7-8c1c-f55a5337ecb0 tempest-CreateVolumesFromImageTest-605891512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82756) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 15:14:47 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-efbcfbf0-9021-4fe7-8c1c-f55a5337ecb0 tempest-CreateVolumesFromImageTest-605891512 None] Flow 'volume_create_manager' (07d9c019-d73b-43bd-8e47-3e7bf375bf8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:14:47 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-efbcfbf0-9021-4fe7-8c1c-f55a5337ecb0 tempest-CreateVolumesFromImageTest-605891512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ab70aba-b789-4000-beb9-b9f112a5b530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:14:47 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-efbcfbf0-9021-4fe7-8c1c-f55a5337ecb0 tempest-CreateVolumesFromImageTest-605891512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ab70aba-b789-4000-beb9-b9f112a5b530) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:14:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2123904005',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93065a0d-4557-47d0-b061-53fc09cbe63f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7c4e5e569e740e088e3c3c50291c76b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:14:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:14:48Z,use_quota=True,user_id='042629e9ed074407b2806fe3ad61e130',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:14:47 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-efbcfbf0-9021-4fe7-8c1c-f55a5337ecb0 tempest-CreateVolumesFromImageTest-605891512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (283e8556-1e63-4056-b094-50e8fb648624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:14:47 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-efbcfbf0-9021-4fe7-8c1c-f55a5337ecb0 tempest-CreateVolumesFromImageTest-605891512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (283e8556-1e63-4056-b094-50e8fb648624) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:14:47 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-efbcfbf0-9021-4fe7-8c1c-f55a5337ecb0 tempest-CreateVolumesFromImageTest-605891512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf82fe0a-028e-4478-a479-3ca00460d83a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:14:47 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-efbcfbf0-9021-4fe7-8c1c-f55a5337ecb0 tempest-CreateVolumesFromImageTest-605891512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf82fe0a-028e-4478-a479-3ca00460d83a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93065a0d-4557-47d0-b061-53fc09cbe63f', 'volume_name': 'volume-93065a0d-4557-47d0-b061-53fc09cbe63f', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:14:47 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-efbcfbf0-9021-4fe7-8c1c-f55a5337ecb0 tempest-CreateVolumesFromImageTest-605891512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9753e2df-29c2-496c-b61a-4402bc502004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:14:47 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-efbcfbf0-9021-4fe7-8c1c-f55a5337ecb0 tempest-CreateVolumesFromImageTest-605891512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9753e2df-29c2-496c-b61a-4402bc502004) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:14:47 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-efbcfbf0-9021-4fe7-8c1c-f55a5337ecb0 tempest-CreateVolumesFromImageTest-605891512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a1e2fcb-f3ec-44a9-b87b-8e7b09821b30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:14:47 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-efbcfbf0-9021-4fe7-8c1c-f55a5337ecb0 tempest-CreateVolumesFromImageTest-605891512 None] Volume 93065a0d-4557-47d0-b061-53fc09cbe63f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93065a0d-4557-47d0-b061-53fc09cbe63f', 'volume_size': 1} Apr 16 15:14:47 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-efbcfbf0-9021-4fe7-8c1c-f55a5337ecb0 tempest-CreateVolumesFromImageTest-605891512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:14:47 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [None req-355ee358-b7a8-4666-8ea6-4ca0d400f050 tempest-CreateVolumesFromImageTest-605891512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82756) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 15:14:47 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-355ee358-b7a8-4666-8ea6-4ca0d400f050 tempest-CreateVolumesFromImageTest-605891512 None] Flow 'volume_create_manager' (b470e104-3d66-4f94-80f4-3409cb41bcd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:14:47 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-355ee358-b7a8-4666-8ea6-4ca0d400f050 tempest-CreateVolumesFromImageTest-605891512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9832aff-bca3-4eb5-bd15-fb59a25a29e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:14:47 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-355ee358-b7a8-4666-8ea6-4ca0d400f050 tempest-CreateVolumesFromImageTest-605891512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9832aff-bca3-4eb5-bd15-fb59a25a29e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:14:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2066859054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ac4e079-556f-4842-9bd0-a9e34bad6d7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7c4e5e569e740e088e3c3c50291c76b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:14:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:14:48Z,use_quota=True,user_id='042629e9ed074407b2806fe3ad61e130',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:14:47 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-355ee358-b7a8-4666-8ea6-4ca0d400f050 tempest-CreateVolumesFromImageTest-605891512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7a2f1b2-d34e-4d0c-b439-654689e1e5e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:14:47 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-355ee358-b7a8-4666-8ea6-4ca0d400f050 tempest-CreateVolumesFromImageTest-605891512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7a2f1b2-d34e-4d0c-b439-654689e1e5e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:14:47 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-355ee358-b7a8-4666-8ea6-4ca0d400f050 tempest-CreateVolumesFromImageTest-605891512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0d93581-4e86-499e-82c8-f294b1fc13f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:14:47 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-355ee358-b7a8-4666-8ea6-4ca0d400f050 tempest-CreateVolumesFromImageTest-605891512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0d93581-4e86-499e-82c8-f294b1fc13f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ac4e079-556f-4842-9bd0-a9e34bad6d7a', 'volume_name': 'volume-5ac4e079-556f-4842-9bd0-a9e34bad6d7a', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:14:47 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-355ee358-b7a8-4666-8ea6-4ca0d400f050 tempest-CreateVolumesFromImageTest-605891512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (440518cf-e47e-4a00-8bec-6de6592c860a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:14:47 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-355ee358-b7a8-4666-8ea6-4ca0d400f050 tempest-CreateVolumesFromImageTest-605891512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (440518cf-e47e-4a00-8bec-6de6592c860a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:14:47 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-355ee358-b7a8-4666-8ea6-4ca0d400f050 tempest-CreateVolumesFromImageTest-605891512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a80bb80-7d78-4bc4-ab2a-4f9f95058657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:14:47 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-355ee358-b7a8-4666-8ea6-4ca0d400f050 tempest-CreateVolumesFromImageTest-605891512 None] Volume 5ac4e079-556f-4842-9bd0-a9e34bad6d7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ac4e079-556f-4842-9bd0-a9e34bad6d7a', 'volume_size': 1} Apr 16 15:14:47 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-355ee358-b7a8-4666-8ea6-4ca0d400f050 tempest-CreateVolumesFromImageTest-605891512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:14:48 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [None req-24056748-cf61-4c83-9d58-7c3b771797af tempest-CreateVolumesFromImageTest-605891512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82756) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 15:14:48 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-24056748-cf61-4c83-9d58-7c3b771797af tempest-CreateVolumesFromImageTest-605891512 None] Flow 'volume_create_manager' (086f88c7-d873-4609-a967-5cd2cd26d858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:14:48 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-24056748-cf61-4c83-9d58-7c3b771797af tempest-CreateVolumesFromImageTest-605891512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee825ecf-9359-40f0-882d-df21de2358e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:14:48 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-24056748-cf61-4c83-9d58-7c3b771797af tempest-CreateVolumesFromImageTest-605891512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee825ecf-9359-40f0-882d-df21de2358e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:14:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-216883958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6038cd6f-d6c3-4b44-8ae8-356cb60be78f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7c4e5e569e740e088e3c3c50291c76b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:14:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:14:48Z,use_quota=True,user_id='042629e9ed074407b2806fe3ad61e130',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:14:48 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-24056748-cf61-4c83-9d58-7c3b771797af tempest-CreateVolumesFromImageTest-605891512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03c245a8-734f-49fe-8502-6e405894658e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:14:48 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-24056748-cf61-4c83-9d58-7c3b771797af tempest-CreateVolumesFromImageTest-605891512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03c245a8-734f-49fe-8502-6e405894658e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:14:48 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-24056748-cf61-4c83-9d58-7c3b771797af tempest-CreateVolumesFromImageTest-605891512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f79b755f-72d6-40ed-b77f-1539e2e80596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:14:48 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-24056748-cf61-4c83-9d58-7c3b771797af tempest-CreateVolumesFromImageTest-605891512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f79b755f-72d6-40ed-b77f-1539e2e80596) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6038cd6f-d6c3-4b44-8ae8-356cb60be78f', 'volume_name': 'volume-6038cd6f-d6c3-4b44-8ae8-356cb60be78f', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:14:48 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-24056748-cf61-4c83-9d58-7c3b771797af tempest-CreateVolumesFromImageTest-605891512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72dae271-a133-4c0d-b571-220f3630ad21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:14:48 devstack sudo[90545]: pam_unix(sudo:session): session closed for user root Apr 16 15:14:48 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-24056748-cf61-4c83-9d58-7c3b771797af tempest-CreateVolumesFromImageTest-605891512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72dae271-a133-4c0d-b571-220f3630ad21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:14:48 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-24056748-cf61-4c83-9d58-7c3b771797af tempest-CreateVolumesFromImageTest-605891512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fea9a358-c84f-4153-9586-025bf7295a56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:14:48 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-24056748-cf61-4c83-9d58-7c3b771797af tempest-CreateVolumesFromImageTest-605891512 None] Volume 6038cd6f-d6c3-4b44-8ae8-356cb60be78f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6038cd6f-d6c3-4b44-8ae8-356cb60be78f', 'volume_size': 1} Apr 16 15:14:48 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-24056748-cf61-4c83-9d58-7c3b771797af tempest-CreateVolumesFromImageTest-605891512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:14:48 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-f2cf7943-a659-4471-9f29-445120197773 tempest-VolumeDependencyTests-1769369869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-35d57e9c-82cf-4ca4-a6c7-4a0773ac88e4 1073741824" returned: 0 in 0.781s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:14:48 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-f2cf7943-a659-4471-9f29-445120197773 tempest-VolumeDependencyTests-1769369869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-35d57e9c-82cf-4ca4-a6c7-4a0773ac88e4 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:14:48 devstack sudo[90550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-35d57e9c-82cf-4ca4-a6c7-4a0773ac88e4 Apr 16 15:14:48 devstack sudo[90550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:14:48 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [None req-99924502-a079-4221-96c6-4d8ebc8fa530 tempest-CreateVolumesFromImageTest-605891512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82756) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 15:14:48 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-99924502-a079-4221-96c6-4d8ebc8fa530 tempest-CreateVolumesFromImageTest-605891512 None] Flow 'volume_create_manager' (6f4f8a5d-b751-4643-9373-341c0048a96d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:14:48 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-99924502-a079-4221-96c6-4d8ebc8fa530 tempest-CreateVolumesFromImageTest-605891512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a32a6810-a6f7-4eb2-80f8-8bcc7f18d81c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:14:48 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-99924502-a079-4221-96c6-4d8ebc8fa530 tempest-CreateVolumesFromImageTest-605891512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a32a6810-a6f7-4eb2-80f8-8bcc7f18d81c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:14:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1337390840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=207759b5-72ae-4e76-9179-defd74dd1058,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7c4e5e569e740e088e3c3c50291c76b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:14:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:14:48Z,use_quota=True,user_id='042629e9ed074407b2806fe3ad61e130',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:14:48 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-99924502-a079-4221-96c6-4d8ebc8fa530 tempest-CreateVolumesFromImageTest-605891512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (183ebc71-c862-4e0d-89d3-fa5fc73c6cc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:14:48 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-99924502-a079-4221-96c6-4d8ebc8fa530 tempest-CreateVolumesFromImageTest-605891512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (183ebc71-c862-4e0d-89d3-fa5fc73c6cc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:14:48 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-99924502-a079-4221-96c6-4d8ebc8fa530 tempest-CreateVolumesFromImageTest-605891512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a1cb423-61c0-4af3-9b51-84189359f546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:14:48 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-99924502-a079-4221-96c6-4d8ebc8fa530 tempest-CreateVolumesFromImageTest-605891512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a1cb423-61c0-4af3-9b51-84189359f546) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '207759b5-72ae-4e76-9179-defd74dd1058', 'volume_name': 'volume-207759b5-72ae-4e76-9179-defd74dd1058', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:14:48 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-99924502-a079-4221-96c6-4d8ebc8fa530 tempest-CreateVolumesFromImageTest-605891512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a39ae21-2426-4e3f-b891-bcc636b23f87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:14:48 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-99924502-a079-4221-96c6-4d8ebc8fa530 tempest-CreateVolumesFromImageTest-605891512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a39ae21-2426-4e3f-b891-bcc636b23f87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:14:48 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-99924502-a079-4221-96c6-4d8ebc8fa530 tempest-CreateVolumesFromImageTest-605891512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2eeda06-7bec-4b5d-8165-992439bff66d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:14:48 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-99924502-a079-4221-96c6-4d8ebc8fa530 tempest-CreateVolumesFromImageTest-605891512 None] Volume 207759b5-72ae-4e76-9179-defd74dd1058: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-207759b5-72ae-4e76-9179-defd74dd1058', 'volume_size': 1} Apr 16 15:14:48 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-99924502-a079-4221-96c6-4d8ebc8fa530 tempest-CreateVolumesFromImageTest-605891512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:14:48 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8f3d529-51b1-47e4-b6a3-528580a81451 tempest-CreateVolumesFromImageTest-605891512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82756) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 15:14:48 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-e8f3d529-51b1-47e4-b6a3-528580a81451 tempest-CreateVolumesFromImageTest-605891512 None] Flow 'volume_create_manager' (db805720-0399-4a4b-a400-7e7c5a49e398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:14:48 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-e8f3d529-51b1-47e4-b6a3-528580a81451 tempest-CreateVolumesFromImageTest-605891512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2af6df4b-f12c-49a1-88f3-d08cc5fb22fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:14:48 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-e8f3d529-51b1-47e4-b6a3-528580a81451 tempest-CreateVolumesFromImageTest-605891512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2af6df4b-f12c-49a1-88f3-d08cc5fb22fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:14:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1417154097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4ec7618-8b6f-4518-910d-492201a8efcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7c4e5e569e740e088e3c3c50291c76b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:14:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:14:48Z,use_quota=True,user_id='042629e9ed074407b2806fe3ad61e130',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:14:48 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-e8f3d529-51b1-47e4-b6a3-528580a81451 tempest-CreateVolumesFromImageTest-605891512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41c8e2d7-16fe-40bc-a3f5-ad306d92bd01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:14:48 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-e8f3d529-51b1-47e4-b6a3-528580a81451 tempest-CreateVolumesFromImageTest-605891512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41c8e2d7-16fe-40bc-a3f5-ad306d92bd01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:14:48 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-e8f3d529-51b1-47e4-b6a3-528580a81451 tempest-CreateVolumesFromImageTest-605891512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eec94764-d5ed-43c1-b868-c00eb47bb982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:14:48 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-e8f3d529-51b1-47e4-b6a3-528580a81451 tempest-CreateVolumesFromImageTest-605891512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eec94764-d5ed-43c1-b868-c00eb47bb982) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4ec7618-8b6f-4518-910d-492201a8efcc', 'volume_name': 'volume-d4ec7618-8b6f-4518-910d-492201a8efcc', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:14:48 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-e8f3d529-51b1-47e4-b6a3-528580a81451 tempest-CreateVolumesFromImageTest-605891512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1395aff0-a3b7-461c-988c-68b38547579d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:14:48 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-e8f3d529-51b1-47e4-b6a3-528580a81451 tempest-CreateVolumesFromImageTest-605891512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1395aff0-a3b7-461c-988c-68b38547579d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:14:48 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-e8f3d529-51b1-47e4-b6a3-528580a81451 tempest-CreateVolumesFromImageTest-605891512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8eebc56d-0f59-489a-a3fa-70c599a694c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:14:48 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-e8f3d529-51b1-47e4-b6a3-528580a81451 tempest-CreateVolumesFromImageTest-605891512 None] Volume d4ec7618-8b6f-4518-910d-492201a8efcc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4ec7618-8b6f-4518-910d-492201a8efcc', 'volume_size': 1} Apr 16 15:14:48 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-e8f3d529-51b1-47e4-b6a3-528580a81451 tempest-CreateVolumesFromImageTest-605891512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:14:48 devstack sudo[90550]: pam_unix(sudo:session): session closed for user root Apr 16 15:14:48 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-f2cf7943-a659-4471-9f29-445120197773 tempest-VolumeDependencyTests-1769369869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-35d57e9c-82cf-4ca4-a6c7-4a0773ac88e4" returned: 0 in 0.515s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:14:48 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-f2cf7943-a659-4471-9f29-445120197773 tempest-VolumeDependencyTests-1769369869 None] <== create_volume: return (1320ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'} {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 15:14:48 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-f2cf7943-a659-4471-9f29-445120197773 tempest-VolumeDependencyTests-1769369869 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.323s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:14:48 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-0c74ffba-74be-4cb0-a2ac-fcc498764fb7 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.228s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:14:48 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-0c74ffba-74be-4cb0-a2ac-fcc498764fb7 tempest-CreateVolumesFromSnapshotTest-1272343304 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:14:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-582886727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b18bcbf-e358-4b27-b079-bff25ab2ec17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67db5101aca74e2493d47e4bf32c1892',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:14:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:14:47Z,use_quota=True,user_id='461fefe546444a57bda769f210b6858e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)}" {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 15:14:48 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-0c74ffba-74be-4cb0-a2ac-fcc498764fb7 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Creating volume 5b18bcbf-e358-4b27-b079-bff25ab2ec17 {{(pid=82756) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 15:14:48 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-0c74ffba-74be-4cb0-a2ac-fcc498764fb7 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:14:48 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-0c74ffba-74be-4cb0-a2ac-fcc498764fb7 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:14:48 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-0c74ffba-74be-4cb0-a2ac-fcc498764fb7 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:14:48 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-0c74ffba-74be-4cb0-a2ac-fcc498764fb7 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:14:48 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-0c74ffba-74be-4cb0-a2ac-fcc498764fb7 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:14:48 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-0c74ffba-74be-4cb0-a2ac-fcc498764fb7 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Selected osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 as target Quobyte volume. {{(pid=82756) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 15:14:48 devstack cinder-volume[82756]: INFO cinder.volume.drivers.remotefs [None req-0c74ffba-74be-4cb0-a2ac-fcc498764fb7 tempest-CreateVolumesFromSnapshotTest-1272343304 None] casted to osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 Apr 16 15:14:48 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-0c74ffba-74be-4cb0-a2ac-fcc498764fb7 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-5b18bcbf-e358-4b27-b079-bff25ab2ec17 1073741824 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:14:48 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-f2cf7943-a659-4471-9f29-445120197773 tempest-VolumeDependencyTests-1769369869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55667957-d4f6-408d-8196-767b993a7eb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35d57e9c-82cf-4ca4-a6c7-4a0773ac88e4', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:14:48 devstack sudo[90553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-5b18bcbf-e358-4b27-b079-bff25ab2ec17 1073741824 Apr 16 15:14:48 devstack sudo[90553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:14:48 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-f2cf7943-a659-4471-9f29-445120197773 tempest-VolumeDependencyTests-1769369869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b5a569b-2079-4f8f-a333-ab1c9f93ade4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:14:48 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-f2cf7943-a659-4471-9f29-445120197773 tempest-VolumeDependencyTests-1769369869 None] Volume volume-35d57e9c-82cf-4ca4-a6c7-4a0773ac88e4 (35d57e9c-82cf-4ca4-a6c7-4a0773ac88e4): created successfully Apr 16 15:14:48 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-f2cf7943-a659-4471-9f29-445120197773 tempest-VolumeDependencyTests-1769369869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b5a569b-2079-4f8f-a333-ab1c9f93ade4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:14:48 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-f2cf7943-a659-4471-9f29-445120197773 tempest-VolumeDependencyTests-1769369869 None] Flow 'volume_create_manager' (107361c9-3793-4e7a-91de-5a6f62662570) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:14:48 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-f2cf7943-a659-4471-9f29-445120197773 tempest-VolumeDependencyTests-1769369869 None] Created volume successfully. Apr 16 15:14:49 devstack sudo[90553]: pam_unix(sudo:session): session closed for user root Apr 16 15:14:49 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-0c74ffba-74be-4cb0-a2ac-fcc498764fb7 tempest-CreateVolumesFromSnapshotTest-1272343304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-5b18bcbf-e358-4b27-b079-bff25ab2ec17 1073741824" returned: 0 in 0.610s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:14:49 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-0c74ffba-74be-4cb0-a2ac-fcc498764fb7 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-5b18bcbf-e358-4b27-b079-bff25ab2ec17 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:14:49 devstack sudo[90558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-5b18bcbf-e358-4b27-b079-bff25ab2ec17 Apr 16 15:14:49 devstack sudo[90558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:14:49 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-9bf25f8b-3c11-4929-8ff9-4b36f5e9a558 tempest-VolumeDependencyTests-1769369869 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:14:49 devstack sudo[90558]: pam_unix(sudo:session): session closed for user root Apr 16 15:14:49 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-0c74ffba-74be-4cb0-a2ac-fcc498764fb7 tempest-CreateVolumesFromSnapshotTest-1272343304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-5b18bcbf-e358-4b27-b079-bff25ab2ec17" returned: 0 in 0.515s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:14:49 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-0c74ffba-74be-4cb0-a2ac-fcc498764fb7 tempest-CreateVolumesFromSnapshotTest-1272343304 None] <== create_volume: return (1158ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'} {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 15:14:49 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-0c74ffba-74be-4cb0-a2ac-fcc498764fb7 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.160s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:14:49 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-efbcfbf0-9021-4fe7-8c1c-f55a5337ecb0 tempest-CreateVolumesFromImageTest-605891512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.244s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:14:49 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-efbcfbf0-9021-4fe7-8c1c-f55a5337ecb0 tempest-CreateVolumesFromImageTest-605891512 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:14:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2123904005',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93065a0d-4557-47d0-b061-53fc09cbe63f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7c4e5e569e740e088e3c3c50291c76b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:14:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:14:48Z,use_quota=True,user_id='042629e9ed074407b2806fe3ad61e130',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)}" {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 15:14:49 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-efbcfbf0-9021-4fe7-8c1c-f55a5337ecb0 tempest-CreateVolumesFromImageTest-605891512 None] Creating volume 93065a0d-4557-47d0-b061-53fc09cbe63f {{(pid=82756) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 15:14:49 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-efbcfbf0-9021-4fe7-8c1c-f55a5337ecb0 tempest-CreateVolumesFromImageTest-605891512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:14:49 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-efbcfbf0-9021-4fe7-8c1c-f55a5337ecb0 tempest-CreateVolumesFromImageTest-605891512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:14:49 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-efbcfbf0-9021-4fe7-8c1c-f55a5337ecb0 tempest-CreateVolumesFromImageTest-605891512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:14:49 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-efbcfbf0-9021-4fe7-8c1c-f55a5337ecb0 tempest-CreateVolumesFromImageTest-605891512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:14:49 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-efbcfbf0-9021-4fe7-8c1c-f55a5337ecb0 tempest-CreateVolumesFromImageTest-605891512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:14:49 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-efbcfbf0-9021-4fe7-8c1c-f55a5337ecb0 tempest-CreateVolumesFromImageTest-605891512 None] Selected osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 as target Quobyte volume. {{(pid=82756) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 15:14:49 devstack cinder-volume[82756]: INFO cinder.volume.drivers.remotefs [None req-efbcfbf0-9021-4fe7-8c1c-f55a5337ecb0 tempest-CreateVolumesFromImageTest-605891512 None] casted to osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 Apr 16 15:14:49 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-efbcfbf0-9021-4fe7-8c1c-f55a5337ecb0 tempest-CreateVolumesFromImageTest-605891512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-93065a0d-4557-47d0-b061-53fc09cbe63f 1073741824 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:14:49 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-0c74ffba-74be-4cb0-a2ac-fcc498764fb7 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29c24195-8705-498b-b2e2-2314cf28c527) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b18bcbf-e358-4b27-b079-bff25ab2ec17', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:14:49 devstack sudo[90561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-93065a0d-4557-47d0-b061-53fc09cbe63f 1073741824 Apr 16 15:14:49 devstack sudo[90561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:14:49 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-0c74ffba-74be-4cb0-a2ac-fcc498764fb7 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39628fe9-d441-49ea-a7d9-ebc6db28e15e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:14:49 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-0c74ffba-74be-4cb0-a2ac-fcc498764fb7 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Volume volume-5b18bcbf-e358-4b27-b079-bff25ab2ec17 (5b18bcbf-e358-4b27-b079-bff25ab2ec17): created successfully Apr 16 15:14:49 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-0c74ffba-74be-4cb0-a2ac-fcc498764fb7 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39628fe9-d441-49ea-a7d9-ebc6db28e15e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:14:49 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-0c74ffba-74be-4cb0-a2ac-fcc498764fb7 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Flow 'volume_create_manager' (37a99c8e-9b6f-4cdd-a05b-e268196d5318) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:14:49 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-0c74ffba-74be-4cb0-a2ac-fcc498764fb7 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Created volume successfully. Apr 16 15:14:50 devstack sudo[90561]: pam_unix(sudo:session): session closed for user root Apr 16 15:14:50 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-efbcfbf0-9021-4fe7-8c1c-f55a5337ecb0 tempest-CreateVolumesFromImageTest-605891512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-93065a0d-4557-47d0-b061-53fc09cbe63f 1073741824" returned: 0 in 0.495s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:14:50 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-efbcfbf0-9021-4fe7-8c1c-f55a5337ecb0 tempest-CreateVolumesFromImageTest-605891512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-93065a0d-4557-47d0-b061-53fc09cbe63f {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:14:50 devstack sudo[90566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-93065a0d-4557-47d0-b061-53fc09cbe63f Apr 16 15:14:50 devstack sudo[90566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:14:50 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-6a6a40f9-afd7-4607-b395-bc2e069afd3e tempest-CreateVolumesFromSnapshotTest-1272343304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:14:50 devstack sudo[90566]: pam_unix(sudo:session): session closed for user root Apr 16 15:14:50 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-efbcfbf0-9021-4fe7-8c1c-f55a5337ecb0 tempest-CreateVolumesFromImageTest-605891512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-93065a0d-4557-47d0-b061-53fc09cbe63f" returned: 0 in 0.489s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:14:50 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-efbcfbf0-9021-4fe7-8c1c-f55a5337ecb0 tempest-CreateVolumesFromImageTest-605891512 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'} {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 15:14:50 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-efbcfbf0-9021-4fe7-8c1c-f55a5337ecb0 tempest-CreateVolumesFromImageTest-605891512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.028s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:14:50 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-355ee358-b7a8-4666-8ea6-4ca0d400f050 tempest-CreateVolumesFromImageTest-605891512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.059s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:14:50 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-355ee358-b7a8-4666-8ea6-4ca0d400f050 tempest-CreateVolumesFromImageTest-605891512 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:14:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2066859054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ac4e079-556f-4842-9bd0-a9e34bad6d7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7c4e5e569e740e088e3c3c50291c76b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:14:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:14:48Z,use_quota=True,user_id='042629e9ed074407b2806fe3ad61e130',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)}" {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 15:14:50 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-355ee358-b7a8-4666-8ea6-4ca0d400f050 tempest-CreateVolumesFromImageTest-605891512 None] Creating volume 5ac4e079-556f-4842-9bd0-a9e34bad6d7a {{(pid=82756) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 15:14:50 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-355ee358-b7a8-4666-8ea6-4ca0d400f050 tempest-CreateVolumesFromImageTest-605891512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:14:50 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-355ee358-b7a8-4666-8ea6-4ca0d400f050 tempest-CreateVolumesFromImageTest-605891512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:14:50 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-355ee358-b7a8-4666-8ea6-4ca0d400f050 tempest-CreateVolumesFromImageTest-605891512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:14:50 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-355ee358-b7a8-4666-8ea6-4ca0d400f050 tempest-CreateVolumesFromImageTest-605891512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:14:50 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-355ee358-b7a8-4666-8ea6-4ca0d400f050 tempest-CreateVolumesFromImageTest-605891512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:14:50 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-355ee358-b7a8-4666-8ea6-4ca0d400f050 tempest-CreateVolumesFromImageTest-605891512 None] Selected osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 as target Quobyte volume. {{(pid=82756) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 15:14:50 devstack cinder-volume[82756]: INFO cinder.volume.drivers.remotefs [None req-355ee358-b7a8-4666-8ea6-4ca0d400f050 tempest-CreateVolumesFromImageTest-605891512 None] casted to osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 Apr 16 15:14:50 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-355ee358-b7a8-4666-8ea6-4ca0d400f050 tempest-CreateVolumesFromImageTest-605891512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-5ac4e079-556f-4842-9bd0-a9e34bad6d7a 1073741824 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:14:50 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-efbcfbf0-9021-4fe7-8c1c-f55a5337ecb0 tempest-CreateVolumesFromImageTest-605891512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a1e2fcb-f3ec-44a9-b87b-8e7b09821b30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93065a0d-4557-47d0-b061-53fc09cbe63f', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:14:50 devstack sudo[90569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-5ac4e079-556f-4842-9bd0-a9e34bad6d7a 1073741824 Apr 16 15:14:50 devstack sudo[90569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:14:50 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-efbcfbf0-9021-4fe7-8c1c-f55a5337ecb0 tempest-CreateVolumesFromImageTest-605891512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3ae0f8f-3604-47f1-a8cb-7efdb55726ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:14:50 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-efbcfbf0-9021-4fe7-8c1c-f55a5337ecb0 tempest-CreateVolumesFromImageTest-605891512 None] Volume volume-93065a0d-4557-47d0-b061-53fc09cbe63f (93065a0d-4557-47d0-b061-53fc09cbe63f): created successfully Apr 16 15:14:50 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-efbcfbf0-9021-4fe7-8c1c-f55a5337ecb0 tempest-CreateVolumesFromImageTest-605891512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3ae0f8f-3604-47f1-a8cb-7efdb55726ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:14:50 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-efbcfbf0-9021-4fe7-8c1c-f55a5337ecb0 tempest-CreateVolumesFromImageTest-605891512 None] Flow 'volume_create_manager' (07d9c019-d73b-43bd-8e47-3e7bf375bf8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:14:50 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-efbcfbf0-9021-4fe7-8c1c-f55a5337ecb0 tempest-CreateVolumesFromImageTest-605891512 None] Created volume successfully. Apr 16 15:14:51 devstack sudo[90569]: pam_unix(sudo:session): session closed for user root Apr 16 15:14:51 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-355ee358-b7a8-4666-8ea6-4ca0d400f050 tempest-CreateVolumesFromImageTest-605891512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-5ac4e079-556f-4842-9bd0-a9e34bad6d7a 1073741824" returned: 0 in 0.628s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:14:51 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-355ee358-b7a8-4666-8ea6-4ca0d400f050 tempest-CreateVolumesFromImageTest-605891512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-5ac4e079-556f-4842-9bd0-a9e34bad6d7a {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:14:51 devstack sudo[90574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-5ac4e079-556f-4842-9bd0-a9e34bad6d7a Apr 16 15:14:51 devstack sudo[90574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:14:51 devstack cinder-volume[82756]: DEBUG oslo_service.periodic_task [None req-9570f02d-5ef9-412b-993f-520a9e5bfa81 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82756) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 16 15:14:51 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-9570f02d-5ef9-412b-993f-520a9e5bfa81 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:14:51 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-9570f02d-5ef9-412b-993f-520a9e5bfa81 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:14:51 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-9570f02d-5ef9-412b-993f-520a9e5bfa81 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:14:51 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-9570f02d-5ef9-412b-993f-520a9e5bfa81 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:14:51 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-9570f02d-5ef9-412b-993f-520a9e5bfa81 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:14:51 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-9570f02d-5ef9-412b-993f-520a9e5bfa81 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:14:51 devstack sudo[90576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:14:51 devstack sudo[90576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:14:52 devstack sudo[90574]: pam_unix(sudo:session): session closed for user root Apr 16 15:14:52 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-355ee358-b7a8-4666-8ea6-4ca0d400f050 tempest-CreateVolumesFromImageTest-605891512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-5ac4e079-556f-4842-9bd0-a9e34bad6d7a" returned: 0 in 0.555s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:14:52 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-355ee358-b7a8-4666-8ea6-4ca0d400f050 tempest-CreateVolumesFromImageTest-605891512 None] <== create_volume: return (1226ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'} {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 15:14:52 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-355ee358-b7a8-4666-8ea6-4ca0d400f050 tempest-CreateVolumesFromImageTest-605891512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.230s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:14:52 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-24056748-cf61-4c83-9d58-7c3b771797af tempest-CreateVolumesFromImageTest-605891512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.970s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:14:52 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-24056748-cf61-4c83-9d58-7c3b771797af tempest-CreateVolumesFromImageTest-605891512 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:14:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-216883958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6038cd6f-d6c3-4b44-8ae8-356cb60be78f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7c4e5e569e740e088e3c3c50291c76b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:14:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:14:48Z,use_quota=True,user_id='042629e9ed074407b2806fe3ad61e130',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)}" {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 15:14:52 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-24056748-cf61-4c83-9d58-7c3b771797af tempest-CreateVolumesFromImageTest-605891512 None] Creating volume 6038cd6f-d6c3-4b44-8ae8-356cb60be78f {{(pid=82756) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 15:14:52 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-24056748-cf61-4c83-9d58-7c3b771797af tempest-CreateVolumesFromImageTest-605891512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:14:52 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-24056748-cf61-4c83-9d58-7c3b771797af tempest-CreateVolumesFromImageTest-605891512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:14:52 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-24056748-cf61-4c83-9d58-7c3b771797af tempest-CreateVolumesFromImageTest-605891512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:14:52 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-24056748-cf61-4c83-9d58-7c3b771797af tempest-CreateVolumesFromImageTest-605891512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:14:52 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-24056748-cf61-4c83-9d58-7c3b771797af tempest-CreateVolumesFromImageTest-605891512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:14:52 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-24056748-cf61-4c83-9d58-7c3b771797af tempest-CreateVolumesFromImageTest-605891512 None] Selected osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 as target Quobyte volume. {{(pid=82756) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 15:14:52 devstack cinder-volume[82756]: INFO cinder.volume.drivers.remotefs [None req-24056748-cf61-4c83-9d58-7c3b771797af tempest-CreateVolumesFromImageTest-605891512 None] casted to osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 Apr 16 15:14:52 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-24056748-cf61-4c83-9d58-7c3b771797af tempest-CreateVolumesFromImageTest-605891512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6038cd6f-d6c3-4b44-8ae8-356cb60be78f 1073741824 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:14:52 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-355ee358-b7a8-4666-8ea6-4ca0d400f050 tempest-CreateVolumesFromImageTest-605891512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a80bb80-7d78-4bc4-ab2a-4f9f95058657) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ac4e079-556f-4842-9bd0-a9e34bad6d7a', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:14:52 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-355ee358-b7a8-4666-8ea6-4ca0d400f050 tempest-CreateVolumesFromImageTest-605891512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9101dba9-23ca-4773-a209-c20f909be7b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:14:52 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-355ee358-b7a8-4666-8ea6-4ca0d400f050 tempest-CreateVolumesFromImageTest-605891512 None] Volume volume-5ac4e079-556f-4842-9bd0-a9e34bad6d7a (5ac4e079-556f-4842-9bd0-a9e34bad6d7a): created successfully Apr 16 15:14:52 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-355ee358-b7a8-4666-8ea6-4ca0d400f050 tempest-CreateVolumesFromImageTest-605891512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9101dba9-23ca-4773-a209-c20f909be7b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:14:52 devstack sudo[90580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6038cd6f-d6c3-4b44-8ae8-356cb60be78f 1073741824 Apr 16 15:14:52 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-355ee358-b7a8-4666-8ea6-4ca0d400f050 tempest-CreateVolumesFromImageTest-605891512 None] Flow 'volume_create_manager' (b470e104-3d66-4f94-80f4-3409cb41bcd3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:14:52 devstack sudo[90580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:14:52 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-355ee358-b7a8-4666-8ea6-4ca0d400f050 tempest-CreateVolumesFromImageTest-605891512 None] Created volume successfully. Apr 16 15:14:52 devstack sudo[90576]: pam_unix(sudo:session): session closed for user root Apr 16 15:14:52 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-9570f02d-5ef9-412b-993f-520a9e5bfa81 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.482s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:14:52 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-9570f02d-5ef9-412b-993f-520a9e5bfa81 None None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:14:52 devstack sudo[90580]: pam_unix(sudo:session): session closed for user root Apr 16 15:14:52 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-24056748-cf61-4c83-9d58-7c3b771797af tempest-CreateVolumesFromImageTest-605891512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6038cd6f-d6c3-4b44-8ae8-356cb60be78f 1073741824" returned: 0 in 0.684s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:14:52 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-24056748-cf61-4c83-9d58-7c3b771797af tempest-CreateVolumesFromImageTest-605891512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6038cd6f-d6c3-4b44-8ae8-356cb60be78f {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:14:52 devstack sudo[90585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6038cd6f-d6c3-4b44-8ae8-356cb60be78f Apr 16 15:14:52 devstack sudo[90585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:14:53 devstack sudo[90585]: pam_unix(sudo:session): session closed for user root Apr 16 15:14:53 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-24056748-cf61-4c83-9d58-7c3b771797af tempest-CreateVolumesFromImageTest-605891512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6038cd6f-d6c3-4b44-8ae8-356cb60be78f" returned: 0 in 0.441s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:14:53 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-24056748-cf61-4c83-9d58-7c3b771797af tempest-CreateVolumesFromImageTest-605891512 None] <== create_volume: return (1149ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'} {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 15:14:53 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-24056748-cf61-4c83-9d58-7c3b771797af tempest-CreateVolumesFromImageTest-605891512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.152s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:14:53 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-99924502-a079-4221-96c6-4d8ebc8fa530 tempest-CreateVolumesFromImageTest-605891512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.872s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:14:53 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-99924502-a079-4221-96c6-4d8ebc8fa530 tempest-CreateVolumesFromImageTest-605891512 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:14:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1337390840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=207759b5-72ae-4e76-9179-defd74dd1058,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7c4e5e569e740e088e3c3c50291c76b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:14:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:14:48Z,use_quota=True,user_id='042629e9ed074407b2806fe3ad61e130',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)}" {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 15:14:53 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-99924502-a079-4221-96c6-4d8ebc8fa530 tempest-CreateVolumesFromImageTest-605891512 None] Creating volume 207759b5-72ae-4e76-9179-defd74dd1058 {{(pid=82756) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 15:14:53 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-99924502-a079-4221-96c6-4d8ebc8fa530 tempest-CreateVolumesFromImageTest-605891512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:14:53 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-99924502-a079-4221-96c6-4d8ebc8fa530 tempest-CreateVolumesFromImageTest-605891512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:14:53 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-99924502-a079-4221-96c6-4d8ebc8fa530 tempest-CreateVolumesFromImageTest-605891512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:14:53 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-99924502-a079-4221-96c6-4d8ebc8fa530 tempest-CreateVolumesFromImageTest-605891512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:14:53 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-99924502-a079-4221-96c6-4d8ebc8fa530 tempest-CreateVolumesFromImageTest-605891512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:14:53 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-99924502-a079-4221-96c6-4d8ebc8fa530 tempest-CreateVolumesFromImageTest-605891512 None] Selected osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 as target Quobyte volume. {{(pid=82756) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 15:14:53 devstack cinder-volume[82756]: INFO cinder.volume.drivers.remotefs [None req-99924502-a079-4221-96c6-4d8ebc8fa530 tempest-CreateVolumesFromImageTest-605891512 None] casted to osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 Apr 16 15:14:53 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-99924502-a079-4221-96c6-4d8ebc8fa530 tempest-CreateVolumesFromImageTest-605891512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-207759b5-72ae-4e76-9179-defd74dd1058 1073741824 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:14:53 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-24056748-cf61-4c83-9d58-7c3b771797af tempest-CreateVolumesFromImageTest-605891512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fea9a358-c84f-4153-9586-025bf7295a56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6038cd6f-d6c3-4b44-8ae8-356cb60be78f', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:14:53 devstack sudo[90588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-207759b5-72ae-4e76-9179-defd74dd1058 1073741824 Apr 16 15:14:53 devstack sudo[90588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:14:53 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-24056748-cf61-4c83-9d58-7c3b771797af tempest-CreateVolumesFromImageTest-605891512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13289a09-0da7-4773-97ec-da003bdb0c0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:14:53 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-24056748-cf61-4c83-9d58-7c3b771797af tempest-CreateVolumesFromImageTest-605891512 None] Volume volume-6038cd6f-d6c3-4b44-8ae8-356cb60be78f (6038cd6f-d6c3-4b44-8ae8-356cb60be78f): created successfully Apr 16 15:14:53 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-24056748-cf61-4c83-9d58-7c3b771797af tempest-CreateVolumesFromImageTest-605891512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13289a09-0da7-4773-97ec-da003bdb0c0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:14:53 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-24056748-cf61-4c83-9d58-7c3b771797af tempest-CreateVolumesFromImageTest-605891512 None] Flow 'volume_create_manager' (086f88c7-d873-4609-a967-5cd2cd26d858) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:14:53 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-24056748-cf61-4c83-9d58-7c3b771797af tempest-CreateVolumesFromImageTest-605891512 None] Created volume successfully. Apr 16 15:14:53 devstack sudo[90588]: pam_unix(sudo:session): session closed for user root Apr 16 15:14:53 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-99924502-a079-4221-96c6-4d8ebc8fa530 tempest-CreateVolumesFromImageTest-605891512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-207759b5-72ae-4e76-9179-defd74dd1058 1073741824" returned: 0 in 0.585s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:14:53 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-99924502-a079-4221-96c6-4d8ebc8fa530 tempest-CreateVolumesFromImageTest-605891512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-207759b5-72ae-4e76-9179-defd74dd1058 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:14:53 devstack sudo[90594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-207759b5-72ae-4e76-9179-defd74dd1058 Apr 16 15:14:53 devstack sudo[90594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:14:54 devstack sudo[90594]: pam_unix(sudo:session): session closed for user root Apr 16 15:14:54 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-99924502-a079-4221-96c6-4d8ebc8fa530 tempest-CreateVolumesFromImageTest-605891512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-207759b5-72ae-4e76-9179-defd74dd1058" returned: 0 in 0.524s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:14:54 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-99924502-a079-4221-96c6-4d8ebc8fa530 tempest-CreateVolumesFromImageTest-605891512 None] <== create_volume: return (1137ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'} {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 15:14:54 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-99924502-a079-4221-96c6-4d8ebc8fa530 tempest-CreateVolumesFromImageTest-605891512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.139s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:14:54 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-e8f3d529-51b1-47e4-b6a3-528580a81451 tempest-CreateVolumesFromImageTest-605891512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.936s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:14:54 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-e8f3d529-51b1-47e4-b6a3-528580a81451 tempest-CreateVolumesFromImageTest-605891512 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:14:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1417154097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4ec7618-8b6f-4518-910d-492201a8efcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7c4e5e569e740e088e3c3c50291c76b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:14:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:14:48Z,use_quota=True,user_id='042629e9ed074407b2806fe3ad61e130',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)}" {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 15:14:54 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-e8f3d529-51b1-47e4-b6a3-528580a81451 tempest-CreateVolumesFromImageTest-605891512 None] Creating volume d4ec7618-8b6f-4518-910d-492201a8efcc {{(pid=82756) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 15:14:54 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-e8f3d529-51b1-47e4-b6a3-528580a81451 tempest-CreateVolumesFromImageTest-605891512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:14:54 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-e8f3d529-51b1-47e4-b6a3-528580a81451 tempest-CreateVolumesFromImageTest-605891512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:14:54 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-e8f3d529-51b1-47e4-b6a3-528580a81451 tempest-CreateVolumesFromImageTest-605891512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:14:54 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-e8f3d529-51b1-47e4-b6a3-528580a81451 tempest-CreateVolumesFromImageTest-605891512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:14:54 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-e8f3d529-51b1-47e4-b6a3-528580a81451 tempest-CreateVolumesFromImageTest-605891512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:14:54 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-e8f3d529-51b1-47e4-b6a3-528580a81451 tempest-CreateVolumesFromImageTest-605891512 None] Selected osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 as target Quobyte volume. {{(pid=82756) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 15:14:54 devstack cinder-volume[82756]: INFO cinder.volume.drivers.remotefs [None req-e8f3d529-51b1-47e4-b6a3-528580a81451 tempest-CreateVolumesFromImageTest-605891512 None] casted to osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 Apr 16 15:14:54 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-e8f3d529-51b1-47e4-b6a3-528580a81451 tempest-CreateVolumesFromImageTest-605891512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-d4ec7618-8b6f-4518-910d-492201a8efcc 1073741824 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:14:54 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-99924502-a079-4221-96c6-4d8ebc8fa530 tempest-CreateVolumesFromImageTest-605891512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2eeda06-7bec-4b5d-8165-992439bff66d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-207759b5-72ae-4e76-9179-defd74dd1058', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:14:54 devstack sudo[90597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-d4ec7618-8b6f-4518-910d-492201a8efcc 1073741824 Apr 16 15:14:54 devstack sudo[90597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:14:54 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-99924502-a079-4221-96c6-4d8ebc8fa530 tempest-CreateVolumesFromImageTest-605891512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fcb41e7-77a2-488e-982d-588fe8883aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:14:54 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-99924502-a079-4221-96c6-4d8ebc8fa530 tempest-CreateVolumesFromImageTest-605891512 None] Volume volume-207759b5-72ae-4e76-9179-defd74dd1058 (207759b5-72ae-4e76-9179-defd74dd1058): created successfully Apr 16 15:14:54 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-99924502-a079-4221-96c6-4d8ebc8fa530 tempest-CreateVolumesFromImageTest-605891512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fcb41e7-77a2-488e-982d-588fe8883aa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:14:54 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-99924502-a079-4221-96c6-4d8ebc8fa530 tempest-CreateVolumesFromImageTest-605891512 None] Flow 'volume_create_manager' (6f4f8a5d-b751-4643-9373-341c0048a96d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:14:54 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-99924502-a079-4221-96c6-4d8ebc8fa530 tempest-CreateVolumesFromImageTest-605891512 None] Created volume successfully. Apr 16 15:14:55 devstack sudo[90597]: pam_unix(sudo:session): session closed for user root Apr 16 15:14:55 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-e8f3d529-51b1-47e4-b6a3-528580a81451 tempest-CreateVolumesFromImageTest-605891512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-d4ec7618-8b6f-4518-910d-492201a8efcc 1073741824" returned: 0 in 0.616s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:14:55 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-e8f3d529-51b1-47e4-b6a3-528580a81451 tempest-CreateVolumesFromImageTest-605891512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-d4ec7618-8b6f-4518-910d-492201a8efcc {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:14:55 devstack sudo[90602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-d4ec7618-8b6f-4518-910d-492201a8efcc Apr 16 15:14:55 devstack sudo[90602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:14:55 devstack sudo[90602]: pam_unix(sudo:session): session closed for user root Apr 16 15:14:55 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-e8f3d529-51b1-47e4-b6a3-528580a81451 tempest-CreateVolumesFromImageTest-605891512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-d4ec7618-8b6f-4518-910d-492201a8efcc" returned: 0 in 0.412s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:14:55 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-e8f3d529-51b1-47e4-b6a3-528580a81451 tempest-CreateVolumesFromImageTest-605891512 None] <== create_volume: return (1053ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'} {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 15:14:55 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-e8f3d529-51b1-47e4-b6a3-528580a81451 tempest-CreateVolumesFromImageTest-605891512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.056s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:14:55 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-9bf25f8b-3c11-4929-8ff9-4b36f5e9a558 tempest-VolumeDependencyTests-1769369869 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.984s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:14:55 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-e8f3d529-51b1-47e4-b6a3-528580a81451 tempest-CreateVolumesFromImageTest-605891512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8eebc56d-0f59-489a-a3fa-70c599a694c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4ec7618-8b6f-4518-910d-492201a8efcc', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:14:55 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-e8f3d529-51b1-47e4-b6a3-528580a81451 tempest-CreateVolumesFromImageTest-605891512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a9ddb58-8b0e-44b2-b45e-120e8bdb418a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:14:55 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-9bf25f8b-3c11-4929-8ff9-4b36f5e9a558 tempest-VolumeDependencyTests-1769369869 None] Creating offline snapshot 88efe222-a7ad-4c91-84a8-762f2b4d9492 of volume 35d57e9c-82cf-4ca4-a6c7-4a0773ac88e4 {{(pid=82756) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 16 15:14:55 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-e8f3d529-51b1-47e4-b6a3-528580a81451 tempest-CreateVolumesFromImageTest-605891512 None] Volume volume-d4ec7618-8b6f-4518-910d-492201a8efcc (d4ec7618-8b6f-4518-910d-492201a8efcc): created successfully Apr 16 15:14:55 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-e8f3d529-51b1-47e4-b6a3-528580a81451 tempest-CreateVolumesFromImageTest-605891512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a9ddb58-8b0e-44b2-b45e-120e8bdb418a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:14:55 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-e8f3d529-51b1-47e4-b6a3-528580a81451 tempest-CreateVolumesFromImageTest-605891512 None] Flow 'volume_create_manager' (db805720-0399-4a4b-a400-7e7c5a49e398) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:14:55 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e25a543-a505-4505-a5de-4b06aaa0e321]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:14:55 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-9bf25f8b-3c11-4929-8ff9-4b36f5e9a558 tempest-VolumeDependencyTests-1769369869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-35d57e9c-82cf-4ca4-a6c7-4a0773ac88e4 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:14:55 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-e8f3d529-51b1-47e4-b6a3-528580a81451 tempest-CreateVolumesFromImageTest-605891512 None] Created volume successfully. Apr 16 15:14:55 devstack sudo[90605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-35d57e9c-82cf-4ca4-a6c7-4a0773ac88e4 Apr 16 15:14:55 devstack sudo[90605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:14:56 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-6237c375-08f7-49a8-8155-ed6a9abf279f tempest-CreateVolumesFromImageTest-605891512 None] Acquiring lock "cinder-d4ec7618-8b6f-4518-910d-492201a8efcc-delete_volume" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:14:56 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-6237c375-08f7-49a8-8155-ed6a9abf279f tempest-CreateVolumesFromImageTest-605891512 None] Lock "cinder-d4ec7618-8b6f-4518-910d-492201a8efcc-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:14:56 devstack sudo[90605]: pam_unix(sudo:session): session closed for user root Apr 16 15:14:56 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-9bf25f8b-3c11-4929-8ff9-4b36f5e9a558 tempest-VolumeDependencyTests-1769369869 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-35d57e9c-82cf-4ca4-a6c7-4a0773ac88e4" returned: 0 in 0.599s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:14:56 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-9bf25f8b-3c11-4929-8ff9-4b36f5e9a558 tempest-VolumeDependencyTests-1769369869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-35d57e9c-82cf-4ca4-a6c7-4a0773ac88e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-35d57e9c-82cf-4ca4-a6c7-4a0773ac88e4.88efe222-a7ad-4c91-84a8-762f2b4d9492 1G {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:14:56 devstack sudo[90610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-35d57e9c-82cf-4ca4-a6c7-4a0773ac88e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-35d57e9c-82cf-4ca4-a6c7-4a0773ac88e4.88efe222-a7ad-4c91-84a8-762f2b4d9492 1G Apr 16 15:14:56 devstack sudo[90610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:14:56 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-6237c375-08f7-49a8-8155-ed6a9abf279f tempest-CreateVolumesFromImageTest-605891512 None] Acquiring lock "cinder-quobyte-d4ec7618-8b6f-4518-910d-492201a8efcc" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:14:56 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-6237c375-08f7-49a8-8155-ed6a9abf279f tempest-CreateVolumesFromImageTest-605891512 None] Lock "cinder-quobyte-d4ec7618-8b6f-4518-910d-492201a8efcc" acquired by "delete_volume" :: waited 0.010s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:14:56 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[75a80124-0246-478f-8053-15754ca1d464]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:14:56 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-6237c375-08f7-49a8-8155-ed6a9abf279f tempest-CreateVolumesFromImageTest-605891512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-d4ec7618-8b6f-4518-910d-492201a8efcc {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:14:56 devstack sudo[90612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-d4ec7618-8b6f-4518-910d-492201a8efcc Apr 16 15:14:56 devstack sudo[90612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:14:56 devstack sudo[90612]: pam_unix(sudo:session): session closed for user root Apr 16 15:14:56 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-6237c375-08f7-49a8-8155-ed6a9abf279f tempest-CreateVolumesFromImageTest-605891512 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-d4ec7618-8b6f-4518-910d-492201a8efcc" returned: 0 in 0.554s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:14:56 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-6237c375-08f7-49a8-8155-ed6a9abf279f tempest-CreateVolumesFromImageTest-605891512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-d4ec7618-8b6f-4518-910d-492201a8efcc {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:14:56 devstack sudo[90620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-d4ec7618-8b6f-4518-910d-492201a8efcc Apr 16 15:14:56 devstack sudo[90620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:14:56 devstack sudo[90610]: pam_unix(sudo:session): session closed for user root Apr 16 15:14:56 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-9bf25f8b-3c11-4929-8ff9-4b36f5e9a558 tempest-VolumeDependencyTests-1769369869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-35d57e9c-82cf-4ca4-a6c7-4a0773ac88e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-35d57e9c-82cf-4ca4-a6c7-4a0773ac88e4.88efe222-a7ad-4c91-84a8-762f2b4d9492 1G" returned: 0 in 0.661s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:14:56 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-9bf25f8b-3c11-4929-8ff9-4b36f5e9a558 tempest-VolumeDependencyTests-1769369869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35d57e9c-82cf-4ca4-a6c7-4a0773ac88e4 -F qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-35d57e9c-82cf-4ca4-a6c7-4a0773ac88e4.88efe222-a7ad-4c91-84a8-762f2b4d9492 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:14:56 devstack sudo[90622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35d57e9c-82cf-4ca4-a6c7-4a0773ac88e4 -F qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-35d57e9c-82cf-4ca4-a6c7-4a0773ac88e4.88efe222-a7ad-4c91-84a8-762f2b4d9492 Apr 16 15:14:56 devstack sudo[90622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:14:57 devstack sudo[90620]: pam_unix(sudo:session): session closed for user root Apr 16 15:14:57 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-6237c375-08f7-49a8-8155-ed6a9abf279f tempest-CreateVolumesFromImageTest-605891512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-d4ec7618-8b6f-4518-910d-492201a8efcc" returned: 0 in 0.458s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:14:57 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-6237c375-08f7-49a8-8155-ed6a9abf279f tempest-CreateVolumesFromImageTest-605891512 None] Lock "cinder-quobyte-d4ec7618-8b6f-4518-910d-492201a8efcc" released by "delete_volume" :: held 1.039s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:14:57 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-6237c375-08f7-49a8-8155-ed6a9abf279f tempest-CreateVolumesFromImageTest-605891512 None] Created reservations ['01fadba8-c819-48ac-8939-8258313f6158', '0df197d9-e8e0-4ef9-b7f7-8e919d14ccaa', 'a9520122-336f-43dd-a653-80cec270074e', '9c85b4b5-0301-41df-99c7-15f934ef8783'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:14:57 devstack sudo[90622]: pam_unix(sudo:session): session closed for user root Apr 16 15:14:57 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-9bf25f8b-3c11-4929-8ff9-4b36f5e9a558 tempest-VolumeDependencyTests-1769369869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35d57e9c-82cf-4ca4-a6c7-4a0773ac88e4 -F qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-35d57e9c-82cf-4ca4-a6c7-4a0773ac88e4.88efe222-a7ad-4c91-84a8-762f2b4d9492" returned: 0 in 0.483s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:14:57 devstack cinder-volume[82756]: WARNING cinder.volume.drivers.remotefs [None req-9bf25f8b-3c11-4929-8ff9-4b36f5e9a558 tempest-VolumeDependencyTests-1769369869 None] /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-35d57e9c-82cf-4ca4-a6c7-4a0773ac88e4.88efe222-a7ad-4c91-84a8-762f2b4d9492 is being set with open permissions: ugo+rw Apr 16 15:14:57 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-9bf25f8b-3c11-4929-8ff9-4b36f5e9a558 tempest-VolumeDependencyTests-1769369869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-35d57e9c-82cf-4ca4-a6c7-4a0773ac88e4.88efe222-a7ad-4c91-84a8-762f2b4d9492 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:14:57 devstack sudo[90628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-35d57e9c-82cf-4ca4-a6c7-4a0773ac88e4.88efe222-a7ad-4c91-84a8-762f2b4d9492 Apr 16 15:14:57 devstack sudo[90628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:14:57 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-6237c375-08f7-49a8-8155-ed6a9abf279f tempest-CreateVolumesFromImageTest-605891512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:14:57 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-6237c375-08f7-49a8-8155-ed6a9abf279f tempest-CreateVolumesFromImageTest-605891512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:14:57 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-6237c375-08f7-49a8-8155-ed6a9abf279f tempest-CreateVolumesFromImageTest-605891512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:14:57 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-6237c375-08f7-49a8-8155-ed6a9abf279f tempest-CreateVolumesFromImageTest-605891512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:14:57 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-6237c375-08f7-49a8-8155-ed6a9abf279f tempest-CreateVolumesFromImageTest-605891512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:14:57 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-6237c375-08f7-49a8-8155-ed6a9abf279f tempest-CreateVolumesFromImageTest-605891512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:14:57 devstack sudo[90630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:14:57 devstack sudo[90630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:14:57 devstack sudo[90628]: pam_unix(sudo:session): session closed for user root Apr 16 15:14:57 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-9bf25f8b-3c11-4929-8ff9-4b36f5e9a558 tempest-VolumeDependencyTests-1769369869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-35d57e9c-82cf-4ca4-a6c7-4a0773ac88e4.88efe222-a7ad-4c91-84a8-762f2b4d9492" returned: 0 in 0.491s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:14:57 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-9bf25f8b-3c11-4929-8ff9-4b36f5e9a558 tempest-VolumeDependencyTests-1769369869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-35d57e9c-82cf-4ca4-a6c7-4a0773ac88e4.info {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:14:57 devstack sudo[90634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-35d57e9c-82cf-4ca4-a6c7-4a0773ac88e4.info Apr 16 15:14:57 devstack sudo[90634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:14:57 devstack sudo[90630]: pam_unix(sudo:session): session closed for user root Apr 16 15:14:57 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-6237c375-08f7-49a8-8155-ed6a9abf279f tempest-CreateVolumesFromImageTest-605891512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.499s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:14:57 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-6237c375-08f7-49a8-8155-ed6a9abf279f tempest-CreateVolumesFromImageTest-605891512 None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:14:57 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-6237c375-08f7-49a8-8155-ed6a9abf279f tempest-CreateVolumesFromImageTest-605891512 None] Deleted volume successfully. Apr 16 15:14:57 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-6237c375-08f7-49a8-8155-ed6a9abf279f tempest-CreateVolumesFromImageTest-605891512 None] Lock "cinder-d4ec7618-8b6f-4518-910d-492201a8efcc-delete_volume" released by "delete_volume" :: held 1.767s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:14:58 devstack sudo[90634]: pam_unix(sudo:session): session closed for user root Apr 16 15:14:58 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-9bf25f8b-3c11-4929-8ff9-4b36f5e9a558 tempest-VolumeDependencyTests-1769369869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-35d57e9c-82cf-4ca4-a6c7-4a0773ac88e4.info" returned: 0 in 0.412s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:14:58 devstack cinder-volume[82756]: WARNING cinder.volume.drivers.remotefs [None req-9bf25f8b-3c11-4929-8ff9-4b36f5e9a558 tempest-VolumeDependencyTests-1769369869 None] /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-35d57e9c-82cf-4ca4-a6c7-4a0773ac88e4.info is being set with open permissions: ugo+rw Apr 16 15:14:58 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-9bf25f8b-3c11-4929-8ff9-4b36f5e9a558 tempest-VolumeDependencyTests-1769369869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-35d57e9c-82cf-4ca4-a6c7-4a0773ac88e4.info {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:14:58 devstack sudo[90637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-35d57e9c-82cf-4ca4-a6c7-4a0773ac88e4.info Apr 16 15:14:58 devstack sudo[90637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:14:58 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-767f7ea0-49ac-4d19-993d-f4553d73ea80 tempest-CreateVolumesFromImageTest-605891512 None] Acquiring lock "cinder-207759b5-72ae-4e76-9179-defd74dd1058-delete_volume" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:14:58 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-767f7ea0-49ac-4d19-993d-f4553d73ea80 tempest-CreateVolumesFromImageTest-605891512 None] Lock "cinder-207759b5-72ae-4e76-9179-defd74dd1058-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:14:58 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-767f7ea0-49ac-4d19-993d-f4553d73ea80 tempest-CreateVolumesFromImageTest-605891512 None] Acquiring lock "cinder-quobyte-207759b5-72ae-4e76-9179-defd74dd1058" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:14:58 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-767f7ea0-49ac-4d19-993d-f4553d73ea80 tempest-CreateVolumesFromImageTest-605891512 None] Lock "cinder-quobyte-207759b5-72ae-4e76-9179-defd74dd1058" acquired by "delete_volume" :: waited 0.008s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:14:58 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[9576760e-91fa-4c1a-9e16-cc24f37479ee]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:14:58 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-767f7ea0-49ac-4d19-993d-f4553d73ea80 tempest-CreateVolumesFromImageTest-605891512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-207759b5-72ae-4e76-9179-defd74dd1058 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:14:58 devstack sudo[90639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-207759b5-72ae-4e76-9179-defd74dd1058 Apr 16 15:14:58 devstack sudo[90639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:14:58 devstack sudo[90637]: pam_unix(sudo:session): session closed for user root Apr 16 15:14:58 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-9bf25f8b-3c11-4929-8ff9-4b36f5e9a558 tempest-VolumeDependencyTests-1769369869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-35d57e9c-82cf-4ca4-a6c7-4a0773ac88e4.info" returned: 0 in 0.449s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:14:58 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-9bf25f8b-3c11-4929-8ff9-4b36f5e9a558 tempest-VolumeDependencyTests-1769369869 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.196s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:14:58 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-6a6a40f9-afd7-4607-b395-bc2e069afd3e tempest-CreateVolumesFromSnapshotTest-1272343304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.058s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:14:58 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-6a6a40f9-afd7-4607-b395-bc2e069afd3e tempest-CreateVolumesFromSnapshotTest-1272343304 None] Creating offline snapshot ea81d119-9f42-4534-ba5f-7f94f7f8a737 of volume 5b18bcbf-e358-4b27-b079-bff25ab2ec17 {{(pid=82756) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 16 15:14:58 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d41c3b4-cac3-4906-a68c-a75d89ed680a]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:14:58 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-6a6a40f9-afd7-4607-b395-bc2e069afd3e tempest-CreateVolumesFromSnapshotTest-1272343304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-5b18bcbf-e358-4b27-b079-bff25ab2ec17 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:14:58 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-9bf25f8b-3c11-4929-8ff9-4b36f5e9a558 tempest-VolumeDependencyTests-1769369869 None] Create snapshot completed successfully Apr 16 15:14:58 devstack sudo[90642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-5b18bcbf-e358-4b27-b079-bff25ab2ec17 Apr 16 15:14:58 devstack sudo[90642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:14:58 devstack sudo[90639]: pam_unix(sudo:session): session closed for user root Apr 16 15:14:58 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-767f7ea0-49ac-4d19-993d-f4553d73ea80 tempest-CreateVolumesFromImageTest-605891512 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-207759b5-72ae-4e76-9179-defd74dd1058" returned: 0 in 0.507s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:14:58 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-767f7ea0-49ac-4d19-993d-f4553d73ea80 tempest-CreateVolumesFromImageTest-605891512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-207759b5-72ae-4e76-9179-defd74dd1058 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:14:59 devstack sudo[90647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-207759b5-72ae-4e76-9179-defd74dd1058 Apr 16 15:14:59 devstack sudo[90647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:14:59 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [None req-182c76ab-6f06-407c-b536-421b7cdc690d tempest-VolumeDependencyTests-1769369869 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82756) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 15:14:59 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-182c76ab-6f06-407c-b536-421b7cdc690d tempest-VolumeDependencyTests-1769369869 None] Flow 'volume_create_manager' (947d4739-3653-43ff-a494-b3af31674162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:14:59 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-182c76ab-6f06-407c-b536-421b7cdc690d tempest-VolumeDependencyTests-1769369869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (485b2f7f-2a0e-4fe3-b628-d74e4bb05df6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:14:59 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-182c76ab-6f06-407c-b536-421b7cdc690d tempest-VolumeDependencyTests-1769369869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (485b2f7f-2a0e-4fe3-b628-d74e4bb05df6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:14:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1410574401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ea7e4be-e8ab-4465-b41a-0938018d568c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2465b74888c74c608190b15eb478a3e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:14:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=88efe222-a7ad-4c91-84a8-762f2b4d9492,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:14:59Z,use_quota=True,user_id='bbe844468df24b8bb78f9c30c795001c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:14:59 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-182c76ab-6f06-407c-b536-421b7cdc690d tempest-VolumeDependencyTests-1769369869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46629b25-3a99-477b-abfb-aced3d1cc356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:14:59 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-182c76ab-6f06-407c-b536-421b7cdc690d tempest-VolumeDependencyTests-1769369869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46629b25-3a99-477b-abfb-aced3d1cc356) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:14:59 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-182c76ab-6f06-407c-b536-421b7cdc690d tempest-VolumeDependencyTests-1769369869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d938b125-374b-48ba-8136-dde3ff236060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:14:59 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-182c76ab-6f06-407c-b536-421b7cdc690d tempest-VolumeDependencyTests-1769369869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d938b125-374b-48ba-8136-dde3ff236060) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2ea7e4be-e8ab-4465-b41a-0938018d568c', 'volume_name': 'volume-2ea7e4be-e8ab-4465-b41a-0938018d568c', 'volume_size': 1, 'snapshot_id': '88efe222-a7ad-4c91-84a8-762f2b4d9492'}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:14:59 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-182c76ab-6f06-407c-b536-421b7cdc690d tempest-VolumeDependencyTests-1769369869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d0dac03-0de3-4a81-bcb6-3fb0be5dedf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:14:59 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-182c76ab-6f06-407c-b536-421b7cdc690d tempest-VolumeDependencyTests-1769369869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d0dac03-0de3-4a81-bcb6-3fb0be5dedf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:14:59 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-182c76ab-6f06-407c-b536-421b7cdc690d tempest-VolumeDependencyTests-1769369869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0720de24-ba31-4761-9a64-a8d089cc2cec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:14:59 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-182c76ab-6f06-407c-b536-421b7cdc690d tempest-VolumeDependencyTests-1769369869 None] Volume 2ea7e4be-e8ab-4465-b41a-0938018d568c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2ea7e4be-e8ab-4465-b41a-0938018d568c', 'volume_size': 1, 'snapshot_id': '88efe222-a7ad-4c91-84a8-762f2b4d9492'} Apr 16 15:14:59 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-182c76ab-6f06-407c-b536-421b7cdc690d tempest-VolumeDependencyTests-1769369869 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:14:59 devstack sudo[90642]: pam_unix(sudo:session): session closed for user root Apr 16 15:14:59 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-6a6a40f9-afd7-4607-b395-bc2e069afd3e tempest-CreateVolumesFromSnapshotTest-1272343304 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-5b18bcbf-e358-4b27-b079-bff25ab2ec17" returned: 0 in 0.643s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:14:59 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-6a6a40f9-afd7-4607-b395-bc2e069afd3e tempest-CreateVolumesFromSnapshotTest-1272343304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-5b18bcbf-e358-4b27-b079-bff25ab2ec17,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-5b18bcbf-e358-4b27-b079-bff25ab2ec17.ea81d119-9f42-4534-ba5f-7f94f7f8a737 1G {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:14:59 devstack sudo[90654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-5b18bcbf-e358-4b27-b079-bff25ab2ec17,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-5b18bcbf-e358-4b27-b079-bff25ab2ec17.ea81d119-9f42-4534-ba5f-7f94f7f8a737 1G Apr 16 15:14:59 devstack sudo[90654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:14:59 devstack sudo[90647]: pam_unix(sudo:session): session closed for user root Apr 16 15:14:59 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-767f7ea0-49ac-4d19-993d-f4553d73ea80 tempest-CreateVolumesFromImageTest-605891512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-207759b5-72ae-4e76-9179-defd74dd1058" returned: 0 in 0.579s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:14:59 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-767f7ea0-49ac-4d19-993d-f4553d73ea80 tempest-CreateVolumesFromImageTest-605891512 None] Lock "cinder-quobyte-207759b5-72ae-4e76-9179-defd74dd1058" released by "delete_volume" :: held 1.110s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:14:59 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-767f7ea0-49ac-4d19-993d-f4553d73ea80 tempest-CreateVolumesFromImageTest-605891512 None] Created reservations ['5b88b0e8-5f1a-412e-bd6a-91d5681d7eb3', '08ca3a90-f3ce-4ef7-92d0-9c07e3503695', '72cdd577-a8be-4218-98ac-288e0d0af6c3', '51dfc3c8-432e-4d2f-a52a-8e515f42fad5'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:14:59 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-767f7ea0-49ac-4d19-993d-f4553d73ea80 tempest-CreateVolumesFromImageTest-605891512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:14:59 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-767f7ea0-49ac-4d19-993d-f4553d73ea80 tempest-CreateVolumesFromImageTest-605891512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:14:59 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-767f7ea0-49ac-4d19-993d-f4553d73ea80 tempest-CreateVolumesFromImageTest-605891512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:14:59 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-767f7ea0-49ac-4d19-993d-f4553d73ea80 tempest-CreateVolumesFromImageTest-605891512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:14:59 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-767f7ea0-49ac-4d19-993d-f4553d73ea80 tempest-CreateVolumesFromImageTest-605891512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:14:59 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-767f7ea0-49ac-4d19-993d-f4553d73ea80 tempest-CreateVolumesFromImageTest-605891512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:14:59 devstack sudo[90657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:14:59 devstack sudo[90657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:14:59 devstack sudo[90654]: pam_unix(sudo:session): session closed for user root Apr 16 15:14:59 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-6a6a40f9-afd7-4607-b395-bc2e069afd3e tempest-CreateVolumesFromSnapshotTest-1272343304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-5b18bcbf-e358-4b27-b079-bff25ab2ec17,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-5b18bcbf-e358-4b27-b079-bff25ab2ec17.ea81d119-9f42-4534-ba5f-7f94f7f8a737 1G" returned: 0 in 0.549s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:14:59 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-6a6a40f9-afd7-4607-b395-bc2e069afd3e tempest-CreateVolumesFromSnapshotTest-1272343304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b18bcbf-e358-4b27-b079-bff25ab2ec17 -F qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-5b18bcbf-e358-4b27-b079-bff25ab2ec17.ea81d119-9f42-4534-ba5f-7f94f7f8a737 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:14:59 devstack sudo[90663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b18bcbf-e358-4b27-b079-bff25ab2ec17 -F qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-5b18bcbf-e358-4b27-b079-bff25ab2ec17.ea81d119-9f42-4534-ba5f-7f94f7f8a737 Apr 16 15:14:59 devstack sudo[90663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:00 devstack sudo[90657]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:00 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-767f7ea0-49ac-4d19-993d-f4553d73ea80 tempest-CreateVolumesFromImageTest-605891512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.477s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:00 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-767f7ea0-49ac-4d19-993d-f4553d73ea80 tempest-CreateVolumesFromImageTest-605891512 None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:15:00 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-767f7ea0-49ac-4d19-993d-f4553d73ea80 tempest-CreateVolumesFromImageTest-605891512 None] Deleted volume successfully. Apr 16 15:15:00 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-767f7ea0-49ac-4d19-993d-f4553d73ea80 tempest-CreateVolumesFromImageTest-605891512 None] Lock "cinder-207759b5-72ae-4e76-9179-defd74dd1058-delete_volume" released by "delete_volume" :: held 1.769s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:15:00 devstack sudo[90663]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:00 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-6a6a40f9-afd7-4607-b395-bc2e069afd3e tempest-CreateVolumesFromSnapshotTest-1272343304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b18bcbf-e358-4b27-b079-bff25ab2ec17 -F qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-5b18bcbf-e358-4b27-b079-bff25ab2ec17.ea81d119-9f42-4534-ba5f-7f94f7f8a737" returned: 0 in 0.483s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:00 devstack cinder-volume[82756]: WARNING cinder.volume.drivers.remotefs [None req-6a6a40f9-afd7-4607-b395-bc2e069afd3e tempest-CreateVolumesFromSnapshotTest-1272343304 None] /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-5b18bcbf-e358-4b27-b079-bff25ab2ec17.ea81d119-9f42-4534-ba5f-7f94f7f8a737 is being set with open permissions: ugo+rw Apr 16 15:15:00 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-6a6a40f9-afd7-4607-b395-bc2e069afd3e tempest-CreateVolumesFromSnapshotTest-1272343304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-5b18bcbf-e358-4b27-b079-bff25ab2ec17.ea81d119-9f42-4534-ba5f-7f94f7f8a737 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:00 devstack sudo[90669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-5b18bcbf-e358-4b27-b079-bff25ab2ec17.ea81d119-9f42-4534-ba5f-7f94f7f8a737 Apr 16 15:15:00 devstack sudo[90669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:00 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-700d6e04-9554-44c5-94bb-e30f1c5fb630 tempest-CreateVolumesFromImageTest-605891512 None] Acquiring lock "cinder-6038cd6f-d6c3-4b44-8ae8-356cb60be78f-delete_volume" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:15:00 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-700d6e04-9554-44c5-94bb-e30f1c5fb630 tempest-CreateVolumesFromImageTest-605891512 None] Lock "cinder-6038cd6f-d6c3-4b44-8ae8-356cb60be78f-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:15:00 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-700d6e04-9554-44c5-94bb-e30f1c5fb630 tempest-CreateVolumesFromImageTest-605891512 None] Acquiring lock "cinder-quobyte-6038cd6f-d6c3-4b44-8ae8-356cb60be78f" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:15:00 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-700d6e04-9554-44c5-94bb-e30f1c5fb630 tempest-CreateVolumesFromImageTest-605891512 None] Lock "cinder-quobyte-6038cd6f-d6c3-4b44-8ae8-356cb60be78f" acquired by "delete_volume" :: waited 0.010s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:15:00 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c9ad12c-3184-4b27-8210-082d816c7889]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:15:00 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-700d6e04-9554-44c5-94bb-e30f1c5fb630 tempest-CreateVolumesFromImageTest-605891512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6038cd6f-d6c3-4b44-8ae8-356cb60be78f {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:00 devstack sudo[90671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6038cd6f-d6c3-4b44-8ae8-356cb60be78f Apr 16 15:15:00 devstack sudo[90671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:00 devstack sudo[90669]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:00 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-6a6a40f9-afd7-4607-b395-bc2e069afd3e tempest-CreateVolumesFromSnapshotTest-1272343304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-5b18bcbf-e358-4b27-b079-bff25ab2ec17.ea81d119-9f42-4534-ba5f-7f94f7f8a737" returned: 0 in 0.551s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:01 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-6a6a40f9-afd7-4607-b395-bc2e069afd3e tempest-CreateVolumesFromSnapshotTest-1272343304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-5b18bcbf-e358-4b27-b079-bff25ab2ec17.info {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:01 devstack sudo[90674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-5b18bcbf-e358-4b27-b079-bff25ab2ec17.info Apr 16 15:15:01 devstack sudo[90674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:01 devstack sudo[90671]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:01 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-700d6e04-9554-44c5-94bb-e30f1c5fb630 tempest-CreateVolumesFromImageTest-605891512 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6038cd6f-d6c3-4b44-8ae8-356cb60be78f" returned: 0 in 0.675s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:01 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-700d6e04-9554-44c5-94bb-e30f1c5fb630 tempest-CreateVolumesFromImageTest-605891512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6038cd6f-d6c3-4b44-8ae8-356cb60be78f {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:01 devstack sudo[90679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6038cd6f-d6c3-4b44-8ae8-356cb60be78f Apr 16 15:15:01 devstack sudo[90679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:01 devstack sudo[90674]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:01 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-6a6a40f9-afd7-4607-b395-bc2e069afd3e tempest-CreateVolumesFromSnapshotTest-1272343304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-5b18bcbf-e358-4b27-b079-bff25ab2ec17.info" returned: 0 in 0.453s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:01 devstack cinder-volume[82756]: WARNING cinder.volume.drivers.remotefs [None req-6a6a40f9-afd7-4607-b395-bc2e069afd3e tempest-CreateVolumesFromSnapshotTest-1272343304 None] /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-5b18bcbf-e358-4b27-b079-bff25ab2ec17.info is being set with open permissions: ugo+rw Apr 16 15:15:01 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-6a6a40f9-afd7-4607-b395-bc2e069afd3e tempest-CreateVolumesFromSnapshotTest-1272343304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-5b18bcbf-e358-4b27-b079-bff25ab2ec17.info {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:01 devstack sudo[90682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-5b18bcbf-e358-4b27-b079-bff25ab2ec17.info Apr 16 15:15:01 devstack sudo[90682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:01 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [None req-078501b7-c4fa-42da-b0fa-589a0e1168a0 tempest-SnapshotDependencyTests-858447260 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82756) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 15:15:01 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-078501b7-c4fa-42da-b0fa-589a0e1168a0 tempest-SnapshotDependencyTests-858447260 None] Flow 'volume_create_manager' (a338283d-5eb0-4eaf-bb40-fc81548b3b97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:15:01 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-078501b7-c4fa-42da-b0fa-589a0e1168a0 tempest-SnapshotDependencyTests-858447260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b1bd4a7-7b1e-4ef3-af8d-9db79ea51429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:15:01 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-078501b7-c4fa-42da-b0fa-589a0e1168a0 tempest-SnapshotDependencyTests-858447260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b1bd4a7-7b1e-4ef3-af8d-9db79ea51429) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:15:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1506837381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=386dcbae-cb25-4737-8aeb-cfee8921c168,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcf35c7972cc455a89f699dcbe307a69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:15:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:15:02Z,use_quota=True,user_id='3a728be3f00f44b889ff7ea60d57ae06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:15:01 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-078501b7-c4fa-42da-b0fa-589a0e1168a0 tempest-SnapshotDependencyTests-858447260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (660f9c66-b366-472c-928b-aa87468a13d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:15:01 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-078501b7-c4fa-42da-b0fa-589a0e1168a0 tempest-SnapshotDependencyTests-858447260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (660f9c66-b366-472c-928b-aa87468a13d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:15:01 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-078501b7-c4fa-42da-b0fa-589a0e1168a0 tempest-SnapshotDependencyTests-858447260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d3a08ef-4101-4573-8c66-260998362d2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:15:01 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-078501b7-c4fa-42da-b0fa-589a0e1168a0 tempest-SnapshotDependencyTests-858447260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d3a08ef-4101-4573-8c66-260998362d2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '386dcbae-cb25-4737-8aeb-cfee8921c168', 'volume_name': 'volume-386dcbae-cb25-4737-8aeb-cfee8921c168', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:15:01 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-078501b7-c4fa-42da-b0fa-589a0e1168a0 tempest-SnapshotDependencyTests-858447260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70ee1984-16b0-428f-afd8-a8f13a08f81b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:15:01 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-078501b7-c4fa-42da-b0fa-589a0e1168a0 tempest-SnapshotDependencyTests-858447260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70ee1984-16b0-428f-afd8-a8f13a08f81b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:15:01 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-078501b7-c4fa-42da-b0fa-589a0e1168a0 tempest-SnapshotDependencyTests-858447260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3f50ecc-fb7e-4c52-a453-6de708370c1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:15:01 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-078501b7-c4fa-42da-b0fa-589a0e1168a0 tempest-SnapshotDependencyTests-858447260 None] Volume 386dcbae-cb25-4737-8aeb-cfee8921c168: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-386dcbae-cb25-4737-8aeb-cfee8921c168', 'volume_size': 1} Apr 16 15:15:01 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-078501b7-c4fa-42da-b0fa-589a0e1168a0 tempest-SnapshotDependencyTests-858447260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:15:01 devstack sudo[90679]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:01 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-700d6e04-9554-44c5-94bb-e30f1c5fb630 tempest-CreateVolumesFromImageTest-605891512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6038cd6f-d6c3-4b44-8ae8-356cb60be78f" returned: 0 in 0.444s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:01 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-700d6e04-9554-44c5-94bb-e30f1c5fb630 tempest-CreateVolumesFromImageTest-605891512 None] Lock "cinder-quobyte-6038cd6f-d6c3-4b44-8ae8-356cb60be78f" released by "delete_volume" :: held 1.149s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:15:01 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-700d6e04-9554-44c5-94bb-e30f1c5fb630 tempest-CreateVolumesFromImageTest-605891512 None] Created reservations ['55bc9ce5-6a4f-4a50-9d06-95b9b01fbbb4', 'd60c581c-34a1-4eb1-be9d-e02e1a0ba976', 'bbc124cc-ba23-4c9b-a2d1-1948c1b5c34d', '7311cd4e-b72c-4e87-ae6e-e22bcf5494f9'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:15:01 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-700d6e04-9554-44c5-94bb-e30f1c5fb630 tempest-CreateVolumesFromImageTest-605891512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:15:01 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-700d6e04-9554-44c5-94bb-e30f1c5fb630 tempest-CreateVolumesFromImageTest-605891512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:15:01 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-700d6e04-9554-44c5-94bb-e30f1c5fb630 tempest-CreateVolumesFromImageTest-605891512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:15:01 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-700d6e04-9554-44c5-94bb-e30f1c5fb630 tempest-CreateVolumesFromImageTest-605891512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:15:01 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-700d6e04-9554-44c5-94bb-e30f1c5fb630 tempest-CreateVolumesFromImageTest-605891512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:15:01 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-700d6e04-9554-44c5-94bb-e30f1c5fb630 tempest-CreateVolumesFromImageTest-605891512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:01 devstack sudo[90692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:15:01 devstack sudo[90692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:01 devstack sudo[90682]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:01 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-6a6a40f9-afd7-4607-b395-bc2e069afd3e tempest-CreateVolumesFromSnapshotTest-1272343304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-5b18bcbf-e358-4b27-b079-bff25ab2ec17.info" returned: 0 in 0.464s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:01 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-6a6a40f9-afd7-4607-b395-bc2e069afd3e tempest-CreateVolumesFromSnapshotTest-1272343304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.223s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:15:01 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-182c76ab-6f06-407c-b536-421b7cdc690d tempest-VolumeDependencyTests-1769369869 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.669s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:15:01 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-182c76ab-6f06-407c-b536-421b7cdc690d tempest-VolumeDependencyTests-1769369869 None] Acquiring lock "cinder-quobyte-88efe222-a7ad-4c91-84a8-762f2b4d9492-2ea7e4be-e8ab-4465-b41a-0938018d568c" by "_create_volume_from_snapshot" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:15:01 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-182c76ab-6f06-407c-b536-421b7cdc690d tempest-VolumeDependencyTests-1769369869 None] Lock "cinder-quobyte-88efe222-a7ad-4c91-84a8-762f2b4d9492-2ea7e4be-e8ab-4465-b41a-0938018d568c" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:15:01 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-182c76ab-6f06-407c-b536-421b7cdc690d tempest-VolumeDependencyTests-1769369869 None] Creating volume 2ea7e4be-e8ab-4465-b41a-0938018d568c from snapshot 88efe222-a7ad-4c91-84a8-762f2b4d9492 {{(pid=82756) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 16 15:15:01 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-182c76ab-6f06-407c-b536-421b7cdc690d tempest-VolumeDependencyTests-1769369869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:15:01 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-182c76ab-6f06-407c-b536-421b7cdc690d tempest-VolumeDependencyTests-1769369869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:15:01 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-182c76ab-6f06-407c-b536-421b7cdc690d tempest-VolumeDependencyTests-1769369869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:15:01 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-182c76ab-6f06-407c-b536-421b7cdc690d tempest-VolumeDependencyTests-1769369869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:15:01 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-182c76ab-6f06-407c-b536-421b7cdc690d tempest-VolumeDependencyTests-1769369869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:15:01 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-182c76ab-6f06-407c-b536-421b7cdc690d tempest-VolumeDependencyTests-1769369869 None] Selected osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 as target Quobyte volume. {{(pid=82756) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 15:15:01 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-182c76ab-6f06-407c-b536-421b7cdc690d tempest-VolumeDependencyTests-1769369869 None] Acquiring lock "cinder-quobyte-2ea7e4be-e8ab-4465-b41a-0938018d568c" by "_copy_volume_from_snapshot" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:15:01 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-6a6a40f9-afd7-4607-b395-bc2e069afd3e tempest-CreateVolumesFromSnapshotTest-1272343304 None] Create snapshot completed successfully Apr 16 15:15:02 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-182c76ab-6f06-407c-b536-421b7cdc690d tempest-VolumeDependencyTests-1769369869 None] Lock "cinder-quobyte-2ea7e4be-e8ab-4465-b41a-0938018d568c" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:15:02 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-182c76ab-6f06-407c-b536-421b7cdc690d tempest-VolumeDependencyTests-1769369869 None] snapshot: 88efe222-a7ad-4c91-84a8-762f2b4d9492, volume: 2ea7e4be-e8ab-4465-b41a-0938018d568c, {{(pid=82756) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 16 15:15:02 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-182c76ab-6f06-407c-b536-421b7cdc690d tempest-VolumeDependencyTests-1769369869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:15:02 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-182c76ab-6f06-407c-b536-421b7cdc690d tempest-VolumeDependencyTests-1769369869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:15:02 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-182c76ab-6f06-407c-b536-421b7cdc690d tempest-VolumeDependencyTests-1769369869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:15:02 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-182c76ab-6f06-407c-b536-421b7cdc690d tempest-VolumeDependencyTests-1769369869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:15:02 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-182c76ab-6f06-407c-b536-421b7cdc690d tempest-VolumeDependencyTests-1769369869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:15:02 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[85a822d7-1ab7-4115-87db-5f90493d0e86]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:15:02 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-182c76ab-6f06-407c-b536-421b7cdc690d tempest-VolumeDependencyTests-1769369869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-35d57e9c-82cf-4ca4-a6c7-4a0773ac88e4.88efe222-a7ad-4c91-84a8-762f2b4d9492 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:02 devstack sudo[90694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-35d57e9c-82cf-4ca4-a6c7-4a0773ac88e4.88efe222-a7ad-4c91-84a8-762f2b4d9492 Apr 16 15:15:02 devstack sudo[90694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:02 devstack sudo[90692]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:02 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-700d6e04-9554-44c5-94bb-e30f1c5fb630 tempest-CreateVolumesFromImageTest-605891512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.455s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:02 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-700d6e04-9554-44c5-94bb-e30f1c5fb630 tempest-CreateVolumesFromImageTest-605891512 None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:15:02 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-700d6e04-9554-44c5-94bb-e30f1c5fb630 tempest-CreateVolumesFromImageTest-605891512 None] Deleted volume successfully. Apr 16 15:15:02 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-700d6e04-9554-44c5-94bb-e30f1c5fb630 tempest-CreateVolumesFromImageTest-605891512 None] Lock "cinder-6038cd6f-d6c3-4b44-8ae8-356cb60be78f-delete_volume" released by "delete_volume" :: held 1.750s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:15:02 devstack sudo[90694]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:02 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-182c76ab-6f06-407c-b536-421b7cdc690d tempest-VolumeDependencyTests-1769369869 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-35d57e9c-82cf-4ca4-a6c7-4a0773ac88e4.88efe222-a7ad-4c91-84a8-762f2b4d9492" returned: 0 in 0.487s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:02 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-182c76ab-6f06-407c-b536-421b7cdc690d tempest-VolumeDependencyTests-1769369869 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-35d57e9c-82cf-4ca4-a6c7-4a0773ac88e4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82756) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 15:15:02 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-182c76ab-6f06-407c-b536-421b7cdc690d tempest-VolumeDependencyTests-1769369869 None] will copy from snapshot at /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-35d57e9c-82cf-4ca4-a6c7-4a0773ac88e4 {{(pid=82756) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 16 15:15:02 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-182c76ab-6f06-407c-b536-421b7cdc690d tempest-VolumeDependencyTests-1769369869 None] Creating direct copy from snapshot {{(pid=82756) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 16 15:15:02 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[12b1dacd-aa95-415b-bc96-d32f846611bd]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:15:02 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-182c76ab-6f06-407c-b536-421b7cdc690d tempest-VolumeDependencyTests-1769369869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-35d57e9c-82cf-4ca4-a6c7-4a0773ac88e4 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:02 devstack sudo[90734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-35d57e9c-82cf-4ca4-a6c7-4a0773ac88e4 Apr 16 15:15:02 devstack sudo[90734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:02 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-f28bbad7-2530-42c0-8603-37d173e3b607 tempest-CreateVolumesFromImageTest-605891512 None] Acquiring lock "cinder-5ac4e079-556f-4842-9bd0-a9e34bad6d7a-delete_volume" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:15:02 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-f28bbad7-2530-42c0-8603-37d173e3b607 tempest-CreateVolumesFromImageTest-605891512 None] Lock "cinder-5ac4e079-556f-4842-9bd0-a9e34bad6d7a-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:15:02 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-f28bbad7-2530-42c0-8603-37d173e3b607 tempest-CreateVolumesFromImageTest-605891512 None] Acquiring lock "cinder-quobyte-5ac4e079-556f-4842-9bd0-a9e34bad6d7a" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:15:02 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-f28bbad7-2530-42c0-8603-37d173e3b607 tempest-CreateVolumesFromImageTest-605891512 None] Lock "cinder-quobyte-5ac4e079-556f-4842-9bd0-a9e34bad6d7a" acquired by "delete_volume" :: waited 0.008s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:15:02 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[55114caf-8c72-40d2-ad09-09f4c8ec3173]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:15:02 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-f28bbad7-2530-42c0-8603-37d173e3b607 tempest-CreateVolumesFromImageTest-605891512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-5ac4e079-556f-4842-9bd0-a9e34bad6d7a {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:02 devstack sudo[90736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-5ac4e079-556f-4842-9bd0-a9e34bad6d7a Apr 16 15:15:02 devstack sudo[90736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:03 devstack sudo[90734]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:03 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-182c76ab-6f06-407c-b536-421b7cdc690d tempest-VolumeDependencyTests-1769369869 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-35d57e9c-82cf-4ca4-a6c7-4a0773ac88e4" returned: 0 in 0.557s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:03 devstack cinder-volume[82756]: DEBUG cinder.utils [None req-182c76ab-6f06-407c-b536-421b7cdc690d tempest-VolumeDependencyTests-1769369869 None] Path /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2ea7e4be-e8ab-4465-b41a-0938018d568c not found in is_blk_device check {{(pid=82756) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 16 15:15:03 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-182c76ab-6f06-407c-b536-421b7cdc690d tempest-VolumeDependencyTests-1769369869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-35d57e9c-82cf-4ca4-a6c7-4a0773ac88e4 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2ea7e4be-e8ab-4465-b41a-0938018d568c {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:03 devstack sudo[90741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-35d57e9c-82cf-4ca4-a6c7-4a0773ac88e4 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2ea7e4be-e8ab-4465-b41a-0938018d568c Apr 16 15:15:03 devstack sudo[90741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:03 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf7e0fe9-717e-49ae-a1d7-7b2753a59672 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82756) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 15:15:03 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-bf7e0fe9-717e-49ae-a1d7-7b2753a59672 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Flow 'volume_create_manager' (1e196030-c942-42f1-846f-c38801978b85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:15:03 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-bf7e0fe9-717e-49ae-a1d7-7b2753a59672 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64bb9785-daa3-495c-b2f8-c006c6ea74d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:15:03 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-bf7e0fe9-717e-49ae-a1d7-7b2753a59672 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64bb9785-daa3-495c-b2f8-c006c6ea74d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:15:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-300888699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3403603b-a9fb-493b-a948-e8578fe3494a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67db5101aca74e2493d47e4bf32c1892',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:15:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:15:03Z,use_quota=True,user_id='461fefe546444a57bda769f210b6858e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:15:03 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-bf7e0fe9-717e-49ae-a1d7-7b2753a59672 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd53e5c1-3a4c-47a9-b608-b815996fa1f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:15:03 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-bf7e0fe9-717e-49ae-a1d7-7b2753a59672 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd53e5c1-3a4c-47a9-b608-b815996fa1f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:15:03 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-bf7e0fe9-717e-49ae-a1d7-7b2753a59672 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5769f7dd-0090-420f-b2c1-6b2934d5c764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:15:03 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-bf7e0fe9-717e-49ae-a1d7-7b2753a59672 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5769f7dd-0090-420f-b2c1-6b2934d5c764) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3403603b-a9fb-493b-a948-e8578fe3494a', 'volume_name': 'volume-3403603b-a9fb-493b-a948-e8578fe3494a', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:15:03 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-bf7e0fe9-717e-49ae-a1d7-7b2753a59672 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e44153f9-917e-4179-88a9-c31a33e689a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:15:03 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-bf7e0fe9-717e-49ae-a1d7-7b2753a59672 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e44153f9-917e-4179-88a9-c31a33e689a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:15:03 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-bf7e0fe9-717e-49ae-a1d7-7b2753a59672 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caffeb86-d805-4472-9670-e3e5f8793518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:15:03 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-bf7e0fe9-717e-49ae-a1d7-7b2753a59672 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Volume 3403603b-a9fb-493b-a948-e8578fe3494a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3403603b-a9fb-493b-a948-e8578fe3494a', 'volume_size': 1} Apr 16 15:15:03 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-bf7e0fe9-717e-49ae-a1d7-7b2753a59672 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:15:03 devstack sudo[90736]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:03 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-f28bbad7-2530-42c0-8603-37d173e3b607 tempest-CreateVolumesFromImageTest-605891512 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-5ac4e079-556f-4842-9bd0-a9e34bad6d7a" returned: 0 in 0.572s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:03 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-f28bbad7-2530-42c0-8603-37d173e3b607 tempest-CreateVolumesFromImageTest-605891512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-5ac4e079-556f-4842-9bd0-a9e34bad6d7a {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:03 devstack sudo[90746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-5ac4e079-556f-4842-9bd0-a9e34bad6d7a Apr 16 15:15:03 devstack sudo[90746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:03 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab42f25f-f487-4f63-9822-1b91c2d8ff75 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82756) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 15:15:03 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-ab42f25f-f487-4f63-9822-1b91c2d8ff75 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Flow 'volume_create_manager' (b5f3c307-0a11-44df-8106-5cec7e32a9c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:15:03 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-ab42f25f-f487-4f63-9822-1b91c2d8ff75 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcc46302-9bb8-4692-81b9-981010faba5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:15:03 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-ab42f25f-f487-4f63-9822-1b91c2d8ff75 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcc46302-9bb8-4692-81b9-981010faba5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:15:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-654162086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a60e6b7d-5be5-4814-ab98-6e21c1c522b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67db5101aca74e2493d47e4bf32c1892',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:15:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:15:04Z,use_quota=True,user_id='461fefe546444a57bda769f210b6858e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:15:03 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-ab42f25f-f487-4f63-9822-1b91c2d8ff75 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (627ab149-78d1-4996-bd35-da285c1af749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:15:03 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-ab42f25f-f487-4f63-9822-1b91c2d8ff75 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (627ab149-78d1-4996-bd35-da285c1af749) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:15:03 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-ab42f25f-f487-4f63-9822-1b91c2d8ff75 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f0da4d5-0bf6-40da-aead-6be5aeba8d7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:15:03 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-ab42f25f-f487-4f63-9822-1b91c2d8ff75 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f0da4d5-0bf6-40da-aead-6be5aeba8d7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a60e6b7d-5be5-4814-ab98-6e21c1c522b4', 'volume_name': 'volume-a60e6b7d-5be5-4814-ab98-6e21c1c522b4', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:15:03 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-ab42f25f-f487-4f63-9822-1b91c2d8ff75 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3c376f6-23b9-492b-8c11-2dbd3564479e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:15:03 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-ab42f25f-f487-4f63-9822-1b91c2d8ff75 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3c376f6-23b9-492b-8c11-2dbd3564479e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:15:03 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-ab42f25f-f487-4f63-9822-1b91c2d8ff75 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8fd9b49-e1ac-4dfa-80e1-658b57cae958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:15:03 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-ab42f25f-f487-4f63-9822-1b91c2d8ff75 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Volume a60e6b7d-5be5-4814-ab98-6e21c1c522b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a60e6b7d-5be5-4814-ab98-6e21c1c522b4', 'volume_size': 1} Apr 16 15:15:03 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-ab42f25f-f487-4f63-9822-1b91c2d8ff75 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:15:04 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebf627fa-6766-4db3-a596-452dfb411682 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82756) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 15:15:04 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-ebf627fa-6766-4db3-a596-452dfb411682 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Flow 'volume_create_manager' (0294bf8d-f401-41d1-8647-50ccddfb2635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:15:04 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-ebf627fa-6766-4db3-a596-452dfb411682 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3c87aa9-5d2d-44e3-b399-0fd04a7d17ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:15:04 devstack sudo[90746]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:04 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-ebf627fa-6766-4db3-a596-452dfb411682 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3c87aa9-5d2d-44e3-b399-0fd04a7d17ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:15:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1638922012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80d004c0-6ecb-456b-a55d-e1d8652015b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67db5101aca74e2493d47e4bf32c1892',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:15:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:15:04Z,use_quota=True,user_id='461fefe546444a57bda769f210b6858e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:15:04 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-ebf627fa-6766-4db3-a596-452dfb411682 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01562c72-6a13-4f39-b145-41d71a65275d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:15:04 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-ebf627fa-6766-4db3-a596-452dfb411682 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01562c72-6a13-4f39-b145-41d71a65275d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:15:04 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-ebf627fa-6766-4db3-a596-452dfb411682 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53268e7b-5fde-4fb0-9544-aad5efec0a3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:15:04 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-ebf627fa-6766-4db3-a596-452dfb411682 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53268e7b-5fde-4fb0-9544-aad5efec0a3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80d004c0-6ecb-456b-a55d-e1d8652015b7', 'volume_name': 'volume-80d004c0-6ecb-456b-a55d-e1d8652015b7', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:15:04 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-ebf627fa-6766-4db3-a596-452dfb411682 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e13d01e5-e459-4db2-95a4-4164e439b0ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:15:04 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-ebf627fa-6766-4db3-a596-452dfb411682 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e13d01e5-e459-4db2-95a4-4164e439b0ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:15:04 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-ebf627fa-6766-4db3-a596-452dfb411682 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c281cd8-0a00-4593-857f-1ba14a0eeb5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:15:04 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-ebf627fa-6766-4db3-a596-452dfb411682 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Volume 80d004c0-6ecb-456b-a55d-e1d8652015b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80d004c0-6ecb-456b-a55d-e1d8652015b7', 'volume_size': 1} Apr 16 15:15:04 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-ebf627fa-6766-4db3-a596-452dfb411682 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:15:04 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-f28bbad7-2530-42c0-8603-37d173e3b607 tempest-CreateVolumesFromImageTest-605891512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-5ac4e079-556f-4842-9bd0-a9e34bad6d7a" returned: 0 in 1.416s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:04 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-f28bbad7-2530-42c0-8603-37d173e3b607 tempest-CreateVolumesFromImageTest-605891512 None] Lock "cinder-quobyte-5ac4e079-556f-4842-9bd0-a9e34bad6d7a" released by "delete_volume" :: held 2.108s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:15:04 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ac33d15-9a98-49d5-89b1-35548a03a0b8 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82756) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 15:15:04 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-7ac33d15-9a98-49d5-89b1-35548a03a0b8 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Flow 'volume_create_manager' (be46b58e-0ee9-485c-881d-b794c079e316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:15:04 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-7ac33d15-9a98-49d5-89b1-35548a03a0b8 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ea3d361-f737-42fe-a23b-b2346e21aba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:15:05 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-7ac33d15-9a98-49d5-89b1-35548a03a0b8 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ea3d361-f737-42fe-a23b-b2346e21aba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:15:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-210275396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c91094bc-4d90-46ea-b2d9-7a2db6900acb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67db5101aca74e2493d47e4bf32c1892',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:15:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:15:05Z,use_quota=True,user_id='461fefe546444a57bda769f210b6858e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:15:05 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-7ac33d15-9a98-49d5-89b1-35548a03a0b8 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9cc9910-95b8-4bca-a02d-1ca37f39d3af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:15:05 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-7ac33d15-9a98-49d5-89b1-35548a03a0b8 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9cc9910-95b8-4bca-a02d-1ca37f39d3af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:15:05 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-7ac33d15-9a98-49d5-89b1-35548a03a0b8 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (134458e6-bec1-4136-8d1c-d203356328fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:15:05 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-7ac33d15-9a98-49d5-89b1-35548a03a0b8 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (134458e6-bec1-4136-8d1c-d203356328fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c91094bc-4d90-46ea-b2d9-7a2db6900acb', 'volume_name': 'volume-c91094bc-4d90-46ea-b2d9-7a2db6900acb', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:15:05 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-7ac33d15-9a98-49d5-89b1-35548a03a0b8 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d99e59b-46ed-401e-9431-a261b683353e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:15:05 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-7ac33d15-9a98-49d5-89b1-35548a03a0b8 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d99e59b-46ed-401e-9431-a261b683353e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:15:05 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-7ac33d15-9a98-49d5-89b1-35548a03a0b8 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (438e418b-3fcf-405d-8a18-35d083907336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:15:05 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-7ac33d15-9a98-49d5-89b1-35548a03a0b8 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Volume c91094bc-4d90-46ea-b2d9-7a2db6900acb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c91094bc-4d90-46ea-b2d9-7a2db6900acb', 'volume_size': 1} Apr 16 15:15:05 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-7ac33d15-9a98-49d5-89b1-35548a03a0b8 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:15:05 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [None req-99fd8814-776f-444e-9fa6-d9249451914c tempest-CreateVolumesFromSnapshotTest-1272343304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82756) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 15:15:05 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-99fd8814-776f-444e-9fa6-d9249451914c tempest-CreateVolumesFromSnapshotTest-1272343304 None] Flow 'volume_create_manager' (3f3ed89b-a986-4936-b694-55dca5fec623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:15:05 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-99fd8814-776f-444e-9fa6-d9249451914c tempest-CreateVolumesFromSnapshotTest-1272343304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcbf04c8-7f2f-42e8-b259-1e9cd540289c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:15:05 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-99fd8814-776f-444e-9fa6-d9249451914c tempest-CreateVolumesFromSnapshotTest-1272343304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcbf04c8-7f2f-42e8-b259-1e9cd540289c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:15:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-699713536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47c5ac9a-5ca4-488f-b084-67a2b8508edf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67db5101aca74e2493d47e4bf32c1892',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:15:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:15:05Z,use_quota=True,user_id='461fefe546444a57bda769f210b6858e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:15:05 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-99fd8814-776f-444e-9fa6-d9249451914c tempest-CreateVolumesFromSnapshotTest-1272343304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06b4c7f7-4e4f-4699-ab71-2e0bc6175bd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:15:05 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-99fd8814-776f-444e-9fa6-d9249451914c tempest-CreateVolumesFromSnapshotTest-1272343304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06b4c7f7-4e4f-4699-ab71-2e0bc6175bd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:15:05 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-99fd8814-776f-444e-9fa6-d9249451914c tempest-CreateVolumesFromSnapshotTest-1272343304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f242241-27a6-4a1c-9f35-46804c1093d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:15:05 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-99fd8814-776f-444e-9fa6-d9249451914c tempest-CreateVolumesFromSnapshotTest-1272343304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f242241-27a6-4a1c-9f35-46804c1093d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47c5ac9a-5ca4-488f-b084-67a2b8508edf', 'volume_name': 'volume-47c5ac9a-5ca4-488f-b084-67a2b8508edf', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:15:05 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-99fd8814-776f-444e-9fa6-d9249451914c tempest-CreateVolumesFromSnapshotTest-1272343304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6d63b96-772c-45ec-938b-66ebf7f25161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:15:05 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-99fd8814-776f-444e-9fa6-d9249451914c tempest-CreateVolumesFromSnapshotTest-1272343304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6d63b96-772c-45ec-938b-66ebf7f25161) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:15:05 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-99fd8814-776f-444e-9fa6-d9249451914c tempest-CreateVolumesFromSnapshotTest-1272343304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecc9037c-99cf-4193-bde4-f4cfb2af6d61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:15:05 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-99fd8814-776f-444e-9fa6-d9249451914c tempest-CreateVolumesFromSnapshotTest-1272343304 None] Volume 47c5ac9a-5ca4-488f-b084-67a2b8508edf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47c5ac9a-5ca4-488f-b084-67a2b8508edf', 'volume_size': 1} Apr 16 15:15:05 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-99fd8814-776f-444e-9fa6-d9249451914c tempest-CreateVolumesFromSnapshotTest-1272343304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:15:05 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-f28bbad7-2530-42c0-8603-37d173e3b607 tempest-CreateVolumesFromImageTest-605891512 None] Created reservations ['07fc9f1f-7377-4aa7-a79f-fb6e24425807', 'c373170e-9d24-427c-85df-4895e4c3f4f1', '2dc48f07-daa9-49ed-b70f-74b6b7d36404', '57308079-0e4f-4222-865e-e999f7c8e9e6'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:15:05 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-f28bbad7-2530-42c0-8603-37d173e3b607 tempest-CreateVolumesFromImageTest-605891512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:15:05 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-f28bbad7-2530-42c0-8603-37d173e3b607 tempest-CreateVolumesFromImageTest-605891512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:15:05 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-f28bbad7-2530-42c0-8603-37d173e3b607 tempest-CreateVolumesFromImageTest-605891512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:15:05 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-f28bbad7-2530-42c0-8603-37d173e3b607 tempest-CreateVolumesFromImageTest-605891512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:15:05 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-f28bbad7-2530-42c0-8603-37d173e3b607 tempest-CreateVolumesFromImageTest-605891512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:15:05 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-f28bbad7-2530-42c0-8603-37d173e3b607 tempest-CreateVolumesFromImageTest-605891512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:05 devstack sudo[90760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:15:05 devstack sudo[90760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:05 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-874d2640-d4c3-482c-a6be-9670a9fcb94f tempest-CreateVolumesFromImageTest-605891512 None] Acquiring lock "cinder-93065a0d-4557-47d0-b061-53fc09cbe63f-delete_volume" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:15:05 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-874d2640-d4c3-482c-a6be-9670a9fcb94f tempest-CreateVolumesFromImageTest-605891512 None] Lock "cinder-93065a0d-4557-47d0-b061-53fc09cbe63f-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:15:05 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-874d2640-d4c3-482c-a6be-9670a9fcb94f tempest-CreateVolumesFromImageTest-605891512 None] Acquiring lock "cinder-quobyte-93065a0d-4557-47d0-b061-53fc09cbe63f" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:15:05 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-874d2640-d4c3-482c-a6be-9670a9fcb94f tempest-CreateVolumesFromImageTest-605891512 None] Lock "cinder-quobyte-93065a0d-4557-47d0-b061-53fc09cbe63f" acquired by "delete_volume" :: waited 0.021s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:15:05 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ae00c69-be53-4058-a4cb-f7723f356aba]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:15:05 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-874d2640-d4c3-482c-a6be-9670a9fcb94f tempest-CreateVolumesFromImageTest-605891512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-93065a0d-4557-47d0-b061-53fc09cbe63f {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:05 devstack sudo[90762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-93065a0d-4557-47d0-b061-53fc09cbe63f Apr 16 15:15:05 devstack sudo[90762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:05 devstack sudo[90741]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:05 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-182c76ab-6f06-407c-b536-421b7cdc690d tempest-VolumeDependencyTests-1769369869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-35d57e9c-82cf-4ca4-a6c7-4a0773ac88e4 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2ea7e4be-e8ab-4465-b41a-0938018d568c" returned: 0 in 2.751s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:05 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[17e9c46d-177f-4de9-8afa-553f679f62f9]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:15:05 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-182c76ab-6f06-407c-b536-421b7cdc690d tempest-VolumeDependencyTests-1769369869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-35d57e9c-82cf-4ca4-a6c7-4a0773ac88e4 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:05 devstack sudo[90764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-35d57e9c-82cf-4ca4-a6c7-4a0773ac88e4 Apr 16 15:15:05 devstack sudo[90764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:06 devstack sudo[90760]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:06 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-f28bbad7-2530-42c0-8603-37d173e3b607 tempest-CreateVolumesFromImageTest-605891512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.876s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:06 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-f28bbad7-2530-42c0-8603-37d173e3b607 tempest-CreateVolumesFromImageTest-605891512 None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:15:06 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-f28bbad7-2530-42c0-8603-37d173e3b607 tempest-CreateVolumesFromImageTest-605891512 None] Deleted volume successfully. Apr 16 15:15:06 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-f28bbad7-2530-42c0-8603-37d173e3b607 tempest-CreateVolumesFromImageTest-605891512 None] Lock "cinder-5ac4e079-556f-4842-9bd0-a9e34bad6d7a-delete_volume" released by "delete_volume" :: held 3.360s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:15:06 devstack sudo[90762]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:06 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-874d2640-d4c3-482c-a6be-9670a9fcb94f tempest-CreateVolumesFromImageTest-605891512 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-93065a0d-4557-47d0-b061-53fc09cbe63f" returned: 0 in 0.699s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:06 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-874d2640-d4c3-482c-a6be-9670a9fcb94f tempest-CreateVolumesFromImageTest-605891512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-93065a0d-4557-47d0-b061-53fc09cbe63f {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:06 devstack sudo[90770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-93065a0d-4557-47d0-b061-53fc09cbe63f Apr 16 15:15:06 devstack sudo[90770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:06 devstack sudo[90764]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:06 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-182c76ab-6f06-407c-b536-421b7cdc690d tempest-VolumeDependencyTests-1769369869 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-35d57e9c-82cf-4ca4-a6c7-4a0773ac88e4" returned: 0 in 0.615s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:06 devstack cinder-volume[82756]: DEBUG cinder.image.image_utils [None req-182c76ab-6f06-407c-b536-421b7cdc690d tempest-VolumeDependencyTests-1769369869 None] Image conversion details: src /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-35d57e9c-82cf-4ca4-a6c7-4a0773ac88e4, size 1024.00 MB, duration 2.75 sec, destination /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2ea7e4be-e8ab-4465-b41a-0938018d568c {{(pid=82756) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 15:15:06 devstack cinder-volume[82756]: INFO cinder.image.image_utils [None req-182c76ab-6f06-407c-b536-421b7cdc690d tempest-VolumeDependencyTests-1769369869 None] Converted 1024.00 MB image at 372.02 MB/s Apr 16 15:15:06 devstack cinder-volume[82756]: WARNING cinder.volume.drivers.remotefs [None req-182c76ab-6f06-407c-b536-421b7cdc690d tempest-VolumeDependencyTests-1769369869 None] /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2ea7e4be-e8ab-4465-b41a-0938018d568c is being set with open permissions: ugo+rw Apr 16 15:15:06 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-182c76ab-6f06-407c-b536-421b7cdc690d tempest-VolumeDependencyTests-1769369869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2ea7e4be-e8ab-4465-b41a-0938018d568c {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:06 devstack sudo[90775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2ea7e4be-e8ab-4465-b41a-0938018d568c Apr 16 15:15:06 devstack sudo[90775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:06 devstack sudo[90770]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:06 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-874d2640-d4c3-482c-a6be-9670a9fcb94f tempest-CreateVolumesFromImageTest-605891512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-93065a0d-4557-47d0-b061-53fc09cbe63f" returned: 0 in 0.400s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:06 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-874d2640-d4c3-482c-a6be-9670a9fcb94f tempest-CreateVolumesFromImageTest-605891512 None] Lock "cinder-quobyte-93065a0d-4557-47d0-b061-53fc09cbe63f" released by "delete_volume" :: held 1.138s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:15:06 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-874d2640-d4c3-482c-a6be-9670a9fcb94f tempest-CreateVolumesFromImageTest-605891512 None] Created reservations ['d3b55d96-d0bc-4726-bf11-08bddabcf08f', 'e95b6119-13ae-467c-9d84-3deb12c03094', '7b99efe5-951b-434b-ab9e-dab6e2a51c14', '3275e0a6-dfe6-4380-a0d3-3b0dcadeb99d'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:15:06 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-874d2640-d4c3-482c-a6be-9670a9fcb94f tempest-CreateVolumesFromImageTest-605891512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:15:06 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-874d2640-d4c3-482c-a6be-9670a9fcb94f tempest-CreateVolumesFromImageTest-605891512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:15:06 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-874d2640-d4c3-482c-a6be-9670a9fcb94f tempest-CreateVolumesFromImageTest-605891512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:15:06 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-874d2640-d4c3-482c-a6be-9670a9fcb94f tempest-CreateVolumesFromImageTest-605891512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:15:06 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-874d2640-d4c3-482c-a6be-9670a9fcb94f tempest-CreateVolumesFromImageTest-605891512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:15:06 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-874d2640-d4c3-482c-a6be-9670a9fcb94f tempest-CreateVolumesFromImageTest-605891512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:06 devstack sudo[90778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:15:06 devstack sudo[90778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:06 devstack sudo[90775]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:06 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-182c76ab-6f06-407c-b536-421b7cdc690d tempest-VolumeDependencyTests-1769369869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2ea7e4be-e8ab-4465-b41a-0938018d568c" returned: 0 in 0.432s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:06 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-182c76ab-6f06-407c-b536-421b7cdc690d tempest-VolumeDependencyTests-1769369869 None] Lock "cinder-quobyte-2ea7e4be-e8ab-4465-b41a-0938018d568c" released by "_copy_volume_from_snapshot" :: held 4.910s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:15:06 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-182c76ab-6f06-407c-b536-421b7cdc690d tempest-VolumeDependencyTests-1769369869 None] Lock "cinder-quobyte-88efe222-a7ad-4c91-84a8-762f2b4d9492-2ea7e4be-e8ab-4465-b41a-0938018d568c" released by "_create_volume_from_snapshot" :: held 4.936s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:15:06 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-182c76ab-6f06-407c-b536-421b7cdc690d tempest-VolumeDependencyTests-1769369869 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.962s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:15:06 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-078501b7-c4fa-42da-b0fa-589a0e1168a0 tempest-SnapshotDependencyTests-858447260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.220s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:15:06 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-078501b7-c4fa-42da-b0fa-589a0e1168a0 tempest-SnapshotDependencyTests-858447260 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:15:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1506837381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=386dcbae-cb25-4737-8aeb-cfee8921c168,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcf35c7972cc455a89f699dcbe307a69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:15:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:15:02Z,use_quota=True,user_id='3a728be3f00f44b889ff7ea60d57ae06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)}" {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 15:15:06 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-078501b7-c4fa-42da-b0fa-589a0e1168a0 tempest-SnapshotDependencyTests-858447260 None] Creating volume 386dcbae-cb25-4737-8aeb-cfee8921c168 {{(pid=82756) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 15:15:06 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-078501b7-c4fa-42da-b0fa-589a0e1168a0 tempest-SnapshotDependencyTests-858447260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:15:06 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-078501b7-c4fa-42da-b0fa-589a0e1168a0 tempest-SnapshotDependencyTests-858447260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:15:06 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-078501b7-c4fa-42da-b0fa-589a0e1168a0 tempest-SnapshotDependencyTests-858447260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:15:06 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-078501b7-c4fa-42da-b0fa-589a0e1168a0 tempest-SnapshotDependencyTests-858447260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:15:06 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-078501b7-c4fa-42da-b0fa-589a0e1168a0 tempest-SnapshotDependencyTests-858447260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:15:06 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-078501b7-c4fa-42da-b0fa-589a0e1168a0 tempest-SnapshotDependencyTests-858447260 None] Selected osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 as target Quobyte volume. {{(pid=82756) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 15:15:06 devstack cinder-volume[82756]: INFO cinder.volume.drivers.remotefs [None req-078501b7-c4fa-42da-b0fa-589a0e1168a0 tempest-SnapshotDependencyTests-858447260 None] casted to osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 Apr 16 15:15:06 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-078501b7-c4fa-42da-b0fa-589a0e1168a0 tempest-SnapshotDependencyTests-858447260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-386dcbae-cb25-4737-8aeb-cfee8921c168 1073741824 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:06 devstack sudo[90781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-386dcbae-cb25-4737-8aeb-cfee8921c168 1073741824 Apr 16 15:15:06 devstack sudo[90781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:06 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-182c76ab-6f06-407c-b536-421b7cdc690d tempest-VolumeDependencyTests-1769369869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0720de24-ba31-4761-9a64-a8d089cc2cec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ea7e4be-e8ab-4465-b41a-0938018d568c', 'volume_size': 1, 'snapshot_id': '88efe222-a7ad-4c91-84a8-762f2b4d9492'}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:15:06 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-182c76ab-6f06-407c-b536-421b7cdc690d tempest-VolumeDependencyTests-1769369869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf0894da-8d74-4d5f-96bc-8f5fb108171b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:15:06 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-182c76ab-6f06-407c-b536-421b7cdc690d tempest-VolumeDependencyTests-1769369869 None] Volume volume-2ea7e4be-e8ab-4465-b41a-0938018d568c (2ea7e4be-e8ab-4465-b41a-0938018d568c): created successfully Apr 16 15:15:06 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-182c76ab-6f06-407c-b536-421b7cdc690d tempest-VolumeDependencyTests-1769369869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf0894da-8d74-4d5f-96bc-8f5fb108171b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:15:06 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-182c76ab-6f06-407c-b536-421b7cdc690d tempest-VolumeDependencyTests-1769369869 None] Flow 'volume_create_manager' (947d4739-3653-43ff-a494-b3af31674162) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:15:06 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-182c76ab-6f06-407c-b536-421b7cdc690d tempest-VolumeDependencyTests-1769369869 None] Created volume successfully. Apr 16 15:15:07 devstack sudo[90778]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:07 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-874d2640-d4c3-482c-a6be-9670a9fcb94f tempest-CreateVolumesFromImageTest-605891512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.461s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:07 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-874d2640-d4c3-482c-a6be-9670a9fcb94f tempest-CreateVolumesFromImageTest-605891512 None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:15:07 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-874d2640-d4c3-482c-a6be-9670a9fcb94f tempest-CreateVolumesFromImageTest-605891512 None] Deleted volume successfully. Apr 16 15:15:07 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-874d2640-d4c3-482c-a6be-9670a9fcb94f tempest-CreateVolumesFromImageTest-605891512 None] Lock "cinder-93065a0d-4557-47d0-b061-53fc09cbe63f-delete_volume" released by "delete_volume" :: held 1.790s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:15:07 devstack sudo[90781]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:07 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-078501b7-c4fa-42da-b0fa-589a0e1168a0 tempest-SnapshotDependencyTests-858447260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-386dcbae-cb25-4737-8aeb-cfee8921c168 1073741824" returned: 0 in 0.522s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:07 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-078501b7-c4fa-42da-b0fa-589a0e1168a0 tempest-SnapshotDependencyTests-858447260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-386dcbae-cb25-4737-8aeb-cfee8921c168 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:07 devstack sudo[90787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-386dcbae-cb25-4737-8aeb-cfee8921c168 Apr 16 15:15:07 devstack sudo[90787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:07 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-18b643b1-7bc0-454c-b72d-44f598a9ae2f tempest-VolumeDependencyTests-1769369869 None] Acquiring lock "cinder-88efe222-a7ad-4c91-84a8-762f2b4d9492-delete_snapshot" by "delete_snapshot" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:15:07 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-18b643b1-7bc0-454c-b72d-44f598a9ae2f tempest-VolumeDependencyTests-1769369869 None] Lock "cinder-88efe222-a7ad-4c91-84a8-762f2b4d9492-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:15:07 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-18b643b1-7bc0-454c-b72d-44f598a9ae2f tempest-VolumeDependencyTests-1769369869 None] Acquiring lock "cinder-quobyte-35d57e9c-82cf-4ca4-a6c7-4a0773ac88e4" by "delete_snapshot" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:15:07 devstack sudo[90787]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:07 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-078501b7-c4fa-42da-b0fa-589a0e1168a0 tempest-SnapshotDependencyTests-858447260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-386dcbae-cb25-4737-8aeb-cfee8921c168" returned: 0 in 0.479s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:07 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-078501b7-c4fa-42da-b0fa-589a0e1168a0 tempest-SnapshotDependencyTests-858447260 None] <== create_volume: return (1026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'} {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 15:15:07 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-078501b7-c4fa-42da-b0fa-589a0e1168a0 tempest-SnapshotDependencyTests-858447260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.029s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:15:07 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-bf7e0fe9-717e-49ae-a1d7-7b2753a59672 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.604s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:15:07 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-bf7e0fe9-717e-49ae-a1d7-7b2753a59672 tempest-CreateVolumesFromSnapshotTest-1272343304 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:15:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-300888699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3403603b-a9fb-493b-a948-e8578fe3494a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67db5101aca74e2493d47e4bf32c1892',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:15:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:15:03Z,use_quota=True,user_id='461fefe546444a57bda769f210b6858e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)}" {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 15:15:07 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-bf7e0fe9-717e-49ae-a1d7-7b2753a59672 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Creating volume 3403603b-a9fb-493b-a948-e8578fe3494a {{(pid=82756) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 15:15:07 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-bf7e0fe9-717e-49ae-a1d7-7b2753a59672 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:15:07 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-bf7e0fe9-717e-49ae-a1d7-7b2753a59672 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:15:07 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-bf7e0fe9-717e-49ae-a1d7-7b2753a59672 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:15:07 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-bf7e0fe9-717e-49ae-a1d7-7b2753a59672 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:15:07 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-bf7e0fe9-717e-49ae-a1d7-7b2753a59672 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:15:07 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-bf7e0fe9-717e-49ae-a1d7-7b2753a59672 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Selected osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 as target Quobyte volume. {{(pid=82756) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 15:15:07 devstack cinder-volume[82756]: INFO cinder.volume.drivers.remotefs [None req-bf7e0fe9-717e-49ae-a1d7-7b2753a59672 tempest-CreateVolumesFromSnapshotTest-1272343304 None] casted to osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 Apr 16 15:15:07 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-bf7e0fe9-717e-49ae-a1d7-7b2753a59672 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-3403603b-a9fb-493b-a948-e8578fe3494a 1073741824 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:07 devstack sudo[90790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-3403603b-a9fb-493b-a948-e8578fe3494a 1073741824 Apr 16 15:15:07 devstack sudo[90790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:07 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-078501b7-c4fa-42da-b0fa-589a0e1168a0 tempest-SnapshotDependencyTests-858447260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3f50ecc-fb7e-4c52-a453-6de708370c1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-386dcbae-cb25-4737-8aeb-cfee8921c168', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:15:07 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-078501b7-c4fa-42da-b0fa-589a0e1168a0 tempest-SnapshotDependencyTests-858447260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa19ad29-c29f-47ad-be53-e43c2fec69ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:15:07 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-18b643b1-7bc0-454c-b72d-44f598a9ae2f tempest-VolumeDependencyTests-1769369869 None] Lock "cinder-quobyte-35d57e9c-82cf-4ca4-a6c7-4a0773ac88e4" acquired by "delete_snapshot" :: waited 0.054s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:15:08 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-18b643b1-7bc0-454c-b72d-44f598a9ae2f tempest-VolumeDependencyTests-1769369869 None] Acquiring lock "cinder-quobyte-88efe222-a7ad-4c91-84a8-762f2b4d9492" by "_delete_snapshot" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:15:08 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-078501b7-c4fa-42da-b0fa-589a0e1168a0 tempest-SnapshotDependencyTests-858447260 None] Volume volume-386dcbae-cb25-4737-8aeb-cfee8921c168 (386dcbae-cb25-4737-8aeb-cfee8921c168): created successfully Apr 16 15:15:08 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-078501b7-c4fa-42da-b0fa-589a0e1168a0 tempest-SnapshotDependencyTests-858447260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa19ad29-c29f-47ad-be53-e43c2fec69ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:15:08 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-078501b7-c4fa-42da-b0fa-589a0e1168a0 tempest-SnapshotDependencyTests-858447260 None] Flow 'volume_create_manager' (a338283d-5eb0-4eaf-bb40-fc81548b3b97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:15:08 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-18b643b1-7bc0-454c-b72d-44f598a9ae2f tempest-VolumeDependencyTests-1769369869 None] Lock "cinder-quobyte-88efe222-a7ad-4c91-84a8-762f2b4d9492" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:15:08 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-18b643b1-7bc0-454c-b72d-44f598a9ae2f tempest-VolumeDependencyTests-1769369869 None] Deleting offline snapshot 88efe222-a7ad-4c91-84a8-762f2b4d9492 of volume 35d57e9c-82cf-4ca4-a6c7-4a0773ac88e4 {{(pid=82756) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 15:15:08 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-18b643b1-7bc0-454c-b72d-44f598a9ae2f tempest-VolumeDependencyTests-1769369869 None] snapshot_file for this snap is: volume-35d57e9c-82cf-4ca4-a6c7-4a0773ac88e4.88efe222-a7ad-4c91-84a8-762f2b4d9492 {{(pid=82756) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 15:15:08 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-078501b7-c4fa-42da-b0fa-589a0e1168a0 tempest-SnapshotDependencyTests-858447260 None] Created volume successfully. Apr 16 15:15:08 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[29d9e9a1-f4aa-41ff-90fc-a4aa37cfac9c]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:15:08 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-18b643b1-7bc0-454c-b72d-44f598a9ae2f tempest-VolumeDependencyTests-1769369869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-35d57e9c-82cf-4ca4-a6c7-4a0773ac88e4.88efe222-a7ad-4c91-84a8-762f2b4d9492 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:08 devstack sudo[90792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-35d57e9c-82cf-4ca4-a6c7-4a0773ac88e4.88efe222-a7ad-4c91-84a8-762f2b4d9492 Apr 16 15:15:08 devstack sudo[90792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:08 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-98ef0bfb-48dc-4e06-9143-a813f8dd18f1 tempest-SnapshotDependencyTests-858447260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:15:08 devstack sudo[90790]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:08 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-bf7e0fe9-717e-49ae-a1d7-7b2753a59672 tempest-CreateVolumesFromSnapshotTest-1272343304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-3403603b-a9fb-493b-a948-e8578fe3494a 1073741824" returned: 0 in 0.623s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:08 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-bf7e0fe9-717e-49ae-a1d7-7b2753a59672 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-3403603b-a9fb-493b-a948-e8578fe3494a {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:08 devstack sudo[90800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-3403603b-a9fb-493b-a948-e8578fe3494a Apr 16 15:15:08 devstack sudo[90800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:08 devstack sudo[90792]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:08 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-18b643b1-7bc0-454c-b72d-44f598a9ae2f tempest-VolumeDependencyTests-1769369869 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-35d57e9c-82cf-4ca4-a6c7-4a0773ac88e4.88efe222-a7ad-4c91-84a8-762f2b4d9492" returned: 0 in 0.606s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:08 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-18b643b1-7bc0-454c-b72d-44f598a9ae2f tempest-VolumeDependencyTests-1769369869 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-35d57e9c-82cf-4ca4-a6c7-4a0773ac88e4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82756) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 15:15:08 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[83d8729c-8f7a-48d5-b036-ffc5ad3ae8f3]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:15:08 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-18b643b1-7bc0-454c-b72d-44f598a9ae2f tempest-VolumeDependencyTests-1769369869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-35d57e9c-82cf-4ca4-a6c7-4a0773ac88e4 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:08 devstack sudo[90802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-35d57e9c-82cf-4ca4-a6c7-4a0773ac88e4 Apr 16 15:15:08 devstack sudo[90802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:09 devstack sudo[90800]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:09 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-bf7e0fe9-717e-49ae-a1d7-7b2753a59672 tempest-CreateVolumesFromSnapshotTest-1272343304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-3403603b-a9fb-493b-a948-e8578fe3494a" returned: 0 in 0.481s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:09 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-bf7e0fe9-717e-49ae-a1d7-7b2753a59672 tempest-CreateVolumesFromSnapshotTest-1272343304 None] <== create_volume: return (1127ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'} {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 15:15:09 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-bf7e0fe9-717e-49ae-a1d7-7b2753a59672 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.130s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:15:09 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-ab42f25f-f487-4f63-9822-1b91c2d8ff75 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.433s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:15:09 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-ab42f25f-f487-4f63-9822-1b91c2d8ff75 tempest-CreateVolumesFromSnapshotTest-1272343304 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:15:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-654162086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a60e6b7d-5be5-4814-ab98-6e21c1c522b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67db5101aca74e2493d47e4bf32c1892',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:15:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:15:04Z,use_quota=True,user_id='461fefe546444a57bda769f210b6858e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)}" {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 15:15:09 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-ab42f25f-f487-4f63-9822-1b91c2d8ff75 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Creating volume a60e6b7d-5be5-4814-ab98-6e21c1c522b4 {{(pid=82756) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 15:15:09 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-ab42f25f-f487-4f63-9822-1b91c2d8ff75 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:15:09 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-ab42f25f-f487-4f63-9822-1b91c2d8ff75 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:15:09 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-ab42f25f-f487-4f63-9822-1b91c2d8ff75 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:15:09 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-ab42f25f-f487-4f63-9822-1b91c2d8ff75 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:15:09 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-ab42f25f-f487-4f63-9822-1b91c2d8ff75 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:15:09 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-ab42f25f-f487-4f63-9822-1b91c2d8ff75 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Selected osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 as target Quobyte volume. {{(pid=82756) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 15:15:09 devstack cinder-volume[82756]: INFO cinder.volume.drivers.remotefs [None req-ab42f25f-f487-4f63-9822-1b91c2d8ff75 tempest-CreateVolumesFromSnapshotTest-1272343304 None] casted to osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 Apr 16 15:15:09 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-ab42f25f-f487-4f63-9822-1b91c2d8ff75 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-a60e6b7d-5be5-4814-ab98-6e21c1c522b4 1073741824 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:09 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-bf7e0fe9-717e-49ae-a1d7-7b2753a59672 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caffeb86-d805-4472-9670-e3e5f8793518) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3403603b-a9fb-493b-a948-e8578fe3494a', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:15:09 devstack sudo[90805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-a60e6b7d-5be5-4814-ab98-6e21c1c522b4 1073741824 Apr 16 15:15:09 devstack sudo[90805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:09 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-bf7e0fe9-717e-49ae-a1d7-7b2753a59672 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fc363cd-ff61-49ff-82c3-9aa497e563fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:15:09 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-bf7e0fe9-717e-49ae-a1d7-7b2753a59672 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Volume volume-3403603b-a9fb-493b-a948-e8578fe3494a (3403603b-a9fb-493b-a948-e8578fe3494a): created successfully Apr 16 15:15:09 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-bf7e0fe9-717e-49ae-a1d7-7b2753a59672 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fc363cd-ff61-49ff-82c3-9aa497e563fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:15:09 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-bf7e0fe9-717e-49ae-a1d7-7b2753a59672 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Flow 'volume_create_manager' (1e196030-c942-42f1-846f-c38801978b85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:15:09 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-bf7e0fe9-717e-49ae-a1d7-7b2753a59672 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Created volume successfully. Apr 16 15:15:09 devstack sudo[90802]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:09 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-18b643b1-7bc0-454c-b72d-44f598a9ae2f tempest-VolumeDependencyTests-1769369869 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-35d57e9c-82cf-4ca4-a6c7-4a0773ac88e4" returned: 0 in 0.582s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:09 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-18b643b1-7bc0-454c-b72d-44f598a9ae2f tempest-VolumeDependencyTests-1769369869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-35d57e9c-82cf-4ca4-a6c7-4a0773ac88e4.88efe222-a7ad-4c91-84a8-762f2b4d9492 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:09 devstack sudo[90810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-35d57e9c-82cf-4ca4-a6c7-4a0773ac88e4.88efe222-a7ad-4c91-84a8-762f2b4d9492 Apr 16 15:15:09 devstack sudo[90810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:09 devstack sudo[90805]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:09 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-ab42f25f-f487-4f63-9822-1b91c2d8ff75 tempest-CreateVolumesFromSnapshotTest-1272343304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-a60e6b7d-5be5-4814-ab98-6e21c1c522b4 1073741824" returned: 0 in 0.642s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:09 devstack cinder-volume[82756]: DEBUG dbcounter [-] [82756] Writing DB stats cinder:SELECT=121,cinder:INSERT=37,cinder:UPDATE=168,cinder:DELETE=17 {{(pid=82756) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 15:15:09 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-ab42f25f-f487-4f63-9822-1b91c2d8ff75 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-a60e6b7d-5be5-4814-ab98-6e21c1c522b4 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:09 devstack sudo[90810]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:09 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-18b643b1-7bc0-454c-b72d-44f598a9ae2f tempest-VolumeDependencyTests-1769369869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-35d57e9c-82cf-4ca4-a6c7-4a0773ac88e4.88efe222-a7ad-4c91-84a8-762f2b4d9492" returned: 0 in 0.548s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:09 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-18b643b1-7bc0-454c-b72d-44f598a9ae2f tempest-VolumeDependencyTests-1769369869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-35d57e9c-82cf-4ca4-a6c7-4a0773ac88e4.88efe222-a7ad-4c91-84a8-762f2b4d9492 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:09 devstack sudo[90818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-a60e6b7d-5be5-4814-ab98-6e21c1c522b4 Apr 16 15:15:09 devstack sudo[90818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:09 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [None req-19f83311-0444-41e7-b418-68da05761791 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82756) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 15:15:09 devstack sudo[90819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-35d57e9c-82cf-4ca4-a6c7-4a0773ac88e4.88efe222-a7ad-4c91-84a8-762f2b4d9492 Apr 16 15:15:09 devstack sudo[90819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:09 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-19f83311-0444-41e7-b418-68da05761791 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Flow 'volume_create_manager' (c70da7ec-9840-4fcd-b8f9-fa6196c19c5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:15:09 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-19f83311-0444-41e7-b418-68da05761791 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68a4b3ae-6309-43f3-ae22-3f3994ed1a45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:15:09 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-19f83311-0444-41e7-b418-68da05761791 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68a4b3ae-6309-43f3-ae22-3f3994ed1a45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:15:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-973650539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4388773e-4726-4acc-8942-6470dec07d29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19556a2b539946c1ab8a738718adb68d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:15:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:15:10Z,use_quota=True,user_id='a7c6856e1be54beea670dbbd9950ee83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:15:09 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-19f83311-0444-41e7-b418-68da05761791 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7980a806-553c-48e6-9eae-e2c0480ce56e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:15:09 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-19f83311-0444-41e7-b418-68da05761791 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7980a806-553c-48e6-9eae-e2c0480ce56e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:15:09 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-19f83311-0444-41e7-b418-68da05761791 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c75b3f63-19dc-4274-9740-eb574f64efe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:15:09 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-19f83311-0444-41e7-b418-68da05761791 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c75b3f63-19dc-4274-9740-eb574f64efe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4388773e-4726-4acc-8942-6470dec07d29', 'volume_name': 'volume-4388773e-4726-4acc-8942-6470dec07d29', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:15:09 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-19f83311-0444-41e7-b418-68da05761791 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54791f44-70b0-4b49-a58d-681ac5d65974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:15:09 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-19f83311-0444-41e7-b418-68da05761791 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54791f44-70b0-4b49-a58d-681ac5d65974) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:15:09 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-19f83311-0444-41e7-b418-68da05761791 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfd7a5a0-f8ab-4a46-bafa-47cdb60dc3bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:15:09 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-19f83311-0444-41e7-b418-68da05761791 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Volume 4388773e-4726-4acc-8942-6470dec07d29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4388773e-4726-4acc-8942-6470dec07d29', 'volume_size': 1} Apr 16 15:15:09 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-19f83311-0444-41e7-b418-68da05761791 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:15:10 devstack sudo[90819]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:10 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-18b643b1-7bc0-454c-b72d-44f598a9ae2f tempest-VolumeDependencyTests-1769369869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-35d57e9c-82cf-4ca4-a6c7-4a0773ac88e4.88efe222-a7ad-4c91-84a8-762f2b4d9492" returned: 0 in 0.447s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:10 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-18b643b1-7bc0-454c-b72d-44f598a9ae2f tempest-VolumeDependencyTests-1769369869 None] Lock "cinder-quobyte-88efe222-a7ad-4c91-84a8-762f2b4d9492" released by "_delete_snapshot" :: held 2.250s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:15:10 devstack sudo[90818]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:10 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-18b643b1-7bc0-454c-b72d-44f598a9ae2f tempest-VolumeDependencyTests-1769369869 None] Lock "cinder-quobyte-35d57e9c-82cf-4ca4-a6c7-4a0773ac88e4" released by "delete_snapshot" :: held 2.277s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:15:10 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-ab42f25f-f487-4f63-9822-1b91c2d8ff75 tempest-CreateVolumesFromSnapshotTest-1272343304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-a60e6b7d-5be5-4814-ab98-6e21c1c522b4" returned: 0 in 0.514s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:10 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-ab42f25f-f487-4f63-9822-1b91c2d8ff75 tempest-CreateVolumesFromSnapshotTest-1272343304 None] <== create_volume: return (1194ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'} {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 15:15:10 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-ab42f25f-f487-4f63-9822-1b91c2d8ff75 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.197s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:15:10 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-ebf627fa-6766-4db3-a596-452dfb411682 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.499s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:15:10 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-ebf627fa-6766-4db3-a596-452dfb411682 tempest-CreateVolumesFromSnapshotTest-1272343304 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:15:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1638922012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80d004c0-6ecb-456b-a55d-e1d8652015b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67db5101aca74e2493d47e4bf32c1892',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:15:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:15:04Z,use_quota=True,user_id='461fefe546444a57bda769f210b6858e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)}" {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 15:15:10 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-ebf627fa-6766-4db3-a596-452dfb411682 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Creating volume 80d004c0-6ecb-456b-a55d-e1d8652015b7 {{(pid=82756) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 15:15:10 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-ebf627fa-6766-4db3-a596-452dfb411682 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:15:10 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-ebf627fa-6766-4db3-a596-452dfb411682 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:15:10 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-ebf627fa-6766-4db3-a596-452dfb411682 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:15:10 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-ebf627fa-6766-4db3-a596-452dfb411682 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:15:10 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-ebf627fa-6766-4db3-a596-452dfb411682 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:15:10 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-ebf627fa-6766-4db3-a596-452dfb411682 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Selected osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 as target Quobyte volume. {{(pid=82756) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 15:15:10 devstack cinder-volume[82756]: INFO cinder.volume.drivers.remotefs [None req-ebf627fa-6766-4db3-a596-452dfb411682 tempest-CreateVolumesFromSnapshotTest-1272343304 None] casted to osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 Apr 16 15:15:10 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-ebf627fa-6766-4db3-a596-452dfb411682 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-80d004c0-6ecb-456b-a55d-e1d8652015b7 1073741824 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:10 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-ab42f25f-f487-4f63-9822-1b91c2d8ff75 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8fd9b49-e1ac-4dfa-80e1-658b57cae958) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a60e6b7d-5be5-4814-ab98-6e21c1c522b4', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:15:10 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-ab42f25f-f487-4f63-9822-1b91c2d8ff75 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccbe4ad5-393f-411e-9260-610c7330b306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:15:10 devstack sudo[90824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-80d004c0-6ecb-456b-a55d-e1d8652015b7 1073741824 Apr 16 15:15:10 devstack sudo[90824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:10 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-ab42f25f-f487-4f63-9822-1b91c2d8ff75 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Volume volume-a60e6b7d-5be5-4814-ab98-6e21c1c522b4 (a60e6b7d-5be5-4814-ab98-6e21c1c522b4): created successfully Apr 16 15:15:10 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-ab42f25f-f487-4f63-9822-1b91c2d8ff75 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccbe4ad5-393f-411e-9260-610c7330b306) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:15:10 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-ab42f25f-f487-4f63-9822-1b91c2d8ff75 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Flow 'volume_create_manager' (b5f3c307-0a11-44df-8106-5cec7e32a9c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:15:10 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-ab42f25f-f487-4f63-9822-1b91c2d8ff75 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Created volume successfully. Apr 16 15:15:10 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-18b643b1-7bc0-454c-b72d-44f598a9ae2f tempest-VolumeDependencyTests-1769369869 None] Created reservations ['d6e1cce5-81e1-45a9-be63-2963e6aff1e2', 'bc1cdf91-1ab6-4a36-a5a3-b08a023d4e38', '68127c0a-0176-49c8-8471-6dcfd61257d0', 'be6268b1-33e7-4271-83f2-0fc43404e60c'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:15:10 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-18b643b1-7bc0-454c-b72d-44f598a9ae2f tempest-VolumeDependencyTests-1769369869 None] Delete snapshot completed successfully. Apr 16 15:15:10 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-18b643b1-7bc0-454c-b72d-44f598a9ae2f tempest-VolumeDependencyTests-1769369869 None] Lock "cinder-88efe222-a7ad-4c91-84a8-762f2b4d9492-delete_snapshot" released by "delete_snapshot" :: held 2.468s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:15:10 devstack sudo[90824]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:10 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-ebf627fa-6766-4db3-a596-452dfb411682 tempest-CreateVolumesFromSnapshotTest-1272343304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-80d004c0-6ecb-456b-a55d-e1d8652015b7 1073741824" returned: 0 in 0.489s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:10 devstack cinder-volume[82756]: DEBUG dbcounter [-] [82756] Writing DB stats cinder:SELECT=129,cinder:INSERT=42,cinder:UPDATE=181,cinder:DELETE=18 {{(pid=82756) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 15:15:10 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-ebf627fa-6766-4db3-a596-452dfb411682 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-80d004c0-6ecb-456b-a55d-e1d8652015b7 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:10 devstack sudo[90829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-80d004c0-6ecb-456b-a55d-e1d8652015b7 Apr 16 15:15:10 devstack sudo[90829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:11 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-1f024225-f75c-4c86-b98f-af2fe03b8764 tempest-VolumeDependencyTests-1769369869 None] Acquiring lock "cinder-35d57e9c-82cf-4ca4-a6c7-4a0773ac88e4-delete_volume" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:15:11 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-1f024225-f75c-4c86-b98f-af2fe03b8764 tempest-VolumeDependencyTests-1769369869 None] Lock "cinder-35d57e9c-82cf-4ca4-a6c7-4a0773ac88e4-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:15:11 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-1f024225-f75c-4c86-b98f-af2fe03b8764 tempest-VolumeDependencyTests-1769369869 None] Acquiring lock "cinder-quobyte-35d57e9c-82cf-4ca4-a6c7-4a0773ac88e4" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:15:11 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-1f024225-f75c-4c86-b98f-af2fe03b8764 tempest-VolumeDependencyTests-1769369869 None] Lock "cinder-quobyte-35d57e9c-82cf-4ca4-a6c7-4a0773ac88e4" acquired by "delete_volume" :: waited 0.008s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:15:11 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[92ff3bdb-f152-4959-9d1c-99c8a6243a88]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:15:11 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-1f024225-f75c-4c86-b98f-af2fe03b8764 tempest-VolumeDependencyTests-1769369869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-35d57e9c-82cf-4ca4-a6c7-4a0773ac88e4 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:11 devstack sudo[90831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-35d57e9c-82cf-4ca4-a6c7-4a0773ac88e4 Apr 16 15:15:11 devstack sudo[90831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:11 devstack sudo[90829]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:11 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-ebf627fa-6766-4db3-a596-452dfb411682 tempest-CreateVolumesFromSnapshotTest-1272343304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-80d004c0-6ecb-456b-a55d-e1d8652015b7" returned: 0 in 0.460s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:11 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-ebf627fa-6766-4db3-a596-452dfb411682 tempest-CreateVolumesFromSnapshotTest-1272343304 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'} {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 15:15:11 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-ebf627fa-6766-4db3-a596-452dfb411682 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.982s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:15:11 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-7ac33d15-9a98-49d5-89b1-35548a03a0b8 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.238s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:15:11 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-7ac33d15-9a98-49d5-89b1-35548a03a0b8 tempest-CreateVolumesFromSnapshotTest-1272343304 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:15:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-210275396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c91094bc-4d90-46ea-b2d9-7a2db6900acb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67db5101aca74e2493d47e4bf32c1892',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:15:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:15:05Z,use_quota=True,user_id='461fefe546444a57bda769f210b6858e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)}" {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 15:15:11 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-7ac33d15-9a98-49d5-89b1-35548a03a0b8 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Creating volume c91094bc-4d90-46ea-b2d9-7a2db6900acb {{(pid=82756) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 15:15:11 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-7ac33d15-9a98-49d5-89b1-35548a03a0b8 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:15:11 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-7ac33d15-9a98-49d5-89b1-35548a03a0b8 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:15:11 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-7ac33d15-9a98-49d5-89b1-35548a03a0b8 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:15:11 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-7ac33d15-9a98-49d5-89b1-35548a03a0b8 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:15:11 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-7ac33d15-9a98-49d5-89b1-35548a03a0b8 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:15:11 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-7ac33d15-9a98-49d5-89b1-35548a03a0b8 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Selected osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 as target Quobyte volume. {{(pid=82756) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 15:15:11 devstack cinder-volume[82756]: INFO cinder.volume.drivers.remotefs [None req-7ac33d15-9a98-49d5-89b1-35548a03a0b8 tempest-CreateVolumesFromSnapshotTest-1272343304 None] casted to osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 Apr 16 15:15:11 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-7ac33d15-9a98-49d5-89b1-35548a03a0b8 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c91094bc-4d90-46ea-b2d9-7a2db6900acb 1073741824 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:11 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-ebf627fa-6766-4db3-a596-452dfb411682 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c281cd8-0a00-4593-857f-1ba14a0eeb5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80d004c0-6ecb-456b-a55d-e1d8652015b7', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:15:11 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-ebf627fa-6766-4db3-a596-452dfb411682 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33ac9ba3-c424-48ea-9c0a-823fa0751ab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:15:11 devstack sudo[90834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c91094bc-4d90-46ea-b2d9-7a2db6900acb 1073741824 Apr 16 15:15:11 devstack sudo[90834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:11 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-ebf627fa-6766-4db3-a596-452dfb411682 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Volume volume-80d004c0-6ecb-456b-a55d-e1d8652015b7 (80d004c0-6ecb-456b-a55d-e1d8652015b7): created successfully Apr 16 15:15:11 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-ebf627fa-6766-4db3-a596-452dfb411682 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33ac9ba3-c424-48ea-9c0a-823fa0751ab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:15:11 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-ebf627fa-6766-4db3-a596-452dfb411682 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Flow 'volume_create_manager' (0294bf8d-f401-41d1-8647-50ccddfb2635) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:15:11 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-ebf627fa-6766-4db3-a596-452dfb411682 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Created volume successfully. Apr 16 15:15:11 devstack sudo[90831]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:11 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-1f024225-f75c-4c86-b98f-af2fe03b8764 tempest-VolumeDependencyTests-1769369869 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-35d57e9c-82cf-4ca4-a6c7-4a0773ac88e4" returned: 0 in 0.524s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:11 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-1f024225-f75c-4c86-b98f-af2fe03b8764 tempest-VolumeDependencyTests-1769369869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-35d57e9c-82cf-4ca4-a6c7-4a0773ac88e4 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:11 devstack sudo[90842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-35d57e9c-82cf-4ca4-a6c7-4a0773ac88e4 Apr 16 15:15:11 devstack sudo[90842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:11 devstack sudo[90834]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:11 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-7ac33d15-9a98-49d5-89b1-35548a03a0b8 tempest-CreateVolumesFromSnapshotTest-1272343304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c91094bc-4d90-46ea-b2d9-7a2db6900acb 1073741824" returned: 0 in 0.521s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:11 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-7ac33d15-9a98-49d5-89b1-35548a03a0b8 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c91094bc-4d90-46ea-b2d9-7a2db6900acb {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:11 devstack sudo[90844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c91094bc-4d90-46ea-b2d9-7a2db6900acb Apr 16 15:15:11 devstack sudo[90844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:12 devstack sudo[90842]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:12 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-1f024225-f75c-4c86-b98f-af2fe03b8764 tempest-VolumeDependencyTests-1769369869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-35d57e9c-82cf-4ca4-a6c7-4a0773ac88e4" returned: 0 in 0.463s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:12 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-1f024225-f75c-4c86-b98f-af2fe03b8764 tempest-VolumeDependencyTests-1769369869 None] Lock "cinder-quobyte-35d57e9c-82cf-4ca4-a6c7-4a0773ac88e4" released by "delete_volume" :: held 1.028s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:15:12 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-1f024225-f75c-4c86-b98f-af2fe03b8764 tempest-VolumeDependencyTests-1769369869 None] Created reservations ['e2a74fe9-0e53-4dd8-af50-e161f93b5cd2', 'b16749a5-17aa-482d-901e-61c0474948f8', '7b4e4fe5-e880-4a0f-be4c-849172e25258', 'c92b043d-7006-4c8b-8bea-6290ee77a522'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:15:12 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-1f024225-f75c-4c86-b98f-af2fe03b8764 tempest-VolumeDependencyTests-1769369869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:15:12 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-1f024225-f75c-4c86-b98f-af2fe03b8764 tempest-VolumeDependencyTests-1769369869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:15:12 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-1f024225-f75c-4c86-b98f-af2fe03b8764 tempest-VolumeDependencyTests-1769369869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:15:12 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-1f024225-f75c-4c86-b98f-af2fe03b8764 tempest-VolumeDependencyTests-1769369869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:15:12 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-1f024225-f75c-4c86-b98f-af2fe03b8764 tempest-VolumeDependencyTests-1769369869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:15:12 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-1f024225-f75c-4c86-b98f-af2fe03b8764 tempest-VolumeDependencyTests-1769369869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:12 devstack sudo[90848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:15:12 devstack sudo[90848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:12 devstack sudo[90844]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:12 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-7ac33d15-9a98-49d5-89b1-35548a03a0b8 tempest-CreateVolumesFromSnapshotTest-1272343304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c91094bc-4d90-46ea-b2d9-7a2db6900acb" returned: 0 in 0.458s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:12 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-7ac33d15-9a98-49d5-89b1-35548a03a0b8 tempest-CreateVolumesFromSnapshotTest-1272343304 None] <== create_volume: return (1019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'} {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 15:15:12 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-7ac33d15-9a98-49d5-89b1-35548a03a0b8 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.023s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:15:12 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-99fd8814-776f-444e-9fa6-d9249451914c tempest-CreateVolumesFromSnapshotTest-1272343304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.151s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:15:12 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-99fd8814-776f-444e-9fa6-d9249451914c tempest-CreateVolumesFromSnapshotTest-1272343304 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:15:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-699713536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47c5ac9a-5ca4-488f-b084-67a2b8508edf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67db5101aca74e2493d47e4bf32c1892',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:15:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:15:05Z,use_quota=True,user_id='461fefe546444a57bda769f210b6858e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)}" {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 15:15:12 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-99fd8814-776f-444e-9fa6-d9249451914c tempest-CreateVolumesFromSnapshotTest-1272343304 None] Creating volume 47c5ac9a-5ca4-488f-b084-67a2b8508edf {{(pid=82756) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 15:15:12 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-99fd8814-776f-444e-9fa6-d9249451914c tempest-CreateVolumesFromSnapshotTest-1272343304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:15:12 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-99fd8814-776f-444e-9fa6-d9249451914c tempest-CreateVolumesFromSnapshotTest-1272343304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:15:12 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-99fd8814-776f-444e-9fa6-d9249451914c tempest-CreateVolumesFromSnapshotTest-1272343304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:15:12 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-99fd8814-776f-444e-9fa6-d9249451914c tempest-CreateVolumesFromSnapshotTest-1272343304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:15:12 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-99fd8814-776f-444e-9fa6-d9249451914c tempest-CreateVolumesFromSnapshotTest-1272343304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:15:12 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-99fd8814-776f-444e-9fa6-d9249451914c tempest-CreateVolumesFromSnapshotTest-1272343304 None] Selected osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 as target Quobyte volume. {{(pid=82756) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 15:15:12 devstack cinder-volume[82756]: INFO cinder.volume.drivers.remotefs [None req-99fd8814-776f-444e-9fa6-d9249451914c tempest-CreateVolumesFromSnapshotTest-1272343304 None] casted to osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 Apr 16 15:15:12 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-99fd8814-776f-444e-9fa6-d9249451914c tempest-CreateVolumesFromSnapshotTest-1272343304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-47c5ac9a-5ca4-488f-b084-67a2b8508edf 1073741824 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:12 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-7ac33d15-9a98-49d5-89b1-35548a03a0b8 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (438e418b-3fcf-405d-8a18-35d083907336) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c91094bc-4d90-46ea-b2d9-7a2db6900acb', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:15:12 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-7ac33d15-9a98-49d5-89b1-35548a03a0b8 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2299167f-5b43-4c39-925b-d6012b915281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:15:12 devstack sudo[90850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-47c5ac9a-5ca4-488f-b084-67a2b8508edf 1073741824 Apr 16 15:15:12 devstack sudo[90850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:12 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-7ac33d15-9a98-49d5-89b1-35548a03a0b8 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Volume volume-c91094bc-4d90-46ea-b2d9-7a2db6900acb (c91094bc-4d90-46ea-b2d9-7a2db6900acb): created successfully Apr 16 15:15:12 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-7ac33d15-9a98-49d5-89b1-35548a03a0b8 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2299167f-5b43-4c39-925b-d6012b915281) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:15:12 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-7ac33d15-9a98-49d5-89b1-35548a03a0b8 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Flow 'volume_create_manager' (be46b58e-0ee9-485c-881d-b794c079e316) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:15:12 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-7ac33d15-9a98-49d5-89b1-35548a03a0b8 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Created volume successfully. Apr 16 15:15:12 devstack sudo[90848]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:12 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-1f024225-f75c-4c86-b98f-af2fe03b8764 tempest-VolumeDependencyTests-1769369869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.418s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:12 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-1f024225-f75c-4c86-b98f-af2fe03b8764 tempest-VolumeDependencyTests-1769369869 None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:15:12 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-1f024225-f75c-4c86-b98f-af2fe03b8764 tempest-VolumeDependencyTests-1769369869 None] Deleted volume successfully. Apr 16 15:15:12 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-1f024225-f75c-4c86-b98f-af2fe03b8764 tempest-VolumeDependencyTests-1769369869 None] Lock "cinder-35d57e9c-82cf-4ca4-a6c7-4a0773ac88e4-delete_volume" released by "delete_volume" :: held 1.594s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:15:12 devstack sudo[90850]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:12 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-99fd8814-776f-444e-9fa6-d9249451914c tempest-CreateVolumesFromSnapshotTest-1272343304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-47c5ac9a-5ca4-488f-b084-67a2b8508edf 1073741824" returned: 0 in 0.508s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:12 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-99fd8814-776f-444e-9fa6-d9249451914c tempest-CreateVolumesFromSnapshotTest-1272343304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-47c5ac9a-5ca4-488f-b084-67a2b8508edf {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:12 devstack sudo[90856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-47c5ac9a-5ca4-488f-b084-67a2b8508edf Apr 16 15:15:12 devstack sudo[90856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:13 devstack sudo[90856]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:13 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-99fd8814-776f-444e-9fa6-d9249451914c tempest-CreateVolumesFromSnapshotTest-1272343304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-47c5ac9a-5ca4-488f-b084-67a2b8508edf" returned: 0 in 0.451s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:13 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-99fd8814-776f-444e-9fa6-d9249451914c tempest-CreateVolumesFromSnapshotTest-1272343304 None] <== create_volume: return (989ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'} {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 15:15:13 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-99fd8814-776f-444e-9fa6-d9249451914c tempest-CreateVolumesFromSnapshotTest-1272343304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.992s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:15:13 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-98ef0bfb-48dc-4e06-9143-a813f8dd18f1 tempest-SnapshotDependencyTests-858447260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.908s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:15:13 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-99fd8814-776f-444e-9fa6-d9249451914c tempest-CreateVolumesFromSnapshotTest-1272343304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecc9037c-99cf-4193-bde4-f4cfb2af6d61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47c5ac9a-5ca4-488f-b084-67a2b8508edf', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:15:13 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-99fd8814-776f-444e-9fa6-d9249451914c tempest-CreateVolumesFromSnapshotTest-1272343304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d076970-5268-486c-bca5-67dc142b6aa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:15:13 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-98ef0bfb-48dc-4e06-9143-a813f8dd18f1 tempest-SnapshotDependencyTests-858447260 None] Creating offline snapshot 8e40ff69-9bff-4660-8807-885f971f06fb of volume 386dcbae-cb25-4737-8aeb-cfee8921c168 {{(pid=82756) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 16 15:15:13 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-99fd8814-776f-444e-9fa6-d9249451914c tempest-CreateVolumesFromSnapshotTest-1272343304 None] Volume volume-47c5ac9a-5ca4-488f-b084-67a2b8508edf (47c5ac9a-5ca4-488f-b084-67a2b8508edf): created successfully Apr 16 15:15:13 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-99fd8814-776f-444e-9fa6-d9249451914c tempest-CreateVolumesFromSnapshotTest-1272343304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d076970-5268-486c-bca5-67dc142b6aa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:15:13 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-99fd8814-776f-444e-9fa6-d9249451914c tempest-CreateVolumesFromSnapshotTest-1272343304 None] Flow 'volume_create_manager' (3f3ed89b-a986-4936-b694-55dca5fec623) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:15:13 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[a37bc433-29da-452b-8aa6-a0e4089c3b4e]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:15:13 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-98ef0bfb-48dc-4e06-9143-a813f8dd18f1 tempest-SnapshotDependencyTests-858447260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-386dcbae-cb25-4737-8aeb-cfee8921c168 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:13 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-99fd8814-776f-444e-9fa6-d9249451914c tempest-CreateVolumesFromSnapshotTest-1272343304 None] Created volume successfully. Apr 16 15:15:13 devstack sudo[90859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-386dcbae-cb25-4737-8aeb-cfee8921c168 Apr 16 15:15:13 devstack sudo[90859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:13 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [None req-34bc2765-31f2-4efb-a978-5bfd89c44ca6 tempest-VolumeDependencyTests-1769369869 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82756) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 15:15:13 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-34bc2765-31f2-4efb-a978-5bfd89c44ca6 tempest-VolumeDependencyTests-1769369869 None] Flow 'volume_create_manager' (76e68215-bac1-414b-8421-fa5aed5f727b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:15:13 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-34bc2765-31f2-4efb-a978-5bfd89c44ca6 tempest-VolumeDependencyTests-1769369869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (575a8570-9dd9-493f-94fc-827ac54d2538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:15:13 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-34bc2765-31f2-4efb-a978-5bfd89c44ca6 tempest-VolumeDependencyTests-1769369869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (575a8570-9dd9-493f-94fc-827ac54d2538) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:15:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1595172168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bc2e54d-6a3a-4640-ace4-bfddd5a56056,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2465b74888c74c608190b15eb478a3e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:15:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:15:13Z,use_quota=True,user_id='bbe844468df24b8bb78f9c30c795001c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:15:13 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-34bc2765-31f2-4efb-a978-5bfd89c44ca6 tempest-VolumeDependencyTests-1769369869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3579c00d-dda9-4b51-8590-e731409daf1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:15:13 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-34bc2765-31f2-4efb-a978-5bfd89c44ca6 tempest-VolumeDependencyTests-1769369869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3579c00d-dda9-4b51-8590-e731409daf1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:15:13 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-34bc2765-31f2-4efb-a978-5bfd89c44ca6 tempest-VolumeDependencyTests-1769369869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (044fa13b-a1fe-4f54-b46a-195f628404bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:15:13 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-34bc2765-31f2-4efb-a978-5bfd89c44ca6 tempest-VolumeDependencyTests-1769369869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (044fa13b-a1fe-4f54-b46a-195f628404bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2bc2e54d-6a3a-4640-ace4-bfddd5a56056', 'volume_name': 'volume-2bc2e54d-6a3a-4640-ace4-bfddd5a56056', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:15:13 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-34bc2765-31f2-4efb-a978-5bfd89c44ca6 tempest-VolumeDependencyTests-1769369869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdb11f6b-001e-4171-9bb2-b22483d33dd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:15:13 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-34bc2765-31f2-4efb-a978-5bfd89c44ca6 tempest-VolumeDependencyTests-1769369869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdb11f6b-001e-4171-9bb2-b22483d33dd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:15:13 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-34bc2765-31f2-4efb-a978-5bfd89c44ca6 tempest-VolumeDependencyTests-1769369869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ceae122-4e2d-4cb7-8d7b-a4f2f08b7561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:15:13 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-34bc2765-31f2-4efb-a978-5bfd89c44ca6 tempest-VolumeDependencyTests-1769369869 None] Volume 2bc2e54d-6a3a-4640-ace4-bfddd5a56056: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2bc2e54d-6a3a-4640-ace4-bfddd5a56056', 'volume_size': 1} Apr 16 15:15:13 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-34bc2765-31f2-4efb-a978-5bfd89c44ca6 tempest-VolumeDependencyTests-1769369869 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:15:13 devstack sudo[90859]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:13 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-98ef0bfb-48dc-4e06-9143-a813f8dd18f1 tempest-SnapshotDependencyTests-858447260 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-386dcbae-cb25-4737-8aeb-cfee8921c168" returned: 0 in 0.494s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:13 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-98ef0bfb-48dc-4e06-9143-a813f8dd18f1 tempest-SnapshotDependencyTests-858447260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-386dcbae-cb25-4737-8aeb-cfee8921c168,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-386dcbae-cb25-4737-8aeb-cfee8921c168.8e40ff69-9bff-4660-8807-885f971f06fb 1G {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:13 devstack sudo[90865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-386dcbae-cb25-4737-8aeb-cfee8921c168,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-386dcbae-cb25-4737-8aeb-cfee8921c168.8e40ff69-9bff-4660-8807-885f971f06fb 1G Apr 16 15:15:13 devstack sudo[90865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:14 devstack sudo[90865]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:14 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-98ef0bfb-48dc-4e06-9143-a813f8dd18f1 tempest-SnapshotDependencyTests-858447260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-386dcbae-cb25-4737-8aeb-cfee8921c168,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-386dcbae-cb25-4737-8aeb-cfee8921c168.8e40ff69-9bff-4660-8807-885f971f06fb 1G" returned: 0 in 0.476s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:14 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-98ef0bfb-48dc-4e06-9143-a813f8dd18f1 tempest-SnapshotDependencyTests-858447260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-386dcbae-cb25-4737-8aeb-cfee8921c168 -F qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-386dcbae-cb25-4737-8aeb-cfee8921c168.8e40ff69-9bff-4660-8807-885f971f06fb {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:14 devstack sudo[90870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-386dcbae-cb25-4737-8aeb-cfee8921c168 -F qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-386dcbae-cb25-4737-8aeb-cfee8921c168.8e40ff69-9bff-4660-8807-885f971f06fb Apr 16 15:15:14 devstack sudo[90870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:14 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-5f428b4d-b760-417e-82d2-8f5c36f88eff tempest-CreateVolumesFromSnapshotTest-1272343304 None] Acquiring lock "cinder-47c5ac9a-5ca4-488f-b084-67a2b8508edf-delete_volume" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:15:14 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-5f428b4d-b760-417e-82d2-8f5c36f88eff tempest-CreateVolumesFromSnapshotTest-1272343304 None] Lock "cinder-47c5ac9a-5ca4-488f-b084-67a2b8508edf-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:15:14 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-5f428b4d-b760-417e-82d2-8f5c36f88eff tempest-CreateVolumesFromSnapshotTest-1272343304 None] Acquiring lock "cinder-quobyte-47c5ac9a-5ca4-488f-b084-67a2b8508edf" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:15:14 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-5f428b4d-b760-417e-82d2-8f5c36f88eff tempest-CreateVolumesFromSnapshotTest-1272343304 None] Lock "cinder-quobyte-47c5ac9a-5ca4-488f-b084-67a2b8508edf" acquired by "delete_volume" :: waited 0.009s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:15:14 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[60f13fbd-9662-40a3-8671-fa73dbbf2b78]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:15:14 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-5f428b4d-b760-417e-82d2-8f5c36f88eff tempest-CreateVolumesFromSnapshotTest-1272343304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-47c5ac9a-5ca4-488f-b084-67a2b8508edf {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:14 devstack sudo[90872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-47c5ac9a-5ca4-488f-b084-67a2b8508edf Apr 16 15:15:14 devstack sudo[90872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:14 devstack sudo[90870]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:14 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-98ef0bfb-48dc-4e06-9143-a813f8dd18f1 tempest-SnapshotDependencyTests-858447260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-386dcbae-cb25-4737-8aeb-cfee8921c168 -F qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-386dcbae-cb25-4737-8aeb-cfee8921c168.8e40ff69-9bff-4660-8807-885f971f06fb" returned: 0 in 0.488s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:14 devstack cinder-volume[82756]: WARNING cinder.volume.drivers.remotefs [None req-98ef0bfb-48dc-4e06-9143-a813f8dd18f1 tempest-SnapshotDependencyTests-858447260 None] /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-386dcbae-cb25-4737-8aeb-cfee8921c168.8e40ff69-9bff-4660-8807-885f971f06fb is being set with open permissions: ugo+rw Apr 16 15:15:14 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-98ef0bfb-48dc-4e06-9143-a813f8dd18f1 tempest-SnapshotDependencyTests-858447260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-386dcbae-cb25-4737-8aeb-cfee8921c168.8e40ff69-9bff-4660-8807-885f971f06fb {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:14 devstack sudo[90879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-386dcbae-cb25-4737-8aeb-cfee8921c168.8e40ff69-9bff-4660-8807-885f971f06fb Apr 16 15:15:14 devstack sudo[90879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:14 devstack sudo[90872]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:14 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-5f428b4d-b760-417e-82d2-8f5c36f88eff tempest-CreateVolumesFromSnapshotTest-1272343304 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-47c5ac9a-5ca4-488f-b084-67a2b8508edf" returned: 0 in 0.528s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:14 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-5f428b4d-b760-417e-82d2-8f5c36f88eff tempest-CreateVolumesFromSnapshotTest-1272343304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-47c5ac9a-5ca4-488f-b084-67a2b8508edf {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:14 devstack sudo[90884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-47c5ac9a-5ca4-488f-b084-67a2b8508edf Apr 16 15:15:14 devstack sudo[90884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:15 devstack sudo[90879]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:15 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-98ef0bfb-48dc-4e06-9143-a813f8dd18f1 tempest-SnapshotDependencyTests-858447260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-386dcbae-cb25-4737-8aeb-cfee8921c168.8e40ff69-9bff-4660-8807-885f971f06fb" returned: 0 in 0.466s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:15 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-98ef0bfb-48dc-4e06-9143-a813f8dd18f1 tempest-SnapshotDependencyTests-858447260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-386dcbae-cb25-4737-8aeb-cfee8921c168.info {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:15 devstack sudo[90888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-386dcbae-cb25-4737-8aeb-cfee8921c168.info Apr 16 15:15:15 devstack sudo[90888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:15 devstack sudo[90884]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:15 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-5f428b4d-b760-417e-82d2-8f5c36f88eff tempest-CreateVolumesFromSnapshotTest-1272343304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-47c5ac9a-5ca4-488f-b084-67a2b8508edf" returned: 0 in 0.413s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:15 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-5f428b4d-b760-417e-82d2-8f5c36f88eff tempest-CreateVolumesFromSnapshotTest-1272343304 None] Lock "cinder-quobyte-47c5ac9a-5ca4-488f-b084-67a2b8508edf" released by "delete_volume" :: held 0.962s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:15:15 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-5f428b4d-b760-417e-82d2-8f5c36f88eff tempest-CreateVolumesFromSnapshotTest-1272343304 None] Created reservations ['72533982-095f-4245-b6df-0d793dd525a1', 'e6724193-1abc-43a8-9a1c-088d7b328b33', '78273095-d0d1-4b58-8589-61b6d7835aea', 'ea4a3f19-5abd-4ecf-b6ea-9b387f590ee0'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:15:15 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-5f428b4d-b760-417e-82d2-8f5c36f88eff tempest-CreateVolumesFromSnapshotTest-1272343304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:15:15 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-5f428b4d-b760-417e-82d2-8f5c36f88eff tempest-CreateVolumesFromSnapshotTest-1272343304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:15:15 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-5f428b4d-b760-417e-82d2-8f5c36f88eff tempest-CreateVolumesFromSnapshotTest-1272343304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:15:15 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-5f428b4d-b760-417e-82d2-8f5c36f88eff tempest-CreateVolumesFromSnapshotTest-1272343304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:15:15 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-5f428b4d-b760-417e-82d2-8f5c36f88eff tempest-CreateVolumesFromSnapshotTest-1272343304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:15:15 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-5f428b4d-b760-417e-82d2-8f5c36f88eff tempest-CreateVolumesFromSnapshotTest-1272343304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:15 devstack sudo[90890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:15:15 devstack sudo[90890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:15 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-507db890-cd1d-4ce8-9f81-9f1cf442e956 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Acquiring lock "cinder-c91094bc-4d90-46ea-b2d9-7a2db6900acb-delete_volume" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:15:15 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-507db890-cd1d-4ce8-9f81-9f1cf442e956 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Lock "cinder-c91094bc-4d90-46ea-b2d9-7a2db6900acb-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:15:15 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-507db890-cd1d-4ce8-9f81-9f1cf442e956 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Acquiring lock "cinder-quobyte-c91094bc-4d90-46ea-b2d9-7a2db6900acb" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:15:15 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-507db890-cd1d-4ce8-9f81-9f1cf442e956 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Lock "cinder-quobyte-c91094bc-4d90-46ea-b2d9-7a2db6900acb" acquired by "delete_volume" :: waited 0.008s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:15:15 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[516854ee-f772-4659-a813-2b22fa37d517]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:15:15 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-507db890-cd1d-4ce8-9f81-9f1cf442e956 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c91094bc-4d90-46ea-b2d9-7a2db6900acb {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:15 devstack sudo[90892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c91094bc-4d90-46ea-b2d9-7a2db6900acb Apr 16 15:15:15 devstack sudo[90892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:15 devstack sudo[90888]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:15 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-98ef0bfb-48dc-4e06-9143-a813f8dd18f1 tempest-SnapshotDependencyTests-858447260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-386dcbae-cb25-4737-8aeb-cfee8921c168.info" returned: 0 in 0.484s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:15 devstack cinder-volume[82756]: WARNING cinder.volume.drivers.remotefs [None req-98ef0bfb-48dc-4e06-9143-a813f8dd18f1 tempest-SnapshotDependencyTests-858447260 None] /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-386dcbae-cb25-4737-8aeb-cfee8921c168.info is being set with open permissions: ugo+rw Apr 16 15:15:15 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-98ef0bfb-48dc-4e06-9143-a813f8dd18f1 tempest-SnapshotDependencyTests-858447260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-386dcbae-cb25-4737-8aeb-cfee8921c168.info {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:15 devstack sudo[90895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-386dcbae-cb25-4737-8aeb-cfee8921c168.info Apr 16 15:15:15 devstack sudo[90895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:15 devstack sudo[90890]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:15 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-5f428b4d-b760-417e-82d2-8f5c36f88eff tempest-CreateVolumesFromSnapshotTest-1272343304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.451s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:15 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-5f428b4d-b760-417e-82d2-8f5c36f88eff tempest-CreateVolumesFromSnapshotTest-1272343304 None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:15:15 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-5f428b4d-b760-417e-82d2-8f5c36f88eff tempest-CreateVolumesFromSnapshotTest-1272343304 None] Deleted volume successfully. Apr 16 15:15:15 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-5f428b4d-b760-417e-82d2-8f5c36f88eff tempest-CreateVolumesFromSnapshotTest-1272343304 None] Lock "cinder-47c5ac9a-5ca4-488f-b084-67a2b8508edf-delete_volume" released by "delete_volume" :: held 1.545s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:15:16 devstack sudo[90892]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:16 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-507db890-cd1d-4ce8-9f81-9f1cf442e956 tempest-CreateVolumesFromSnapshotTest-1272343304 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c91094bc-4d90-46ea-b2d9-7a2db6900acb" returned: 0 in 0.499s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:16 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-507db890-cd1d-4ce8-9f81-9f1cf442e956 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c91094bc-4d90-46ea-b2d9-7a2db6900acb {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:16 devstack sudo[90901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c91094bc-4d90-46ea-b2d9-7a2db6900acb Apr 16 15:15:16 devstack sudo[90901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:16 devstack sudo[90895]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:16 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-98ef0bfb-48dc-4e06-9143-a813f8dd18f1 tempest-SnapshotDependencyTests-858447260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-386dcbae-cb25-4737-8aeb-cfee8921c168.info" returned: 0 in 0.444s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:16 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-98ef0bfb-48dc-4e06-9143-a813f8dd18f1 tempest-SnapshotDependencyTests-858447260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.939s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:15:16 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-19f83311-0444-41e7-b418-68da05761791 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.377s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:15:16 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-19f83311-0444-41e7-b418-68da05761791 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:15:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-973650539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4388773e-4726-4acc-8942-6470dec07d29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19556a2b539946c1ab8a738718adb68d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:15:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:15:10Z,use_quota=True,user_id='a7c6856e1be54beea670dbbd9950ee83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)}" {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 15:15:16 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-19f83311-0444-41e7-b418-68da05761791 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Creating volume 4388773e-4726-4acc-8942-6470dec07d29 {{(pid=82756) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 15:15:16 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-19f83311-0444-41e7-b418-68da05761791 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:15:16 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-19f83311-0444-41e7-b418-68da05761791 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:15:16 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-19f83311-0444-41e7-b418-68da05761791 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:15:16 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-19f83311-0444-41e7-b418-68da05761791 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:15:16 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-19f83311-0444-41e7-b418-68da05761791 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:15:16 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-19f83311-0444-41e7-b418-68da05761791 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Selected osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 as target Quobyte volume. {{(pid=82756) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 15:15:16 devstack cinder-volume[82756]: INFO cinder.volume.drivers.remotefs [None req-19f83311-0444-41e7-b418-68da05761791 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] casted to osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 Apr 16 15:15:16 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-19f83311-0444-41e7-b418-68da05761791 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-4388773e-4726-4acc-8942-6470dec07d29 1073741824 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:16 devstack sudo[90904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-4388773e-4726-4acc-8942-6470dec07d29 1073741824 Apr 16 15:15:16 devstack sudo[90904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:16 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-98ef0bfb-48dc-4e06-9143-a813f8dd18f1 tempest-SnapshotDependencyTests-858447260 None] Create snapshot completed successfully Apr 16 15:15:16 devstack sudo[90901]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:16 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-507db890-cd1d-4ce8-9f81-9f1cf442e956 tempest-CreateVolumesFromSnapshotTest-1272343304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-c91094bc-4d90-46ea-b2d9-7a2db6900acb" returned: 0 in 0.408s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:16 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-507db890-cd1d-4ce8-9f81-9f1cf442e956 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Lock "cinder-quobyte-c91094bc-4d90-46ea-b2d9-7a2db6900acb" released by "delete_volume" :: held 0.936s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:15:16 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-507db890-cd1d-4ce8-9f81-9f1cf442e956 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Created reservations ['7ba2cc1f-aba7-4dad-b1bc-6bed5bbccc2e', '0308dc06-0f0b-4422-bc49-3bf6008da66b', 'af041bcc-6af1-4bf9-9237-8e11224f5eb4', '7c159bfa-f153-4c94-8c33-6b3510e5cf0f'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:15:16 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-507db890-cd1d-4ce8-9f81-9f1cf442e956 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:15:16 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-507db890-cd1d-4ce8-9f81-9f1cf442e956 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:15:16 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-507db890-cd1d-4ce8-9f81-9f1cf442e956 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:15:16 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-507db890-cd1d-4ce8-9f81-9f1cf442e956 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:15:16 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-507db890-cd1d-4ce8-9f81-9f1cf442e956 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:15:16 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-507db890-cd1d-4ce8-9f81-9f1cf442e956 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:16 devstack sudo[90907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:15:16 devstack sudo[90907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:16 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-abc3bd8a-7adc-4284-96f4-68849a873f7a tempest-CreateVolumesFromSnapshotTest-1272343304 None] Acquiring lock "cinder-80d004c0-6ecb-456b-a55d-e1d8652015b7-delete_volume" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:15:16 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-abc3bd8a-7adc-4284-96f4-68849a873f7a tempest-CreateVolumesFromSnapshotTest-1272343304 None] Lock "cinder-80d004c0-6ecb-456b-a55d-e1d8652015b7-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:15:16 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-abc3bd8a-7adc-4284-96f4-68849a873f7a tempest-CreateVolumesFromSnapshotTest-1272343304 None] Acquiring lock "cinder-quobyte-80d004c0-6ecb-456b-a55d-e1d8652015b7" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:15:16 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-abc3bd8a-7adc-4284-96f4-68849a873f7a tempest-CreateVolumesFromSnapshotTest-1272343304 None] Lock "cinder-quobyte-80d004c0-6ecb-456b-a55d-e1d8652015b7" acquired by "delete_volume" :: waited 0.009s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:15:16 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[134a530d-7e43-4a06-8321-60796d3dbf11]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:15:16 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-abc3bd8a-7adc-4284-96f4-68849a873f7a tempest-CreateVolumesFromSnapshotTest-1272343304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-80d004c0-6ecb-456b-a55d-e1d8652015b7 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:16 devstack sudo[90912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-80d004c0-6ecb-456b-a55d-e1d8652015b7 Apr 16 15:15:16 devstack sudo[90912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:16 devstack sudo[90904]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:16 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-19f83311-0444-41e7-b418-68da05761791 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-4388773e-4726-4acc-8942-6470dec07d29 1073741824" returned: 0 in 0.577s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:16 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-19f83311-0444-41e7-b418-68da05761791 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-4388773e-4726-4acc-8942-6470dec07d29 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:16 devstack sudo[90914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-4388773e-4726-4acc-8942-6470dec07d29 Apr 16 15:15:16 devstack sudo[90914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:17 devstack sudo[90907]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:17 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-507db890-cd1d-4ce8-9f81-9f1cf442e956 tempest-CreateVolumesFromSnapshotTest-1272343304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.530s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:17 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-507db890-cd1d-4ce8-9f81-9f1cf442e956 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:15:17 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-507db890-cd1d-4ce8-9f81-9f1cf442e956 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Deleted volume successfully. Apr 16 15:15:17 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-507db890-cd1d-4ce8-9f81-9f1cf442e956 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Lock "cinder-c91094bc-4d90-46ea-b2d9-7a2db6900acb-delete_volume" released by "delete_volume" :: held 1.592s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:15:17 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e0f4385-0fa3-4bf2-8fd7-bbc4fdc0f1b3 tempest-SnapshotDependencyTests-858447260 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82756) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 15:15:17 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-5e0f4385-0fa3-4bf2-8fd7-bbc4fdc0f1b3 tempest-SnapshotDependencyTests-858447260 None] Flow 'volume_create_manager' (201f8406-f0bc-46cc-8649-156a99eca0c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:15:17 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-5e0f4385-0fa3-4bf2-8fd7-bbc4fdc0f1b3 tempest-SnapshotDependencyTests-858447260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30382987-1051-4cfa-a8b5-937de2fc5772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:15:17 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-5e0f4385-0fa3-4bf2-8fd7-bbc4fdc0f1b3 tempest-SnapshotDependencyTests-858447260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30382987-1051-4cfa-a8b5-937de2fc5772) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:15:17Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=766518cd-40f1-4e5e-a590-cca5ef04ea08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcf35c7972cc455a89f699dcbe307a69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:15:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8e40ff69-9bff-4660-8807-885f971f06fb,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:15:17Z,use_quota=True,user_id='3a728be3f00f44b889ff7ea60d57ae06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:15:17 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-5e0f4385-0fa3-4bf2-8fd7-bbc4fdc0f1b3 tempest-SnapshotDependencyTests-858447260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e955b7f-e1a6-4d5b-b7f4-56f0da3b250d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:15:17 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-5e0f4385-0fa3-4bf2-8fd7-bbc4fdc0f1b3 tempest-SnapshotDependencyTests-858447260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e955b7f-e1a6-4d5b-b7f4-56f0da3b250d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:15:17 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-5e0f4385-0fa3-4bf2-8fd7-bbc4fdc0f1b3 tempest-SnapshotDependencyTests-858447260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1777304-9c73-4c8d-a161-d84c9693f1fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:15:17 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-5e0f4385-0fa3-4bf2-8fd7-bbc4fdc0f1b3 tempest-SnapshotDependencyTests-858447260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1777304-9c73-4c8d-a161-d84c9693f1fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '766518cd-40f1-4e5e-a590-cca5ef04ea08', 'volume_name': 'volume-766518cd-40f1-4e5e-a590-cca5ef04ea08', 'volume_size': 1, 'snapshot_id': '8e40ff69-9bff-4660-8807-885f971f06fb'}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:15:17 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-5e0f4385-0fa3-4bf2-8fd7-bbc4fdc0f1b3 tempest-SnapshotDependencyTests-858447260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32e2ea78-60f7-48d5-9297-c8e74c8c39c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:15:17 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-5e0f4385-0fa3-4bf2-8fd7-bbc4fdc0f1b3 tempest-SnapshotDependencyTests-858447260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32e2ea78-60f7-48d5-9297-c8e74c8c39c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:15:17 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-5e0f4385-0fa3-4bf2-8fd7-bbc4fdc0f1b3 tempest-SnapshotDependencyTests-858447260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f598075-ab9d-44ea-9723-4d03c0a8515f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:15:17 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-5e0f4385-0fa3-4bf2-8fd7-bbc4fdc0f1b3 tempest-SnapshotDependencyTests-858447260 None] Volume 766518cd-40f1-4e5e-a590-cca5ef04ea08: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-766518cd-40f1-4e5e-a590-cca5ef04ea08', 'volume_size': 1, 'snapshot_id': '8e40ff69-9bff-4660-8807-885f971f06fb'} Apr 16 15:15:17 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-5e0f4385-0fa3-4bf2-8fd7-bbc4fdc0f1b3 tempest-SnapshotDependencyTests-858447260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:15:17 devstack sudo[90912]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:17 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-abc3bd8a-7adc-4284-96f4-68849a873f7a tempest-CreateVolumesFromSnapshotTest-1272343304 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-80d004c0-6ecb-456b-a55d-e1d8652015b7" returned: 0 in 0.577s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:17 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-abc3bd8a-7adc-4284-96f4-68849a873f7a tempest-CreateVolumesFromSnapshotTest-1272343304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-80d004c0-6ecb-456b-a55d-e1d8652015b7 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:17 devstack sudo[90921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-80d004c0-6ecb-456b-a55d-e1d8652015b7 Apr 16 15:15:17 devstack sudo[90921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:17 devstack sudo[90914]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:17 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-19f83311-0444-41e7-b418-68da05761791 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-4388773e-4726-4acc-8942-6470dec07d29" returned: 0 in 0.492s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:17 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-19f83311-0444-41e7-b418-68da05761791 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] <== create_volume: return (1095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'} {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 15:15:17 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-19f83311-0444-41e7-b418-68da05761791 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.098s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:15:17 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-34bc2765-31f2-4efb-a978-5bfd89c44ca6 tempest-VolumeDependencyTests-1769369869 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.805s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:15:17 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-34bc2765-31f2-4efb-a978-5bfd89c44ca6 tempest-VolumeDependencyTests-1769369869 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:15:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1595172168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bc2e54d-6a3a-4640-ace4-bfddd5a56056,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2465b74888c74c608190b15eb478a3e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:15:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:15:13Z,use_quota=True,user_id='bbe844468df24b8bb78f9c30c795001c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)}" {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 15:15:17 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-34bc2765-31f2-4efb-a978-5bfd89c44ca6 tempest-VolumeDependencyTests-1769369869 None] Creating volume 2bc2e54d-6a3a-4640-ace4-bfddd5a56056 {{(pid=82756) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 15:15:17 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-34bc2765-31f2-4efb-a978-5bfd89c44ca6 tempest-VolumeDependencyTests-1769369869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:15:17 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-34bc2765-31f2-4efb-a978-5bfd89c44ca6 tempest-VolumeDependencyTests-1769369869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:15:17 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-34bc2765-31f2-4efb-a978-5bfd89c44ca6 tempest-VolumeDependencyTests-1769369869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:15:17 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-34bc2765-31f2-4efb-a978-5bfd89c44ca6 tempest-VolumeDependencyTests-1769369869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:15:17 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-34bc2765-31f2-4efb-a978-5bfd89c44ca6 tempest-VolumeDependencyTests-1769369869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:15:17 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-34bc2765-31f2-4efb-a978-5bfd89c44ca6 tempest-VolumeDependencyTests-1769369869 None] Selected osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 as target Quobyte volume. {{(pid=82756) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 15:15:17 devstack cinder-volume[82756]: INFO cinder.volume.drivers.remotefs [None req-34bc2765-31f2-4efb-a978-5bfd89c44ca6 tempest-VolumeDependencyTests-1769369869 None] casted to osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 Apr 16 15:15:17 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-34bc2765-31f2-4efb-a978-5bfd89c44ca6 tempest-VolumeDependencyTests-1769369869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2bc2e54d-6a3a-4640-ace4-bfddd5a56056 1073741824 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:17 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-19f83311-0444-41e7-b418-68da05761791 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfd7a5a0-f8ab-4a46-bafa-47cdb60dc3bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4388773e-4726-4acc-8942-6470dec07d29', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:15:17 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-19f83311-0444-41e7-b418-68da05761791 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61e51a07-2020-4239-9670-dcc29e5cce15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:15:17 devstack sudo[90923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2bc2e54d-6a3a-4640-ace4-bfddd5a56056 1073741824 Apr 16 15:15:17 devstack sudo[90923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:17 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-19f83311-0444-41e7-b418-68da05761791 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Volume volume-4388773e-4726-4acc-8942-6470dec07d29 (4388773e-4726-4acc-8942-6470dec07d29): created successfully Apr 16 15:15:17 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-19f83311-0444-41e7-b418-68da05761791 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61e51a07-2020-4239-9670-dcc29e5cce15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:15:17 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-19f83311-0444-41e7-b418-68da05761791 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Flow 'volume_create_manager' (c70da7ec-9840-4fcd-b8f9-fa6196c19c5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:15:17 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-19f83311-0444-41e7-b418-68da05761791 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Created volume successfully. Apr 16 15:15:17 devstack sudo[90921]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:17 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-abc3bd8a-7adc-4284-96f4-68849a873f7a tempest-CreateVolumesFromSnapshotTest-1272343304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-80d004c0-6ecb-456b-a55d-e1d8652015b7" returned: 0 in 0.493s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:17 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-abc3bd8a-7adc-4284-96f4-68849a873f7a tempest-CreateVolumesFromSnapshotTest-1272343304 None] Lock "cinder-quobyte-80d004c0-6ecb-456b-a55d-e1d8652015b7" released by "delete_volume" :: held 1.090s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:15:17 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-abc3bd8a-7adc-4284-96f4-68849a873f7a tempest-CreateVolumesFromSnapshotTest-1272343304 None] Created reservations ['edc8db78-2b26-48cd-b42d-c1517dc6e9b0', '38efe933-ba16-438e-8b0b-22a770482abb', '0dc33bb5-7a46-41b6-ad77-e3c8e9c64497', 'dfa3f48a-5965-448f-b1c8-13bd6805d5fa'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:15:17 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-abc3bd8a-7adc-4284-96f4-68849a873f7a tempest-CreateVolumesFromSnapshotTest-1272343304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:15:17 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-abc3bd8a-7adc-4284-96f4-68849a873f7a tempest-CreateVolumesFromSnapshotTest-1272343304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:15:17 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-abc3bd8a-7adc-4284-96f4-68849a873f7a tempest-CreateVolumesFromSnapshotTest-1272343304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:15:17 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-abc3bd8a-7adc-4284-96f4-68849a873f7a tempest-CreateVolumesFromSnapshotTest-1272343304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:15:17 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-abc3bd8a-7adc-4284-96f4-68849a873f7a tempest-CreateVolumesFromSnapshotTest-1272343304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:15:17 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-abc3bd8a-7adc-4284-96f4-68849a873f7a tempest-CreateVolumesFromSnapshotTest-1272343304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:17 devstack sudo[90929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:15:17 devstack sudo[90929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:17 devstack sudo[90923]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:17 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-34bc2765-31f2-4efb-a978-5bfd89c44ca6 tempest-VolumeDependencyTests-1769369869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2bc2e54d-6a3a-4640-ace4-bfddd5a56056 1073741824" returned: 0 in 0.548s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:17 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-34bc2765-31f2-4efb-a978-5bfd89c44ca6 tempest-VolumeDependencyTests-1769369869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2bc2e54d-6a3a-4640-ace4-bfddd5a56056 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:17 devstack sudo[90931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2bc2e54d-6a3a-4640-ace4-bfddd5a56056 Apr 16 15:15:17 devstack sudo[90931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:18 devstack sudo[90929]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:18 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-abc3bd8a-7adc-4284-96f4-68849a873f7a tempest-CreateVolumesFromSnapshotTest-1272343304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.467s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:18 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-abc3bd8a-7adc-4284-96f4-68849a873f7a tempest-CreateVolumesFromSnapshotTest-1272343304 None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:15:18 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-abc3bd8a-7adc-4284-96f4-68849a873f7a tempest-CreateVolumesFromSnapshotTest-1272343304 None] Deleted volume successfully. Apr 16 15:15:18 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-abc3bd8a-7adc-4284-96f4-68849a873f7a tempest-CreateVolumesFromSnapshotTest-1272343304 None] Lock "cinder-80d004c0-6ecb-456b-a55d-e1d8652015b7-delete_volume" released by "delete_volume" :: held 1.720s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:15:18 devstack sudo[90931]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:18 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-34bc2765-31f2-4efb-a978-5bfd89c44ca6 tempest-VolumeDependencyTests-1769369869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2bc2e54d-6a3a-4640-ace4-bfddd5a56056" returned: 0 in 0.477s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:18 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-34bc2765-31f2-4efb-a978-5bfd89c44ca6 tempest-VolumeDependencyTests-1769369869 None] <== create_volume: return (1050ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'} {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 15:15:18 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-34bc2765-31f2-4efb-a978-5bfd89c44ca6 tempest-VolumeDependencyTests-1769369869 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.053s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:15:18 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-5e0f4385-0fa3-4bf2-8fd7-bbc4fdc0f1b3 tempest-SnapshotDependencyTests-858447260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.228s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:15:18 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-5e0f4385-0fa3-4bf2-8fd7-bbc4fdc0f1b3 tempest-SnapshotDependencyTests-858447260 None] Acquiring lock "cinder-quobyte-8e40ff69-9bff-4660-8807-885f971f06fb-766518cd-40f1-4e5e-a590-cca5ef04ea08" by "_create_volume_from_snapshot" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:15:18 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-34bc2765-31f2-4efb-a978-5bfd89c44ca6 tempest-VolumeDependencyTests-1769369869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ceae122-4e2d-4cb7-8d7b-a4f2f08b7561) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2bc2e54d-6a3a-4640-ace4-bfddd5a56056', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:15:18 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-34bc2765-31f2-4efb-a978-5bfd89c44ca6 tempest-VolumeDependencyTests-1769369869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb9c8bb0-7726-44f7-a544-d36b741f50cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:15:18 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-34bc2765-31f2-4efb-a978-5bfd89c44ca6 tempest-VolumeDependencyTests-1769369869 None] Volume volume-2bc2e54d-6a3a-4640-ace4-bfddd5a56056 (2bc2e54d-6a3a-4640-ace4-bfddd5a56056): created successfully Apr 16 15:15:18 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-34bc2765-31f2-4efb-a978-5bfd89c44ca6 tempest-VolumeDependencyTests-1769369869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb9c8bb0-7726-44f7-a544-d36b741f50cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:15:18 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-34bc2765-31f2-4efb-a978-5bfd89c44ca6 tempest-VolumeDependencyTests-1769369869 None] Flow 'volume_create_manager' (76e68215-bac1-414b-8421-fa5aed5f727b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:15:18 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [None req-6dd22fa7-467c-458d-b0b9-9d41034aaa60 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82756) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 15:15:18 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-6dd22fa7-467c-458d-b0b9-9d41034aaa60 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Flow 'volume_create_manager' (eaf839ca-fb1e-48f0-b47f-4f51d2bfb4d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:15:18 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-6dd22fa7-467c-458d-b0b9-9d41034aaa60 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ffe17a6-ac66-4df0-9ef0-1bea7d11a04c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:15:18 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-6dd22fa7-467c-458d-b0b9-9d41034aaa60 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ffe17a6-ac66-4df0-9ef0-1bea7d11a04c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:15:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1803773619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f176a45c-6076-49f6-a0bf-b28f4f8d276a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19556a2b539946c1ab8a738718adb68d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:15:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:15:18Z,use_quota=True,user_id='a7c6856e1be54beea670dbbd9950ee83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:15:18 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-6dd22fa7-467c-458d-b0b9-9d41034aaa60 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b9b5f3f-5c49-4a87-a58c-beef543078f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:15:18 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-6dd22fa7-467c-458d-b0b9-9d41034aaa60 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b9b5f3f-5c49-4a87-a58c-beef543078f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:15:18 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-6dd22fa7-467c-458d-b0b9-9d41034aaa60 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c900566-249c-4e25-8672-040bf0f19d7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:15:18 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-6dd22fa7-467c-458d-b0b9-9d41034aaa60 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c900566-249c-4e25-8672-040bf0f19d7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f176a45c-6076-49f6-a0bf-b28f4f8d276a', 'volume_name': 'volume-f176a45c-6076-49f6-a0bf-b28f4f8d276a', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:15:18 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-6dd22fa7-467c-458d-b0b9-9d41034aaa60 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80dd7c60-f9ac-41e0-a1da-c9c5987069be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:15:18 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-6dd22fa7-467c-458d-b0b9-9d41034aaa60 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80dd7c60-f9ac-41e0-a1da-c9c5987069be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:15:18 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-6dd22fa7-467c-458d-b0b9-9d41034aaa60 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1c19f70-c1fd-41c3-831a-316acc683cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:15:18 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-6dd22fa7-467c-458d-b0b9-9d41034aaa60 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Volume f176a45c-6076-49f6-a0bf-b28f4f8d276a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f176a45c-6076-49f6-a0bf-b28f4f8d276a', 'volume_size': 1} Apr 16 15:15:18 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-6dd22fa7-467c-458d-b0b9-9d41034aaa60 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:15:18 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-34bc2765-31f2-4efb-a978-5bfd89c44ca6 tempest-VolumeDependencyTests-1769369869 None] Created volume successfully. Apr 16 15:15:18 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-5e0f4385-0fa3-4bf2-8fd7-bbc4fdc0f1b3 tempest-SnapshotDependencyTests-858447260 None] Lock "cinder-quobyte-8e40ff69-9bff-4660-8807-885f971f06fb-766518cd-40f1-4e5e-a590-cca5ef04ea08" acquired by "_create_volume_from_snapshot" :: waited 0.106s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:15:18 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-5e0f4385-0fa3-4bf2-8fd7-bbc4fdc0f1b3 tempest-SnapshotDependencyTests-858447260 None] Creating volume 766518cd-40f1-4e5e-a590-cca5ef04ea08 from snapshot 8e40ff69-9bff-4660-8807-885f971f06fb {{(pid=82756) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 16 15:15:18 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-5e0f4385-0fa3-4bf2-8fd7-bbc4fdc0f1b3 tempest-SnapshotDependencyTests-858447260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:15:18 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-5e0f4385-0fa3-4bf2-8fd7-bbc4fdc0f1b3 tempest-SnapshotDependencyTests-858447260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:15:18 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-5e0f4385-0fa3-4bf2-8fd7-bbc4fdc0f1b3 tempest-SnapshotDependencyTests-858447260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:15:18 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-5e0f4385-0fa3-4bf2-8fd7-bbc4fdc0f1b3 tempest-SnapshotDependencyTests-858447260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:15:18 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-5e0f4385-0fa3-4bf2-8fd7-bbc4fdc0f1b3 tempest-SnapshotDependencyTests-858447260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:15:18 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-5e0f4385-0fa3-4bf2-8fd7-bbc4fdc0f1b3 tempest-SnapshotDependencyTests-858447260 None] Selected osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 as target Quobyte volume. {{(pid=82756) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 15:15:18 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-5e0f4385-0fa3-4bf2-8fd7-bbc4fdc0f1b3 tempest-SnapshotDependencyTests-858447260 None] Acquiring lock "cinder-quobyte-766518cd-40f1-4e5e-a590-cca5ef04ea08" by "_copy_volume_from_snapshot" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:15:18 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-5e0f4385-0fa3-4bf2-8fd7-bbc4fdc0f1b3 tempest-SnapshotDependencyTests-858447260 None] Lock "cinder-quobyte-766518cd-40f1-4e5e-a590-cca5ef04ea08" acquired by "_copy_volume_from_snapshot" :: waited 0.011s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:15:18 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-5e0f4385-0fa3-4bf2-8fd7-bbc4fdc0f1b3 tempest-SnapshotDependencyTests-858447260 None] snapshot: 8e40ff69-9bff-4660-8807-885f971f06fb, volume: 766518cd-40f1-4e5e-a590-cca5ef04ea08, {{(pid=82756) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 16 15:15:18 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-5e0f4385-0fa3-4bf2-8fd7-bbc4fdc0f1b3 tempest-SnapshotDependencyTests-858447260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:15:18 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-5e0f4385-0fa3-4bf2-8fd7-bbc4fdc0f1b3 tempest-SnapshotDependencyTests-858447260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:15:18 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-5e0f4385-0fa3-4bf2-8fd7-bbc4fdc0f1b3 tempest-SnapshotDependencyTests-858447260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:15:18 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-5e0f4385-0fa3-4bf2-8fd7-bbc4fdc0f1b3 tempest-SnapshotDependencyTests-858447260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:15:18 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-5e0f4385-0fa3-4bf2-8fd7-bbc4fdc0f1b3 tempest-SnapshotDependencyTests-858447260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:15:18 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2da197e-8044-45d6-bef3-a456a550d5a7]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:15:18 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-5e0f4385-0fa3-4bf2-8fd7-bbc4fdc0f1b3 tempest-SnapshotDependencyTests-858447260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-386dcbae-cb25-4737-8aeb-cfee8921c168.8e40ff69-9bff-4660-8807-885f971f06fb {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:18 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e9e3439-0f0a-450d-9a6e-1968adf5d4b0 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82756) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 15:15:18 devstack sudo[90935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-386dcbae-cb25-4737-8aeb-cfee8921c168.8e40ff69-9bff-4660-8807-885f971f06fb Apr 16 15:15:18 devstack sudo[90935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:18 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-3e9e3439-0f0a-450d-9a6e-1968adf5d4b0 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Flow 'volume_create_manager' (b97f3379-4d97-4555-b5d4-970785b5ab3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:15:18 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-3e9e3439-0f0a-450d-9a6e-1968adf5d4b0 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e98cc3f1-c98c-4a80-9b13-6ee72a4a8daf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:15:18 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-3e9e3439-0f0a-450d-9a6e-1968adf5d4b0 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e98cc3f1-c98c-4a80-9b13-6ee72a4a8daf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:15:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1586937111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10e2771d-2a1a-483e-a0b8-14b1e66548d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19556a2b539946c1ab8a738718adb68d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:15:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:15:19Z,use_quota=True,user_id='a7c6856e1be54beea670dbbd9950ee83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:15:18 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-3e9e3439-0f0a-450d-9a6e-1968adf5d4b0 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32db1624-8b01-4a68-93dc-5e35463942ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:15:18 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-3e9e3439-0f0a-450d-9a6e-1968adf5d4b0 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32db1624-8b01-4a68-93dc-5e35463942ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:15:18 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-3e9e3439-0f0a-450d-9a6e-1968adf5d4b0 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15f7b951-51ae-45c4-8f31-0ea75cf66d7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:15:18 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-3e9e3439-0f0a-450d-9a6e-1968adf5d4b0 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15f7b951-51ae-45c4-8f31-0ea75cf66d7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10e2771d-2a1a-483e-a0b8-14b1e66548d4', 'volume_name': 'volume-10e2771d-2a1a-483e-a0b8-14b1e66548d4', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:15:18 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-3e9e3439-0f0a-450d-9a6e-1968adf5d4b0 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e29709e7-67fe-4739-9b83-01e35a2c0942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:15:18 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-3e9e3439-0f0a-450d-9a6e-1968adf5d4b0 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e29709e7-67fe-4739-9b83-01e35a2c0942) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:15:18 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-3e9e3439-0f0a-450d-9a6e-1968adf5d4b0 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (388a40a4-d231-42c5-bc95-c1b1c13ec2e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:15:18 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-3e9e3439-0f0a-450d-9a6e-1968adf5d4b0 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Volume 10e2771d-2a1a-483e-a0b8-14b1e66548d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10e2771d-2a1a-483e-a0b8-14b1e66548d4', 'volume_size': 1} Apr 16 15:15:18 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-3e9e3439-0f0a-450d-9a6e-1968adf5d4b0 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:15:18 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd2ad82a-a731-4036-8c2c-3e60f36b6752 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82756) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 15:15:18 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-cd2ad82a-a731-4036-8c2c-3e60f36b6752 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Flow 'volume_create_manager' (b34593ff-50a4-4f57-8eb9-a9ef0952034a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:15:18 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-cd2ad82a-a731-4036-8c2c-3e60f36b6752 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64200f10-1528-4ff4-b9f1-8ba3d8189f44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:15:18 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-cd2ad82a-a731-4036-8c2c-3e60f36b6752 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64200f10-1528-4ff4-b9f1-8ba3d8189f44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:15:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-945370873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed93ac07-982f-4c55-a31e-8bbdb7eb2ad2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19556a2b539946c1ab8a738718adb68d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:15:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:15:19Z,use_quota=True,user_id='a7c6856e1be54beea670dbbd9950ee83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:15:18 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-cd2ad82a-a731-4036-8c2c-3e60f36b6752 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe0b51f2-719f-49dd-ae67-59b12cc7520d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:15:18 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-cd2ad82a-a731-4036-8c2c-3e60f36b6752 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe0b51f2-719f-49dd-ae67-59b12cc7520d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:15:18 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-cd2ad82a-a731-4036-8c2c-3e60f36b6752 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c7764b1-a33d-45f2-b6c0-d1161caf8a8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:15:18 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-cd2ad82a-a731-4036-8c2c-3e60f36b6752 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c7764b1-a33d-45f2-b6c0-d1161caf8a8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed93ac07-982f-4c55-a31e-8bbdb7eb2ad2', 'volume_name': 'volume-ed93ac07-982f-4c55-a31e-8bbdb7eb2ad2', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:15:18 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-cd2ad82a-a731-4036-8c2c-3e60f36b6752 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32a4695e-73e7-42ee-9b21-54cfe577d8e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:15:18 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-cd2ad82a-a731-4036-8c2c-3e60f36b6752 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32a4695e-73e7-42ee-9b21-54cfe577d8e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:15:18 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-cd2ad82a-a731-4036-8c2c-3e60f36b6752 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6024b618-113e-4d2a-8190-35ae27aea82a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:15:18 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-cd2ad82a-a731-4036-8c2c-3e60f36b6752 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Volume ed93ac07-982f-4c55-a31e-8bbdb7eb2ad2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed93ac07-982f-4c55-a31e-8bbdb7eb2ad2', 'volume_size': 1} Apr 16 15:15:18 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-cd2ad82a-a731-4036-8c2c-3e60f36b6752 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:15:19 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-ddfc87a9-518f-466b-bb74-90b9842aebd6 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Acquiring lock "cinder-a60e6b7d-5be5-4814-ab98-6e21c1c522b4-delete_volume" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:15:19 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-ddfc87a9-518f-466b-bb74-90b9842aebd6 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Lock "cinder-a60e6b7d-5be5-4814-ab98-6e21c1c522b4-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:15:19 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-ddfc87a9-518f-466b-bb74-90b9842aebd6 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Acquiring lock "cinder-quobyte-a60e6b7d-5be5-4814-ab98-6e21c1c522b4" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:15:19 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-ddfc87a9-518f-466b-bb74-90b9842aebd6 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Lock "cinder-quobyte-a60e6b7d-5be5-4814-ab98-6e21c1c522b4" acquired by "delete_volume" :: waited 0.007s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:15:19 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[cad5896f-160d-477b-bc76-9e31d8a53c91]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:15:19 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-ddfc87a9-518f-466b-bb74-90b9842aebd6 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-a60e6b7d-5be5-4814-ab98-6e21c1c522b4 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:19 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d7575c0-ffa8-401c-87f1-662d0ad0f4e6 tempest-VolumeDependencyTests-1769369869 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82756) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 15:15:19 devstack sudo[90942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-a60e6b7d-5be5-4814-ab98-6e21c1c522b4 Apr 16 15:15:19 devstack sudo[90942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:19 devstack sudo[90935]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:19 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-5d7575c0-ffa8-401c-87f1-662d0ad0f4e6 tempest-VolumeDependencyTests-1769369869 None] Flow 'volume_create_manager' (a532806d-dce8-4db9-8017-3e88486b9d44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:15:19 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-5d7575c0-ffa8-401c-87f1-662d0ad0f4e6 tempest-VolumeDependencyTests-1769369869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3938d5bf-767a-474b-99e4-dc638c32b7ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:15:19 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [None req-95c5b375-1afa-439f-8225-2595dcb6be78 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82756) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 15:15:19 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-95c5b375-1afa-439f-8225-2595dcb6be78 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Flow 'volume_create_manager' (dda6f716-b0fc-4a42-861d-12fbf0ab6e07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:15:19 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-95c5b375-1afa-439f-8225-2595dcb6be78 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27c7ce3b-5fdf-470f-9985-acf4b10fa396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:15:19 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-95c5b375-1afa-439f-8225-2595dcb6be78 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27c7ce3b-5fdf-470f-9985-acf4b10fa396) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:15:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1658173287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f01eeb6a-6ab1-4651-ae94-243ee9f99d70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19556a2b539946c1ab8a738718adb68d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:15:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:15:19Z,use_quota=True,user_id='a7c6856e1be54beea670dbbd9950ee83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:15:19 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-95c5b375-1afa-439f-8225-2595dcb6be78 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e79840d-21a1-4664-b376-2330305c6f6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:15:19 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-95c5b375-1afa-439f-8225-2595dcb6be78 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e79840d-21a1-4664-b376-2330305c6f6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:15:19 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-95c5b375-1afa-439f-8225-2595dcb6be78 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee71d9d6-4858-4d7b-8457-3a57f2ef74ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:15:19 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-95c5b375-1afa-439f-8225-2595dcb6be78 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee71d9d6-4858-4d7b-8457-3a57f2ef74ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f01eeb6a-6ab1-4651-ae94-243ee9f99d70', 'volume_name': 'volume-f01eeb6a-6ab1-4651-ae94-243ee9f99d70', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:15:19 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-95c5b375-1afa-439f-8225-2595dcb6be78 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54cea518-e7b1-4639-b228-18c419cbd4c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:15:19 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-95c5b375-1afa-439f-8225-2595dcb6be78 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54cea518-e7b1-4639-b228-18c419cbd4c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:15:19 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-95c5b375-1afa-439f-8225-2595dcb6be78 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (009afac1-a975-43ea-a83c-456c3819ab0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:15:19 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-95c5b375-1afa-439f-8225-2595dcb6be78 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Volume f01eeb6a-6ab1-4651-ae94-243ee9f99d70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f01eeb6a-6ab1-4651-ae94-243ee9f99d70', 'volume_size': 1} Apr 16 15:15:19 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-95c5b375-1afa-439f-8225-2595dcb6be78 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:15:19 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-5e0f4385-0fa3-4bf2-8fd7-bbc4fdc0f1b3 tempest-SnapshotDependencyTests-858447260 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-386dcbae-cb25-4737-8aeb-cfee8921c168.8e40ff69-9bff-4660-8807-885f971f06fb" returned: 0 in 0.812s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:19 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-5e0f4385-0fa3-4bf2-8fd7-bbc4fdc0f1b3 tempest-SnapshotDependencyTests-858447260 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-386dcbae-cb25-4737-8aeb-cfee8921c168(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82756) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 15:15:19 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-5e0f4385-0fa3-4bf2-8fd7-bbc4fdc0f1b3 tempest-SnapshotDependencyTests-858447260 None] will copy from snapshot at /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-386dcbae-cb25-4737-8aeb-cfee8921c168 {{(pid=82756) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 16 15:15:19 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-5e0f4385-0fa3-4bf2-8fd7-bbc4fdc0f1b3 tempest-SnapshotDependencyTests-858447260 None] Creating direct copy from snapshot {{(pid=82756) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 16 15:15:19 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-5d7575c0-ffa8-401c-87f1-662d0ad0f4e6 tempest-VolumeDependencyTests-1769369869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3938d5bf-767a-474b-99e4-dc638c32b7ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:15:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-218021355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d1517b4-9e46-4ff0-85b3-a37774ce20ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2465b74888c74c608190b15eb478a3e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:15:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=2bc2e54d-6a3a-4640-ace4-bfddd5a56056,status='creating',terminated_at=None,updated_at=2026-04-16T13:15:19Z,use_quota=True,user_id='bbe844468df24b8bb78f9c30c795001c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:15:19 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-5d7575c0-ffa8-401c-87f1-662d0ad0f4e6 tempest-VolumeDependencyTests-1769369869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2e28586-a48f-43f4-a620-1c583769d003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:15:19 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-5d7575c0-ffa8-401c-87f1-662d0ad0f4e6 tempest-VolumeDependencyTests-1769369869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2e28586-a48f-43f4-a620-1c583769d003) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:15:19 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-5d7575c0-ffa8-401c-87f1-662d0ad0f4e6 tempest-VolumeDependencyTests-1769369869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c018bd88-6f3a-4e7a-b956-002915cc6550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:15:19 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[40aad799-25e8-40e0-9b10-d80ef1b00498]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:15:19 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-5e0f4385-0fa3-4bf2-8fd7-bbc4fdc0f1b3 tempest-SnapshotDependencyTests-858447260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-386dcbae-cb25-4737-8aeb-cfee8921c168 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:19 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-5d7575c0-ffa8-401c-87f1-662d0ad0f4e6 tempest-VolumeDependencyTests-1769369869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c018bd88-6f3a-4e7a-b956-002915cc6550) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '6d1517b4-9e46-4ff0-85b3-a37774ce20ef', 'volume_name': 'volume-6d1517b4-9e46-4ff0-85b3-a37774ce20ef', 'volume_size': 1, 'source_volid': '2bc2e54d-6a3a-4640-ace4-bfddd5a56056', 'source_volstatus': 'available'}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:15:19 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-5d7575c0-ffa8-401c-87f1-662d0ad0f4e6 tempest-VolumeDependencyTests-1769369869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00a94f6a-cd3c-4cad-a06b-dd3d0c0d6dc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:15:19 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-5d7575c0-ffa8-401c-87f1-662d0ad0f4e6 tempest-VolumeDependencyTests-1769369869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00a94f6a-cd3c-4cad-a06b-dd3d0c0d6dc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:15:19 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-5d7575c0-ffa8-401c-87f1-662d0ad0f4e6 tempest-VolumeDependencyTests-1769369869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ece6e95a-9745-4cac-921f-019f94be6d5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:15:19 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-5d7575c0-ffa8-401c-87f1-662d0ad0f4e6 tempest-VolumeDependencyTests-1769369869 None] Volume 6d1517b4-9e46-4ff0-85b3-a37774ce20ef: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-6d1517b4-9e46-4ff0-85b3-a37774ce20ef', 'volume_size': 1, 'source_volid': '2bc2e54d-6a3a-4640-ace4-bfddd5a56056', 'source_volstatus': 'available'} Apr 16 15:15:19 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [None req-376635d2-4fce-43eb-8527-996c27ed8d75 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82756) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 15:15:19 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-376635d2-4fce-43eb-8527-996c27ed8d75 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Flow 'volume_create_manager' (22f3db9b-51e5-4cf2-9e6d-efcb552c3e79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:15:19 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-376635d2-4fce-43eb-8527-996c27ed8d75 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b81e613-fea4-4aaa-8d3b-e22fd430a8e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:15:19 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-5d7575c0-ffa8-401c-87f1-662d0ad0f4e6 tempest-VolumeDependencyTests-1769369869 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:15:19 devstack sudo[90945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-386dcbae-cb25-4737-8aeb-cfee8921c168 Apr 16 15:15:19 devstack sudo[90945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:19 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-376635d2-4fce-43eb-8527-996c27ed8d75 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b81e613-fea4-4aaa-8d3b-e22fd430a8e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:15:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-995061802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d4781f3-797b-4622-a698-89536138b0cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19556a2b539946c1ab8a738718adb68d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:15:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:15:19Z,use_quota=True,user_id='a7c6856e1be54beea670dbbd9950ee83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:15:19 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-376635d2-4fce-43eb-8527-996c27ed8d75 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (569e87db-4bff-4316-8b4b-c9ba2520f7bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:15:19 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-376635d2-4fce-43eb-8527-996c27ed8d75 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (569e87db-4bff-4316-8b4b-c9ba2520f7bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:15:19 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-376635d2-4fce-43eb-8527-996c27ed8d75 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a86a02a9-8239-4965-a5f6-96a9652dac3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:15:19 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-376635d2-4fce-43eb-8527-996c27ed8d75 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a86a02a9-8239-4965-a5f6-96a9652dac3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d4781f3-797b-4622-a698-89536138b0cd', 'volume_name': 'volume-5d4781f3-797b-4622-a698-89536138b0cd', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:15:19 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-376635d2-4fce-43eb-8527-996c27ed8d75 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35f87022-d63e-4b86-bb1a-c9d36cd671a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:15:19 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-376635d2-4fce-43eb-8527-996c27ed8d75 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35f87022-d63e-4b86-bb1a-c9d36cd671a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:15:19 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-376635d2-4fce-43eb-8527-996c27ed8d75 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76cbafad-41cb-4028-a770-e732334644b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:15:19 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-376635d2-4fce-43eb-8527-996c27ed8d75 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Volume 5d4781f3-797b-4622-a698-89536138b0cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d4781f3-797b-4622-a698-89536138b0cd', 'volume_size': 1} Apr 16 15:15:19 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-376635d2-4fce-43eb-8527-996c27ed8d75 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:15:19 devstack sudo[90942]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:19 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-ddfc87a9-518f-466b-bb74-90b9842aebd6 tempest-CreateVolumesFromSnapshotTest-1272343304 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-a60e6b7d-5be5-4814-ab98-6e21c1c522b4" returned: 0 in 0.520s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:19 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-ddfc87a9-518f-466b-bb74-90b9842aebd6 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-a60e6b7d-5be5-4814-ab98-6e21c1c522b4 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:19 devstack sudo[90950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-a60e6b7d-5be5-4814-ab98-6e21c1c522b4 Apr 16 15:15:19 devstack sudo[90950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:19 devstack sudo[90945]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:19 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-5e0f4385-0fa3-4bf2-8fd7-bbc4fdc0f1b3 tempest-SnapshotDependencyTests-858447260 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-386dcbae-cb25-4737-8aeb-cfee8921c168" returned: 0 in 0.525s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:19 devstack cinder-volume[82756]: DEBUG cinder.utils [None req-5e0f4385-0fa3-4bf2-8fd7-bbc4fdc0f1b3 tempest-SnapshotDependencyTests-858447260 None] Path /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-766518cd-40f1-4e5e-a590-cca5ef04ea08 not found in is_blk_device check {{(pid=82756) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 16 15:15:19 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-5e0f4385-0fa3-4bf2-8fd7-bbc4fdc0f1b3 tempest-SnapshotDependencyTests-858447260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-386dcbae-cb25-4737-8aeb-cfee8921c168 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-766518cd-40f1-4e5e-a590-cca5ef04ea08 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:19 devstack sudo[90955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-386dcbae-cb25-4737-8aeb-cfee8921c168 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-766518cd-40f1-4e5e-a590-cca5ef04ea08 Apr 16 15:15:19 devstack sudo[90955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:20 devstack sudo[90950]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:20 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-ddfc87a9-518f-466b-bb74-90b9842aebd6 tempest-CreateVolumesFromSnapshotTest-1272343304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-a60e6b7d-5be5-4814-ab98-6e21c1c522b4" returned: 0 in 0.425s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:20 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-ddfc87a9-518f-466b-bb74-90b9842aebd6 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Lock "cinder-quobyte-a60e6b7d-5be5-4814-ab98-6e21c1c522b4" released by "delete_volume" :: held 0.969s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:15:20 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-ddfc87a9-518f-466b-bb74-90b9842aebd6 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Created reservations ['361ac18a-915b-4a21-8ef0-5829ab17d9c5', '8bfcc9fd-6d02-4784-b088-18cbebdc367d', '59c5ef31-4ee6-4e30-8f91-56da0ff8070a', 'da4ec667-796f-4acd-a26c-111222e8b072'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:15:20 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-ddfc87a9-518f-466b-bb74-90b9842aebd6 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:15:20 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-ddfc87a9-518f-466b-bb74-90b9842aebd6 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:15:20 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-ddfc87a9-518f-466b-bb74-90b9842aebd6 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:15:20 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-ddfc87a9-518f-466b-bb74-90b9842aebd6 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:15:20 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-ddfc87a9-518f-466b-bb74-90b9842aebd6 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:15:20 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-ddfc87a9-518f-466b-bb74-90b9842aebd6 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:20 devstack sudo[90958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:15:20 devstack sudo[90958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:20 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-f13e2788-4cf0-45e6-aa15-d9a22fff80b0 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Acquiring lock "cinder-3403603b-a9fb-493b-a948-e8578fe3494a-delete_volume" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:15:20 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-f13e2788-4cf0-45e6-aa15-d9a22fff80b0 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Lock "cinder-3403603b-a9fb-493b-a948-e8578fe3494a-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:15:20 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-f13e2788-4cf0-45e6-aa15-d9a22fff80b0 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Acquiring lock "cinder-quobyte-3403603b-a9fb-493b-a948-e8578fe3494a" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:15:20 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-f13e2788-4cf0-45e6-aa15-d9a22fff80b0 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Lock "cinder-quobyte-3403603b-a9fb-493b-a948-e8578fe3494a" acquired by "delete_volume" :: waited 0.007s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:15:20 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a9ff06d-c6b0-477f-b574-4f11c67f748f]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:15:20 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-f13e2788-4cf0-45e6-aa15-d9a22fff80b0 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-3403603b-a9fb-493b-a948-e8578fe3494a {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:20 devstack sudo[90960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-3403603b-a9fb-493b-a948-e8578fe3494a Apr 16 15:15:20 devstack sudo[90960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:20 devstack sudo[90958]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:20 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-ddfc87a9-518f-466b-bb74-90b9842aebd6 tempest-CreateVolumesFromSnapshotTest-1272343304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.550s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:20 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-ddfc87a9-518f-466b-bb74-90b9842aebd6 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:15:20 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-ddfc87a9-518f-466b-bb74-90b9842aebd6 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Deleted volume successfully. Apr 16 15:15:20 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-ddfc87a9-518f-466b-bb74-90b9842aebd6 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Lock "cinder-a60e6b7d-5be5-4814-ab98-6e21c1c522b4-delete_volume" released by "delete_volume" :: held 1.658s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:15:22 devstack sudo[90960]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:22 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-f13e2788-4cf0-45e6-aa15-d9a22fff80b0 tempest-CreateVolumesFromSnapshotTest-1272343304 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-3403603b-a9fb-493b-a948-e8578fe3494a" returned: 0 in 1.713s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:22 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-f13e2788-4cf0-45e6-aa15-d9a22fff80b0 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-3403603b-a9fb-493b-a948-e8578fe3494a {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:22 devstack sudo[90978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-3403603b-a9fb-493b-a948-e8578fe3494a Apr 16 15:15:22 devstack sudo[90978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:22 devstack sudo[90955]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:22 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-5e0f4385-0fa3-4bf2-8fd7-bbc4fdc0f1b3 tempest-SnapshotDependencyTests-858447260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-386dcbae-cb25-4737-8aeb-cfee8921c168 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-766518cd-40f1-4e5e-a590-cca5ef04ea08" returned: 0 in 2.194s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:22 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[e731a77a-eec8-495c-b353-929c619a9753]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:15:22 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-5e0f4385-0fa3-4bf2-8fd7-bbc4fdc0f1b3 tempest-SnapshotDependencyTests-858447260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-386dcbae-cb25-4737-8aeb-cfee8921c168 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:22 devstack sudo[90980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-386dcbae-cb25-4737-8aeb-cfee8921c168 Apr 16 15:15:22 devstack sudo[90980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:22 devstack sudo[90978]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:22 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-f13e2788-4cf0-45e6-aa15-d9a22fff80b0 tempest-CreateVolumesFromSnapshotTest-1272343304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-3403603b-a9fb-493b-a948-e8578fe3494a" returned: 0 in 0.434s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:22 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-f13e2788-4cf0-45e6-aa15-d9a22fff80b0 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Lock "cinder-quobyte-3403603b-a9fb-493b-a948-e8578fe3494a" released by "delete_volume" :: held 2.178s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:15:22 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-f13e2788-4cf0-45e6-aa15-d9a22fff80b0 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Created reservations ['91ddaba5-b960-4470-9b31-599214f49b65', '15cd5576-a251-4897-a402-ca3f6c4e63fa', '72ddd241-1861-445e-8b16-8e79f788077d', '2a4d4f96-14f1-450b-9d63-e83b01259791'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:15:22 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-f13e2788-4cf0-45e6-aa15-d9a22fff80b0 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:15:22 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-f13e2788-4cf0-45e6-aa15-d9a22fff80b0 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:15:22 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-f13e2788-4cf0-45e6-aa15-d9a22fff80b0 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:15:22 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-f13e2788-4cf0-45e6-aa15-d9a22fff80b0 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:15:22 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-f13e2788-4cf0-45e6-aa15-d9a22fff80b0 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:15:22 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-f13e2788-4cf0-45e6-aa15-d9a22fff80b0 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:22 devstack sudo[90985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:15:22 devstack sudo[90985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:22 devstack sudo[90980]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:22 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-5e0f4385-0fa3-4bf2-8fd7-bbc4fdc0f1b3 tempest-SnapshotDependencyTests-858447260 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-386dcbae-cb25-4737-8aeb-cfee8921c168" returned: 0 in 0.614s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:22 devstack cinder-volume[82756]: DEBUG cinder.image.image_utils [None req-5e0f4385-0fa3-4bf2-8fd7-bbc4fdc0f1b3 tempest-SnapshotDependencyTests-858447260 None] Image conversion details: src /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-386dcbae-cb25-4737-8aeb-cfee8921c168, size 1024.00 MB, duration 2.20 sec, destination /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-766518cd-40f1-4e5e-a590-cca5ef04ea08 {{(pid=82756) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 15:15:22 devstack cinder-volume[82756]: INFO cinder.image.image_utils [None req-5e0f4385-0fa3-4bf2-8fd7-bbc4fdc0f1b3 tempest-SnapshotDependencyTests-858447260 None] Converted 1024.00 MB image at 466.36 MB/s Apr 16 15:15:22 devstack cinder-volume[82756]: WARNING cinder.volume.drivers.remotefs [None req-5e0f4385-0fa3-4bf2-8fd7-bbc4fdc0f1b3 tempest-SnapshotDependencyTests-858447260 None] /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-766518cd-40f1-4e5e-a590-cca5ef04ea08 is being set with open permissions: ugo+rw Apr 16 15:15:22 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-5e0f4385-0fa3-4bf2-8fd7-bbc4fdc0f1b3 tempest-SnapshotDependencyTests-858447260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-766518cd-40f1-4e5e-a590-cca5ef04ea08 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:22 devstack sudo[90988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-766518cd-40f1-4e5e-a590-cca5ef04ea08 Apr 16 15:15:22 devstack sudo[90988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:23 devstack sudo[90985]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:23 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-f13e2788-4cf0-45e6-aa15-d9a22fff80b0 tempest-CreateVolumesFromSnapshotTest-1272343304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.453s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:23 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-f13e2788-4cf0-45e6-aa15-d9a22fff80b0 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:15:23 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-f13e2788-4cf0-45e6-aa15-d9a22fff80b0 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Deleted volume successfully. Apr 16 15:15:23 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-f13e2788-4cf0-45e6-aa15-d9a22fff80b0 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Lock "cinder-3403603b-a9fb-493b-a948-e8578fe3494a-delete_volume" released by "delete_volume" :: held 2.792s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:15:23 devstack sudo[90988]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:23 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-5e0f4385-0fa3-4bf2-8fd7-bbc4fdc0f1b3 tempest-SnapshotDependencyTests-858447260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-766518cd-40f1-4e5e-a590-cca5ef04ea08" returned: 0 in 0.390s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:23 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-5e0f4385-0fa3-4bf2-8fd7-bbc4fdc0f1b3 tempest-SnapshotDependencyTests-858447260 None] Lock "cinder-quobyte-766518cd-40f1-4e5e-a590-cca5ef04ea08" released by "_copy_volume_from_snapshot" :: held 4.614s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:15:23 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-5e0f4385-0fa3-4bf2-8fd7-bbc4fdc0f1b3 tempest-SnapshotDependencyTests-858447260 None] Lock "cinder-quobyte-8e40ff69-9bff-4660-8807-885f971f06fb-766518cd-40f1-4e5e-a590-cca5ef04ea08" released by "_create_volume_from_snapshot" :: held 4.637s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:15:23 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-5e0f4385-0fa3-4bf2-8fd7-bbc4fdc0f1b3 tempest-SnapshotDependencyTests-858447260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.744s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:15:23 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-6dd22fa7-467c-458d-b0b9-9d41034aaa60 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.647s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:15:23 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-6dd22fa7-467c-458d-b0b9-9d41034aaa60 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:15:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1803773619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f176a45c-6076-49f6-a0bf-b28f4f8d276a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19556a2b539946c1ab8a738718adb68d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:15:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:15:18Z,use_quota=True,user_id='a7c6856e1be54beea670dbbd9950ee83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)}" {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 15:15:23 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-6dd22fa7-467c-458d-b0b9-9d41034aaa60 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Creating volume f176a45c-6076-49f6-a0bf-b28f4f8d276a {{(pid=82756) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 15:15:23 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-6dd22fa7-467c-458d-b0b9-9d41034aaa60 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:15:23 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-6dd22fa7-467c-458d-b0b9-9d41034aaa60 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:15:23 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-6dd22fa7-467c-458d-b0b9-9d41034aaa60 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:15:23 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-6dd22fa7-467c-458d-b0b9-9d41034aaa60 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:15:23 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-6dd22fa7-467c-458d-b0b9-9d41034aaa60 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:15:23 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-6dd22fa7-467c-458d-b0b9-9d41034aaa60 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Selected osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 as target Quobyte volume. {{(pid=82756) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 15:15:23 devstack cinder-volume[82756]: INFO cinder.volume.drivers.remotefs [None req-6dd22fa7-467c-458d-b0b9-9d41034aaa60 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] casted to osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 Apr 16 15:15:23 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-6dd22fa7-467c-458d-b0b9-9d41034aaa60 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-f176a45c-6076-49f6-a0bf-b28f4f8d276a 1073741824 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:23 devstack sudo[90992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-f176a45c-6076-49f6-a0bf-b28f4f8d276a 1073741824 Apr 16 15:15:23 devstack sudo[90992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:23 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-5e0f4385-0fa3-4bf2-8fd7-bbc4fdc0f1b3 tempest-SnapshotDependencyTests-858447260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f598075-ab9d-44ea-9723-4d03c0a8515f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-766518cd-40f1-4e5e-a590-cca5ef04ea08', 'volume_size': 1, 'snapshot_id': '8e40ff69-9bff-4660-8807-885f971f06fb'}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:15:23 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-5e0f4385-0fa3-4bf2-8fd7-bbc4fdc0f1b3 tempest-SnapshotDependencyTests-858447260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c772ebf-62f7-4efd-b723-9ae5ae8acd65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:15:23 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-5e0f4385-0fa3-4bf2-8fd7-bbc4fdc0f1b3 tempest-SnapshotDependencyTests-858447260 None] Volume volume-766518cd-40f1-4e5e-a590-cca5ef04ea08 (766518cd-40f1-4e5e-a590-cca5ef04ea08): created successfully Apr 16 15:15:23 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-5e0f4385-0fa3-4bf2-8fd7-bbc4fdc0f1b3 tempest-SnapshotDependencyTests-858447260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c772ebf-62f7-4efd-b723-9ae5ae8acd65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:15:23 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-5e0f4385-0fa3-4bf2-8fd7-bbc4fdc0f1b3 tempest-SnapshotDependencyTests-858447260 None] Flow 'volume_create_manager' (201f8406-f0bc-46cc-8649-156a99eca0c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:15:23 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-5e0f4385-0fa3-4bf2-8fd7-bbc4fdc0f1b3 tempest-SnapshotDependencyTests-858447260 None] Created volume successfully. Apr 16 15:15:23 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-d3031882-5ede-4cfc-b940-725a3f0d5360 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Acquiring lock "cinder-ea81d119-9f42-4534-ba5f-7f94f7f8a737-delete_snapshot" by "delete_snapshot" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:15:23 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-d3031882-5ede-4cfc-b940-725a3f0d5360 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Lock "cinder-ea81d119-9f42-4534-ba5f-7f94f7f8a737-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:15:23 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-d3031882-5ede-4cfc-b940-725a3f0d5360 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Acquiring lock "cinder-quobyte-5b18bcbf-e358-4b27-b079-bff25ab2ec17" by "delete_snapshot" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:15:23 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-d3031882-5ede-4cfc-b940-725a3f0d5360 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Lock "cinder-quobyte-5b18bcbf-e358-4b27-b079-bff25ab2ec17" acquired by "delete_snapshot" :: waited 0.026s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:15:23 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-d3031882-5ede-4cfc-b940-725a3f0d5360 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Acquiring lock "cinder-quobyte-ea81d119-9f42-4534-ba5f-7f94f7f8a737" by "_delete_snapshot" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:15:23 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-d3031882-5ede-4cfc-b940-725a3f0d5360 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Lock "cinder-quobyte-ea81d119-9f42-4534-ba5f-7f94f7f8a737" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:15:23 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-d3031882-5ede-4cfc-b940-725a3f0d5360 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Deleting offline snapshot ea81d119-9f42-4534-ba5f-7f94f7f8a737 of volume 5b18bcbf-e358-4b27-b079-bff25ab2ec17 {{(pid=82756) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 15:15:23 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-d3031882-5ede-4cfc-b940-725a3f0d5360 tempest-CreateVolumesFromSnapshotTest-1272343304 None] snapshot_file for this snap is: volume-5b18bcbf-e358-4b27-b079-bff25ab2ec17.ea81d119-9f42-4534-ba5f-7f94f7f8a737 {{(pid=82756) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 15:15:23 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b5bf9d8-5f8f-4e10-8129-d22bacc33376]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:15:23 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-d3031882-5ede-4cfc-b940-725a3f0d5360 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-5b18bcbf-e358-4b27-b079-bff25ab2ec17.ea81d119-9f42-4534-ba5f-7f94f7f8a737 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:23 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-c0caf50a-0efb-45c9-a561-6ef0a50c89d3 tempest-SnapshotDependencyTests-858447260 None] Acquiring lock "cinder-8e40ff69-9bff-4660-8807-885f971f06fb-delete_snapshot" by "delete_snapshot" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:15:23 devstack sudo[90998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-5b18bcbf-e358-4b27-b079-bff25ab2ec17.ea81d119-9f42-4534-ba5f-7f94f7f8a737 Apr 16 15:15:23 devstack sudo[90998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:23 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-c0caf50a-0efb-45c9-a561-6ef0a50c89d3 tempest-SnapshotDependencyTests-858447260 None] Lock "cinder-8e40ff69-9bff-4660-8807-885f971f06fb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:15:23 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-c0caf50a-0efb-45c9-a561-6ef0a50c89d3 tempest-SnapshotDependencyTests-858447260 None] Acquiring lock "cinder-quobyte-386dcbae-cb25-4737-8aeb-cfee8921c168" by "delete_snapshot" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:15:23 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-c0caf50a-0efb-45c9-a561-6ef0a50c89d3 tempest-SnapshotDependencyTests-858447260 None] Lock "cinder-quobyte-386dcbae-cb25-4737-8aeb-cfee8921c168" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:15:23 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-c0caf50a-0efb-45c9-a561-6ef0a50c89d3 tempest-SnapshotDependencyTests-858447260 None] Acquiring lock "cinder-quobyte-8e40ff69-9bff-4660-8807-885f971f06fb" by "_delete_snapshot" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:15:23 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-c0caf50a-0efb-45c9-a561-6ef0a50c89d3 tempest-SnapshotDependencyTests-858447260 None] Lock "cinder-quobyte-8e40ff69-9bff-4660-8807-885f971f06fb" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:15:23 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-c0caf50a-0efb-45c9-a561-6ef0a50c89d3 tempest-SnapshotDependencyTests-858447260 None] Deleting offline snapshot 8e40ff69-9bff-4660-8807-885f971f06fb of volume 386dcbae-cb25-4737-8aeb-cfee8921c168 {{(pid=82756) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 15:15:23 devstack sudo[90992]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:23 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-c0caf50a-0efb-45c9-a561-6ef0a50c89d3 tempest-SnapshotDependencyTests-858447260 None] snapshot_file for this snap is: volume-386dcbae-cb25-4737-8aeb-cfee8921c168.8e40ff69-9bff-4660-8807-885f971f06fb {{(pid=82756) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 15:15:23 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-6dd22fa7-467c-458d-b0b9-9d41034aaa60 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-f176a45c-6076-49f6-a0bf-b28f4f8d276a 1073741824" returned: 0 in 0.596s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:23 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[53291c90-4b87-4d46-81cc-26eecb4e6d3a]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:15:23 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-c0caf50a-0efb-45c9-a561-6ef0a50c89d3 tempest-SnapshotDependencyTests-858447260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-386dcbae-cb25-4737-8aeb-cfee8921c168.8e40ff69-9bff-4660-8807-885f971f06fb {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:23 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-6dd22fa7-467c-458d-b0b9-9d41034aaa60 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-f176a45c-6076-49f6-a0bf-b28f4f8d276a {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:23 devstack sudo[91001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-f176a45c-6076-49f6-a0bf-b28f4f8d276a Apr 16 15:15:23 devstack sudo[91001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:23 devstack sudo[91000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-386dcbae-cb25-4737-8aeb-cfee8921c168.8e40ff69-9bff-4660-8807-885f971f06fb Apr 16 15:15:23 devstack sudo[91000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:24 devstack sudo[90998]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:24 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-d3031882-5ede-4cfc-b940-725a3f0d5360 tempest-CreateVolumesFromSnapshotTest-1272343304 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-5b18bcbf-e358-4b27-b079-bff25ab2ec17.ea81d119-9f42-4534-ba5f-7f94f7f8a737" returned: 0 in 0.556s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:24 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-d3031882-5ede-4cfc-b940-725a3f0d5360 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5b18bcbf-e358-4b27-b079-bff25ab2ec17(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82756) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 15:15:24 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[807386b0-5f5d-4af6-8f0e-b5efdb950911]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:15:24 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-d3031882-5ede-4cfc-b940-725a3f0d5360 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-5b18bcbf-e358-4b27-b079-bff25ab2ec17 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:24 devstack sudo[91001]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:24 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-6dd22fa7-467c-458d-b0b9-9d41034aaa60 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-f176a45c-6076-49f6-a0bf-b28f4f8d276a" returned: 0 in 0.444s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:24 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-6dd22fa7-467c-458d-b0b9-9d41034aaa60 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] <== create_volume: return (1083ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'} {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 15:15:24 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-6dd22fa7-467c-458d-b0b9-9d41034aaa60 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.086s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:15:24 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-3e9e3439-0f0a-450d-9a6e-1968adf5d4b0 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.548s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:15:24 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-3e9e3439-0f0a-450d-9a6e-1968adf5d4b0 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:15:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1586937111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10e2771d-2a1a-483e-a0b8-14b1e66548d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19556a2b539946c1ab8a738718adb68d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:15:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:15:19Z,use_quota=True,user_id='a7c6856e1be54beea670dbbd9950ee83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)}" {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 15:15:24 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-3e9e3439-0f0a-450d-9a6e-1968adf5d4b0 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Creating volume 10e2771d-2a1a-483e-a0b8-14b1e66548d4 {{(pid=82756) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 15:15:24 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-3e9e3439-0f0a-450d-9a6e-1968adf5d4b0 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:15:24 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-3e9e3439-0f0a-450d-9a6e-1968adf5d4b0 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:15:24 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-3e9e3439-0f0a-450d-9a6e-1968adf5d4b0 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:15:24 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-3e9e3439-0f0a-450d-9a6e-1968adf5d4b0 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:15:24 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-3e9e3439-0f0a-450d-9a6e-1968adf5d4b0 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:15:24 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-3e9e3439-0f0a-450d-9a6e-1968adf5d4b0 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Selected osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 as target Quobyte volume. {{(pid=82756) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 15:15:24 devstack cinder-volume[82756]: INFO cinder.volume.drivers.remotefs [None req-3e9e3439-0f0a-450d-9a6e-1968adf5d4b0 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] casted to osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 Apr 16 15:15:24 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-3e9e3439-0f0a-450d-9a6e-1968adf5d4b0 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-10e2771d-2a1a-483e-a0b8-14b1e66548d4 1073741824 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:24 devstack sudo[91009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-5b18bcbf-e358-4b27-b079-bff25ab2ec17 Apr 16 15:15:24 devstack sudo[91009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:24 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-6dd22fa7-467c-458d-b0b9-9d41034aaa60 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1c19f70-c1fd-41c3-831a-316acc683cc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f176a45c-6076-49f6-a0bf-b28f4f8d276a', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:15:24 devstack sudo[91013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-10e2771d-2a1a-483e-a0b8-14b1e66548d4 1073741824 Apr 16 15:15:24 devstack sudo[91013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:24 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-6dd22fa7-467c-458d-b0b9-9d41034aaa60 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7db50f4e-8f08-487a-b849-bc55389f4941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:15:24 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-6dd22fa7-467c-458d-b0b9-9d41034aaa60 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Volume volume-f176a45c-6076-49f6-a0bf-b28f4f8d276a (f176a45c-6076-49f6-a0bf-b28f4f8d276a): created successfully Apr 16 15:15:24 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-6dd22fa7-467c-458d-b0b9-9d41034aaa60 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7db50f4e-8f08-487a-b849-bc55389f4941) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:15:24 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-6dd22fa7-467c-458d-b0b9-9d41034aaa60 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Flow 'volume_create_manager' (eaf839ca-fb1e-48f0-b47f-4f51d2bfb4d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:15:24 devstack sudo[91000]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:24 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-c0caf50a-0efb-45c9-a561-6ef0a50c89d3 tempest-SnapshotDependencyTests-858447260 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-386dcbae-cb25-4737-8aeb-cfee8921c168.8e40ff69-9bff-4660-8807-885f971f06fb" returned: 0 in 0.538s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:24 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-c0caf50a-0efb-45c9-a561-6ef0a50c89d3 tempest-SnapshotDependencyTests-858447260 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-386dcbae-cb25-4737-8aeb-cfee8921c168(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82756) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 15:15:24 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-6dd22fa7-467c-458d-b0b9-9d41034aaa60 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Created volume successfully. Apr 16 15:15:24 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb3c5a90-7481-469e-84b3-01b6eaeb58b7]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:15:24 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-c0caf50a-0efb-45c9-a561-6ef0a50c89d3 tempest-SnapshotDependencyTests-858447260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-386dcbae-cb25-4737-8aeb-cfee8921c168 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:24 devstack sudo[91015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-386dcbae-cb25-4737-8aeb-cfee8921c168 Apr 16 15:15:24 devstack sudo[91015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:24 devstack sudo[91009]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:24 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-d3031882-5ede-4cfc-b940-725a3f0d5360 tempest-CreateVolumesFromSnapshotTest-1272343304 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-5b18bcbf-e358-4b27-b079-bff25ab2ec17" returned: 0 in 0.588s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:24 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-d3031882-5ede-4cfc-b940-725a3f0d5360 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-5b18bcbf-e358-4b27-b079-bff25ab2ec17.ea81d119-9f42-4534-ba5f-7f94f7f8a737 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:24 devstack sudo[91026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-5b18bcbf-e358-4b27-b079-bff25ab2ec17.ea81d119-9f42-4534-ba5f-7f94f7f8a737 Apr 16 15:15:24 devstack sudo[91026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:24 devstack sudo[91013]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:24 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-3e9e3439-0f0a-450d-9a6e-1968adf5d4b0 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-10e2771d-2a1a-483e-a0b8-14b1e66548d4 1073741824" returned: 0 in 0.566s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:24 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-3e9e3439-0f0a-450d-9a6e-1968adf5d4b0 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-10e2771d-2a1a-483e-a0b8-14b1e66548d4 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:24 devstack sudo[91015]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:24 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-c0caf50a-0efb-45c9-a561-6ef0a50c89d3 tempest-SnapshotDependencyTests-858447260 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-386dcbae-cb25-4737-8aeb-cfee8921c168" returned: 0 in 0.524s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:24 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-c0caf50a-0efb-45c9-a561-6ef0a50c89d3 tempest-SnapshotDependencyTests-858447260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-386dcbae-cb25-4737-8aeb-cfee8921c168.8e40ff69-9bff-4660-8807-885f971f06fb {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:24 devstack sudo[91028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-10e2771d-2a1a-483e-a0b8-14b1e66548d4 Apr 16 15:15:24 devstack sudo[91028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:24 devstack sudo[91030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-386dcbae-cb25-4737-8aeb-cfee8921c168.8e40ff69-9bff-4660-8807-885f971f06fb Apr 16 15:15:24 devstack sudo[91030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:25 devstack sudo[91026]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:25 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-d3031882-5ede-4cfc-b940-725a3f0d5360 tempest-CreateVolumesFromSnapshotTest-1272343304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-5b18bcbf-e358-4b27-b079-bff25ab2ec17.ea81d119-9f42-4534-ba5f-7f94f7f8a737" returned: 0 in 0.487s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:25 devstack sudo[91028]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:25 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-d3031882-5ede-4cfc-b940-725a3f0d5360 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-5b18bcbf-e358-4b27-b079-bff25ab2ec17.ea81d119-9f42-4534-ba5f-7f94f7f8a737 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:25 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-3e9e3439-0f0a-450d-9a6e-1968adf5d4b0 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-10e2771d-2a1a-483e-a0b8-14b1e66548d4" returned: 0 in 0.427s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:25 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-3e9e3439-0f0a-450d-9a6e-1968adf5d4b0 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] <== create_volume: return (1023ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'} {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 15:15:25 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-3e9e3439-0f0a-450d-9a6e-1968adf5d4b0 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.028s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:15:25 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-cd2ad82a-a731-4036-8c2c-3e60f36b6752 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.372s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:15:25 devstack sudo[91039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-5b18bcbf-e358-4b27-b079-bff25ab2ec17.ea81d119-9f42-4534-ba5f-7f94f7f8a737 Apr 16 15:15:25 devstack sudo[91039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:25 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-cd2ad82a-a731-4036-8c2c-3e60f36b6752 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:15:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-945370873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed93ac07-982f-4c55-a31e-8bbdb7eb2ad2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19556a2b539946c1ab8a738718adb68d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:15:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:15:19Z,use_quota=True,user_id='a7c6856e1be54beea670dbbd9950ee83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)}" {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 15:15:25 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-cd2ad82a-a731-4036-8c2c-3e60f36b6752 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Creating volume ed93ac07-982f-4c55-a31e-8bbdb7eb2ad2 {{(pid=82756) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 15:15:25 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-cd2ad82a-a731-4036-8c2c-3e60f36b6752 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:15:25 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-cd2ad82a-a731-4036-8c2c-3e60f36b6752 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:15:25 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-cd2ad82a-a731-4036-8c2c-3e60f36b6752 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:15:25 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-cd2ad82a-a731-4036-8c2c-3e60f36b6752 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:15:25 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-cd2ad82a-a731-4036-8c2c-3e60f36b6752 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:15:25 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-cd2ad82a-a731-4036-8c2c-3e60f36b6752 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Selected osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 as target Quobyte volume. {{(pid=82756) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 15:15:25 devstack cinder-volume[82756]: INFO cinder.volume.drivers.remotefs [None req-cd2ad82a-a731-4036-8c2c-3e60f36b6752 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] casted to osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 Apr 16 15:15:25 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-cd2ad82a-a731-4036-8c2c-3e60f36b6752 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-ed93ac07-982f-4c55-a31e-8bbdb7eb2ad2 1073741824 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:25 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-3e9e3439-0f0a-450d-9a6e-1968adf5d4b0 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (388a40a4-d231-42c5-bc95-c1b1c13ec2e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10e2771d-2a1a-483e-a0b8-14b1e66548d4', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:15:25 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-3e9e3439-0f0a-450d-9a6e-1968adf5d4b0 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e44056ca-29ec-4d3c-a9f2-45a93c67fdfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:15:25 devstack sudo[91041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-ed93ac07-982f-4c55-a31e-8bbdb7eb2ad2 1073741824 Apr 16 15:15:25 devstack sudo[91041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:25 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-3e9e3439-0f0a-450d-9a6e-1968adf5d4b0 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Volume volume-10e2771d-2a1a-483e-a0b8-14b1e66548d4 (10e2771d-2a1a-483e-a0b8-14b1e66548d4): created successfully Apr 16 15:15:25 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-3e9e3439-0f0a-450d-9a6e-1968adf5d4b0 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e44056ca-29ec-4d3c-a9f2-45a93c67fdfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:15:25 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-3e9e3439-0f0a-450d-9a6e-1968adf5d4b0 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Flow 'volume_create_manager' (b97f3379-4d97-4555-b5d4-970785b5ab3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:15:25 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-3e9e3439-0f0a-450d-9a6e-1968adf5d4b0 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Created volume successfully. Apr 16 15:15:25 devstack sudo[91030]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:25 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-c0caf50a-0efb-45c9-a561-6ef0a50c89d3 tempest-SnapshotDependencyTests-858447260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-386dcbae-cb25-4737-8aeb-cfee8921c168.8e40ff69-9bff-4660-8807-885f971f06fb" returned: 0 in 0.523s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:25 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-c0caf50a-0efb-45c9-a561-6ef0a50c89d3 tempest-SnapshotDependencyTests-858447260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-386dcbae-cb25-4737-8aeb-cfee8921c168.8e40ff69-9bff-4660-8807-885f971f06fb {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:25 devstack sudo[91043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-386dcbae-cb25-4737-8aeb-cfee8921c168.8e40ff69-9bff-4660-8807-885f971f06fb Apr 16 15:15:25 devstack sudo[91043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:25 devstack sudo[91039]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:25 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-d3031882-5ede-4cfc-b940-725a3f0d5360 tempest-CreateVolumesFromSnapshotTest-1272343304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-5b18bcbf-e358-4b27-b079-bff25ab2ec17.ea81d119-9f42-4534-ba5f-7f94f7f8a737" returned: 0 in 0.427s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:25 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-d3031882-5ede-4cfc-b940-725a3f0d5360 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Lock "cinder-quobyte-ea81d119-9f42-4534-ba5f-7f94f7f8a737" released by "_delete_snapshot" :: held 2.123s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:15:25 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-d3031882-5ede-4cfc-b940-725a3f0d5360 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Lock "cinder-quobyte-5b18bcbf-e358-4b27-b079-bff25ab2ec17" released by "delete_snapshot" :: held 2.138s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:15:25 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-d3031882-5ede-4cfc-b940-725a3f0d5360 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Created reservations ['3cb4ed42-3961-48cd-a08b-3a1b57003f74', 'f764ff29-6e62-4feb-9c97-b23abdd78536', 'fe2a0f9d-f8c3-4588-9bfb-cd144c33a8e2', 'cb573c39-2215-422d-892d-1f33349417c1'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:15:25 devstack sudo[91041]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:25 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-cd2ad82a-a731-4036-8c2c-3e60f36b6752 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-ed93ac07-982f-4c55-a31e-8bbdb7eb2ad2 1073741824" returned: 0 in 0.534s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:25 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-d3031882-5ede-4cfc-b940-725a3f0d5360 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Delete snapshot completed successfully. Apr 16 15:15:25 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-d3031882-5ede-4cfc-b940-725a3f0d5360 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Lock "cinder-ea81d119-9f42-4534-ba5f-7f94f7f8a737-delete_snapshot" released by "delete_snapshot" :: held 2.295s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:15:25 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-cd2ad82a-a731-4036-8c2c-3e60f36b6752 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-ed93ac07-982f-4c55-a31e-8bbdb7eb2ad2 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:25 devstack sudo[91043]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:25 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-c0caf50a-0efb-45c9-a561-6ef0a50c89d3 tempest-SnapshotDependencyTests-858447260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-386dcbae-cb25-4737-8aeb-cfee8921c168.8e40ff69-9bff-4660-8807-885f971f06fb" returned: 0 in 0.478s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:25 devstack sudo[91050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-ed93ac07-982f-4c55-a31e-8bbdb7eb2ad2 Apr 16 15:15:25 devstack sudo[91050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:25 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-c0caf50a-0efb-45c9-a561-6ef0a50c89d3 tempest-SnapshotDependencyTests-858447260 None] Lock "cinder-quobyte-8e40ff69-9bff-4660-8807-885f971f06fb" released by "_delete_snapshot" :: held 2.146s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:15:25 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-c0caf50a-0efb-45c9-a561-6ef0a50c89d3 tempest-SnapshotDependencyTests-858447260 None] Lock "cinder-quobyte-386dcbae-cb25-4737-8aeb-cfee8921c168" released by "delete_snapshot" :: held 2.160s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:15:25 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-c0caf50a-0efb-45c9-a561-6ef0a50c89d3 tempest-SnapshotDependencyTests-858447260 None] Created reservations ['0c8bdc5d-ba2e-4ec7-9cf5-0f5e3cc5241b', '19c3c7c8-ced8-49df-8dc2-58fa97b86f4c', 'c6bca522-a689-44f9-a7aa-840e4bd1aceb', '84a9ac37-6618-4583-8d8d-cc32fed68172'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:15:25 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-c0caf50a-0efb-45c9-a561-6ef0a50c89d3 tempest-SnapshotDependencyTests-858447260 None] Delete snapshot completed successfully. Apr 16 15:15:25 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-c0caf50a-0efb-45c9-a561-6ef0a50c89d3 tempest-SnapshotDependencyTests-858447260 None] Lock "cinder-8e40ff69-9bff-4660-8807-885f971f06fb-delete_snapshot" released by "delete_snapshot" :: held 2.240s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:15:26 devstack sudo[91050]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:26 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-cd2ad82a-a731-4036-8c2c-3e60f36b6752 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-ed93ac07-982f-4c55-a31e-8bbdb7eb2ad2" returned: 0 in 0.405s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:26 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-cd2ad82a-a731-4036-8c2c-3e60f36b6752 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] <== create_volume: return (968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'} {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 15:15:26 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-cd2ad82a-a731-4036-8c2c-3e60f36b6752 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.972s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:15:26 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-95c5b375-1afa-439f-8225-2595dcb6be78 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.894s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:15:26 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-95c5b375-1afa-439f-8225-2595dcb6be78 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:15:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1658173287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f01eeb6a-6ab1-4651-ae94-243ee9f99d70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19556a2b539946c1ab8a738718adb68d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:15:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:15:19Z,use_quota=True,user_id='a7c6856e1be54beea670dbbd9950ee83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)}" {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 15:15:26 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-95c5b375-1afa-439f-8225-2595dcb6be78 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Creating volume f01eeb6a-6ab1-4651-ae94-243ee9f99d70 {{(pid=82756) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 15:15:26 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-95c5b375-1afa-439f-8225-2595dcb6be78 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:15:26 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-95c5b375-1afa-439f-8225-2595dcb6be78 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:15:26 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-95c5b375-1afa-439f-8225-2595dcb6be78 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:15:26 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-95c5b375-1afa-439f-8225-2595dcb6be78 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:15:26 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-95c5b375-1afa-439f-8225-2595dcb6be78 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:15:26 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-95c5b375-1afa-439f-8225-2595dcb6be78 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Selected osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 as target Quobyte volume. {{(pid=82756) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 15:15:26 devstack cinder-volume[82756]: INFO cinder.volume.drivers.remotefs [None req-95c5b375-1afa-439f-8225-2595dcb6be78 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] casted to osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 Apr 16 15:15:26 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-95c5b375-1afa-439f-8225-2595dcb6be78 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-f01eeb6a-6ab1-4651-ae94-243ee9f99d70 1073741824 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:26 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-cd2ad82a-a731-4036-8c2c-3e60f36b6752 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6024b618-113e-4d2a-8190-35ae27aea82a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed93ac07-982f-4c55-a31e-8bbdb7eb2ad2', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:15:26 devstack sudo[91053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-f01eeb6a-6ab1-4651-ae94-243ee9f99d70 1073741824 Apr 16 15:15:26 devstack sudo[91053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:26 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-cd2ad82a-a731-4036-8c2c-3e60f36b6752 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54def7a6-4fa7-45ae-85e5-2c4ec3aa9c19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:15:26 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-cd2ad82a-a731-4036-8c2c-3e60f36b6752 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Volume volume-ed93ac07-982f-4c55-a31e-8bbdb7eb2ad2 (ed93ac07-982f-4c55-a31e-8bbdb7eb2ad2): created successfully Apr 16 15:15:26 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-cd2ad82a-a731-4036-8c2c-3e60f36b6752 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54def7a6-4fa7-45ae-85e5-2c4ec3aa9c19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:15:26 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-cd2ad82a-a731-4036-8c2c-3e60f36b6752 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Flow 'volume_create_manager' (b34593ff-50a4-4f57-8eb9-a9ef0952034a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:15:26 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-cd2ad82a-a731-4036-8c2c-3e60f36b6752 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Created volume successfully. Apr 16 15:15:26 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-0a66022e-493c-450b-830d-2a5fa2a63f83 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Acquiring lock "cinder-5b18bcbf-e358-4b27-b079-bff25ab2ec17-delete_volume" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:15:26 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-0a66022e-493c-450b-830d-2a5fa2a63f83 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Lock "cinder-5b18bcbf-e358-4b27-b079-bff25ab2ec17-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:15:26 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-0a66022e-493c-450b-830d-2a5fa2a63f83 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Acquiring lock "cinder-quobyte-5b18bcbf-e358-4b27-b079-bff25ab2ec17" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:15:26 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-0a66022e-493c-450b-830d-2a5fa2a63f83 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Lock "cinder-quobyte-5b18bcbf-e358-4b27-b079-bff25ab2ec17" acquired by "delete_volume" :: waited 0.012s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:15:26 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[63ec0592-282b-4bb9-a437-ed25f0cd53ef]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:15:26 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-0a66022e-493c-450b-830d-2a5fa2a63f83 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-5b18bcbf-e358-4b27-b079-bff25ab2ec17 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:26 devstack sudo[91053]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:26 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-95c5b375-1afa-439f-8225-2595dcb6be78 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-f01eeb6a-6ab1-4651-ae94-243ee9f99d70 1073741824" returned: 0 in 0.534s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:26 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-95c5b375-1afa-439f-8225-2595dcb6be78 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-f01eeb6a-6ab1-4651-ae94-243ee9f99d70 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:26 devstack sudo[91059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-f01eeb6a-6ab1-4651-ae94-243ee9f99d70 Apr 16 15:15:26 devstack sudo[91059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:26 devstack sudo[91058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-5b18bcbf-e358-4b27-b079-bff25ab2ec17 Apr 16 15:15:26 devstack sudo[91058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:26 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-60778763-3b5d-488b-972d-33596ab9bb8f tempest-SnapshotDependencyTests-858447260 None] Acquiring lock "cinder-386dcbae-cb25-4737-8aeb-cfee8921c168-delete_volume" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:15:26 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-60778763-3b5d-488b-972d-33596ab9bb8f tempest-SnapshotDependencyTests-858447260 None] Lock "cinder-386dcbae-cb25-4737-8aeb-cfee8921c168-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:15:26 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-60778763-3b5d-488b-972d-33596ab9bb8f tempest-SnapshotDependencyTests-858447260 None] Acquiring lock "cinder-quobyte-386dcbae-cb25-4737-8aeb-cfee8921c168" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:15:26 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-60778763-3b5d-488b-972d-33596ab9bb8f tempest-SnapshotDependencyTests-858447260 None] Lock "cinder-quobyte-386dcbae-cb25-4737-8aeb-cfee8921c168" acquired by "delete_volume" :: waited 0.008s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:15:27 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[02a2770c-8e76-47f4-bb4b-182017c7a201]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:15:27 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-60778763-3b5d-488b-972d-33596ab9bb8f tempest-SnapshotDependencyTests-858447260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-386dcbae-cb25-4737-8aeb-cfee8921c168 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:27 devstack sudo[91062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-386dcbae-cb25-4737-8aeb-cfee8921c168 Apr 16 15:15:27 devstack sudo[91062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:27 devstack sudo[91059]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:27 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-95c5b375-1afa-439f-8225-2595dcb6be78 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-f01eeb6a-6ab1-4651-ae94-243ee9f99d70" returned: 0 in 0.456s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:27 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-95c5b375-1afa-439f-8225-2595dcb6be78 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] <== create_volume: return (1020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'} {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 15:15:27 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-95c5b375-1afa-439f-8225-2595dcb6be78 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.023s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:15:27 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-5d7575c0-ffa8-401c-87f1-662d0ad0f4e6 tempest-VolumeDependencyTests-1769369869 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 7.812s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:15:27 devstack cinder-volume[82756]: INFO cinder.volume.drivers.remotefs [None req-5d7575c0-ffa8-401c-87f1-662d0ad0f4e6 tempest-VolumeDependencyTests-1769369869 None] Cloning volume 2bc2e54d-6a3a-4640-ace4-bfddd5a56056 to volume 6d1517b4-9e46-4ff0-85b3-a37774ce20ef Apr 16 15:15:27 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-95c5b375-1afa-439f-8225-2595dcb6be78 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (009afac1-a975-43ea-a83c-456c3819ab0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f01eeb6a-6ab1-4651-ae94-243ee9f99d70', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:15:27 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-95c5b375-1afa-439f-8225-2595dcb6be78 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34ad6863-f3ab-4c23-9019-ad575c147bcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:15:27 devstack sudo[91058]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:27 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-0a66022e-493c-450b-830d-2a5fa2a63f83 tempest-CreateVolumesFromSnapshotTest-1272343304 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-5b18bcbf-e358-4b27-b079-bff25ab2ec17" returned: 0 in 0.541s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:27 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-0a66022e-493c-450b-830d-2a5fa2a63f83 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-5b18bcbf-e358-4b27-b079-bff25ab2ec17 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:27 devstack sudo[91068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-5b18bcbf-e358-4b27-b079-bff25ab2ec17 Apr 16 15:15:27 devstack sudo[91068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:27 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-95c5b375-1afa-439f-8225-2595dcb6be78 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Volume volume-f01eeb6a-6ab1-4651-ae94-243ee9f99d70 (f01eeb6a-6ab1-4651-ae94-243ee9f99d70): created successfully Apr 16 15:15:27 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-95c5b375-1afa-439f-8225-2595dcb6be78 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34ad6863-f3ab-4c23-9019-ad575c147bcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:15:27 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-95c5b375-1afa-439f-8225-2595dcb6be78 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Flow 'volume_create_manager' (dda6f716-b0fc-4a42-861d-12fbf0ab6e07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:15:27 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-5d7575c0-ffa8-401c-87f1-662d0ad0f4e6 tempest-VolumeDependencyTests-1769369869 None] Creating offline snapshot 5926b5ec-03bc-4290-9f30-858cb171c027 of volume 2bc2e54d-6a3a-4640-ace4-bfddd5a56056 {{(pid=82756) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 16 15:15:27 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-95c5b375-1afa-439f-8225-2595dcb6be78 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Created volume successfully. Apr 16 15:15:27 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b99e64b-1332-46bf-9d1b-2ed2f9952e3e]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:15:27 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-5d7575c0-ffa8-401c-87f1-662d0ad0f4e6 tempest-VolumeDependencyTests-1769369869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2bc2e54d-6a3a-4640-ace4-bfddd5a56056 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:27 devstack sudo[91071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2bc2e54d-6a3a-4640-ace4-bfddd5a56056 Apr 16 15:15:27 devstack sudo[91071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:27 devstack sudo[91062]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:27 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-60778763-3b5d-488b-972d-33596ab9bb8f tempest-SnapshotDependencyTests-858447260 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-386dcbae-cb25-4737-8aeb-cfee8921c168" returned: 0 in 0.498s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:27 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-60778763-3b5d-488b-972d-33596ab9bb8f tempest-SnapshotDependencyTests-858447260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-386dcbae-cb25-4737-8aeb-cfee8921c168 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:27 devstack sudo[91075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-386dcbae-cb25-4737-8aeb-cfee8921c168 Apr 16 15:15:27 devstack sudo[91075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:27 devstack sudo[91068]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:27 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-0a66022e-493c-450b-830d-2a5fa2a63f83 tempest-CreateVolumesFromSnapshotTest-1272343304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-5b18bcbf-e358-4b27-b079-bff25ab2ec17" returned: 0 in 0.425s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:27 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-0a66022e-493c-450b-830d-2a5fa2a63f83 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Lock "cinder-quobyte-5b18bcbf-e358-4b27-b079-bff25ab2ec17" released by "delete_volume" :: held 0.996s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:15:27 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-0a66022e-493c-450b-830d-2a5fa2a63f83 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Created reservations ['27430b45-5278-4146-8491-53f6de664125', '0b43c8e5-19fe-4d3e-b6e9-65d006051348', 'ae1441af-abd5-421f-a3b1-24266d6482bc', 'a1605daa-f59c-4fe7-83d8-d28789796bc7'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:15:27 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-0a66022e-493c-450b-830d-2a5fa2a63f83 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:15:27 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-0a66022e-493c-450b-830d-2a5fa2a63f83 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:15:27 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-0a66022e-493c-450b-830d-2a5fa2a63f83 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:15:27 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-0a66022e-493c-450b-830d-2a5fa2a63f83 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:15:27 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-0a66022e-493c-450b-830d-2a5fa2a63f83 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:15:27 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-0a66022e-493c-450b-830d-2a5fa2a63f83 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:27 devstack sudo[91082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:15:27 devstack sudo[91082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:27 devstack sudo[91071]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:27 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-5d7575c0-ffa8-401c-87f1-662d0ad0f4e6 tempest-VolumeDependencyTests-1769369869 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2bc2e54d-6a3a-4640-ace4-bfddd5a56056" returned: 0 in 0.526s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:27 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-5d7575c0-ffa8-401c-87f1-662d0ad0f4e6 tempest-VolumeDependencyTests-1769369869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2bc2e54d-6a3a-4640-ace4-bfddd5a56056,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2bc2e54d-6a3a-4640-ace4-bfddd5a56056.5926b5ec-03bc-4290-9f30-858cb171c027 1G {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:27 devstack sudo[91084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2bc2e54d-6a3a-4640-ace4-bfddd5a56056,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2bc2e54d-6a3a-4640-ace4-bfddd5a56056.5926b5ec-03bc-4290-9f30-858cb171c027 1G Apr 16 15:15:27 devstack sudo[91084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:27 devstack sudo[91075]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:27 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-60778763-3b5d-488b-972d-33596ab9bb8f tempest-SnapshotDependencyTests-858447260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-386dcbae-cb25-4737-8aeb-cfee8921c168" returned: 0 in 0.483s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:27 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-60778763-3b5d-488b-972d-33596ab9bb8f tempest-SnapshotDependencyTests-858447260 None] Lock "cinder-quobyte-386dcbae-cb25-4737-8aeb-cfee8921c168" released by "delete_volume" :: held 1.039s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:15:28 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-60778763-3b5d-488b-972d-33596ab9bb8f tempest-SnapshotDependencyTests-858447260 None] Created reservations ['cd169f33-6725-4d21-aad5-3b20e1e136c9', 'e454bb57-b12a-4cfe-b72c-4591da848cb7', 'c5c0e08a-191c-4f7e-b7d0-8f3ae27c53c1', 'e5f06620-47d4-4a9a-8a90-8530f16dbd36'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:15:28 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-60778763-3b5d-488b-972d-33596ab9bb8f tempest-SnapshotDependencyTests-858447260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:15:28 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-60778763-3b5d-488b-972d-33596ab9bb8f tempest-SnapshotDependencyTests-858447260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:15:28 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-60778763-3b5d-488b-972d-33596ab9bb8f tempest-SnapshotDependencyTests-858447260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:15:28 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-60778763-3b5d-488b-972d-33596ab9bb8f tempest-SnapshotDependencyTests-858447260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:15:28 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-60778763-3b5d-488b-972d-33596ab9bb8f tempest-SnapshotDependencyTests-858447260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:15:28 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-60778763-3b5d-488b-972d-33596ab9bb8f tempest-SnapshotDependencyTests-858447260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:28 devstack sudo[91086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:15:28 devstack sudo[91086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:28 devstack sudo[91084]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:28 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-5d7575c0-ffa8-401c-87f1-662d0ad0f4e6 tempest-VolumeDependencyTests-1769369869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2bc2e54d-6a3a-4640-ace4-bfddd5a56056,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2bc2e54d-6a3a-4640-ace4-bfddd5a56056.5926b5ec-03bc-4290-9f30-858cb171c027 1G" returned: 0 in 0.473s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:28 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-5d7575c0-ffa8-401c-87f1-662d0ad0f4e6 tempest-VolumeDependencyTests-1769369869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2bc2e54d-6a3a-4640-ace4-bfddd5a56056 -F qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2bc2e54d-6a3a-4640-ace4-bfddd5a56056.5926b5ec-03bc-4290-9f30-858cb171c027 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:28 devstack sudo[91082]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:28 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-0a66022e-493c-450b-830d-2a5fa2a63f83 tempest-CreateVolumesFromSnapshotTest-1272343304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.540s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:28 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-0a66022e-493c-450b-830d-2a5fa2a63f83 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:15:28 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-0a66022e-493c-450b-830d-2a5fa2a63f83 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Deleted volume successfully. Apr 16 15:15:28 devstack sudo[91092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2bc2e54d-6a3a-4640-ace4-bfddd5a56056 -F qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2bc2e54d-6a3a-4640-ace4-bfddd5a56056.5926b5ec-03bc-4290-9f30-858cb171c027 Apr 16 15:15:28 devstack sudo[91092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:28 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-0a66022e-493c-450b-830d-2a5fa2a63f83 tempest-CreateVolumesFromSnapshotTest-1272343304 None] Lock "cinder-5b18bcbf-e358-4b27-b079-bff25ab2ec17-delete_volume" released by "delete_volume" :: held 1.699s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:15:28 devstack sudo[91086]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:28 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-60778763-3b5d-488b-972d-33596ab9bb8f tempest-SnapshotDependencyTests-858447260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.447s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:28 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-60778763-3b5d-488b-972d-33596ab9bb8f tempest-SnapshotDependencyTests-858447260 None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:15:28 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-60778763-3b5d-488b-972d-33596ab9bb8f tempest-SnapshotDependencyTests-858447260 None] Deleted volume successfully. Apr 16 15:15:28 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-60778763-3b5d-488b-972d-33596ab9bb8f tempest-SnapshotDependencyTests-858447260 None] Lock "cinder-386dcbae-cb25-4737-8aeb-cfee8921c168-delete_volume" released by "delete_volume" :: held 1.627s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:15:28 devstack sudo[91092]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:28 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-5d7575c0-ffa8-401c-87f1-662d0ad0f4e6 tempest-VolumeDependencyTests-1769369869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2bc2e54d-6a3a-4640-ace4-bfddd5a56056 -F qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2bc2e54d-6a3a-4640-ace4-bfddd5a56056.5926b5ec-03bc-4290-9f30-858cb171c027" returned: 0 in 0.437s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:28 devstack cinder-volume[82756]: WARNING cinder.volume.drivers.remotefs [None req-5d7575c0-ffa8-401c-87f1-662d0ad0f4e6 tempest-VolumeDependencyTests-1769369869 None] /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2bc2e54d-6a3a-4640-ace4-bfddd5a56056.5926b5ec-03bc-4290-9f30-858cb171c027 is being set with open permissions: ugo+rw Apr 16 15:15:28 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-5d7575c0-ffa8-401c-87f1-662d0ad0f4e6 tempest-VolumeDependencyTests-1769369869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2bc2e54d-6a3a-4640-ace4-bfddd5a56056.5926b5ec-03bc-4290-9f30-858cb171c027 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:28 devstack sudo[91098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2bc2e54d-6a3a-4640-ace4-bfddd5a56056.5926b5ec-03bc-4290-9f30-858cb171c027 Apr 16 15:15:28 devstack sudo[91098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:29 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-03c0be37-2d95-40a1-81e9-92a9af8609bc tempest-SnapshotDependencyTests-858447260 None] Acquiring lock "cinder-766518cd-40f1-4e5e-a590-cca5ef04ea08-delete_volume" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:15:29 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-03c0be37-2d95-40a1-81e9-92a9af8609bc tempest-SnapshotDependencyTests-858447260 None] Lock "cinder-766518cd-40f1-4e5e-a590-cca5ef04ea08-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:15:29 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-03c0be37-2d95-40a1-81e9-92a9af8609bc tempest-SnapshotDependencyTests-858447260 None] Acquiring lock "cinder-quobyte-766518cd-40f1-4e5e-a590-cca5ef04ea08" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:15:29 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-03c0be37-2d95-40a1-81e9-92a9af8609bc tempest-SnapshotDependencyTests-858447260 None] Lock "cinder-quobyte-766518cd-40f1-4e5e-a590-cca5ef04ea08" acquired by "delete_volume" :: waited 0.006s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:15:29 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a220e75-e610-4a86-8975-ff599b9121b1]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:15:29 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-03c0be37-2d95-40a1-81e9-92a9af8609bc tempest-SnapshotDependencyTests-858447260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-766518cd-40f1-4e5e-a590-cca5ef04ea08 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:29 devstack sudo[91098]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:29 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-5d7575c0-ffa8-401c-87f1-662d0ad0f4e6 tempest-VolumeDependencyTests-1769369869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2bc2e54d-6a3a-4640-ace4-bfddd5a56056.5926b5ec-03bc-4290-9f30-858cb171c027" returned: 0 in 0.443s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:29 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-5d7575c0-ffa8-401c-87f1-662d0ad0f4e6 tempest-VolumeDependencyTests-1769369869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2bc2e54d-6a3a-4640-ace4-bfddd5a56056.info {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:29 devstack sudo[91101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-766518cd-40f1-4e5e-a590-cca5ef04ea08 Apr 16 15:15:29 devstack sudo[91101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:29 devstack sudo[91102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2bc2e54d-6a3a-4640-ace4-bfddd5a56056.info Apr 16 15:15:29 devstack sudo[91102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:29 devstack sudo[91101]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:29 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-03c0be37-2d95-40a1-81e9-92a9af8609bc tempest-SnapshotDependencyTests-858447260 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-766518cd-40f1-4e5e-a590-cca5ef04ea08" returned: 0 in 0.622s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:29 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-03c0be37-2d95-40a1-81e9-92a9af8609bc tempest-SnapshotDependencyTests-858447260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-766518cd-40f1-4e5e-a590-cca5ef04ea08 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:29 devstack sudo[91110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-766518cd-40f1-4e5e-a590-cca5ef04ea08 Apr 16 15:15:29 devstack sudo[91110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:29 devstack sudo[91102]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:29 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-5d7575c0-ffa8-401c-87f1-662d0ad0f4e6 tempest-VolumeDependencyTests-1769369869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2bc2e54d-6a3a-4640-ace4-bfddd5a56056.info" returned: 0 in 0.611s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:29 devstack cinder-volume[82756]: WARNING cinder.volume.drivers.remotefs [None req-5d7575c0-ffa8-401c-87f1-662d0ad0f4e6 tempest-VolumeDependencyTests-1769369869 None] /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2bc2e54d-6a3a-4640-ace4-bfddd5a56056.info is being set with open permissions: ugo+rw Apr 16 15:15:29 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-5d7575c0-ffa8-401c-87f1-662d0ad0f4e6 tempest-VolumeDependencyTests-1769369869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2bc2e54d-6a3a-4640-ace4-bfddd5a56056.info {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:29 devstack sudo[91112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2bc2e54d-6a3a-4640-ace4-bfddd5a56056.info Apr 16 15:15:29 devstack sudo[91112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:30 devstack sudo[91110]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:30 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-03c0be37-2d95-40a1-81e9-92a9af8609bc tempest-SnapshotDependencyTests-858447260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-766518cd-40f1-4e5e-a590-cca5ef04ea08" returned: 0 in 0.572s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:30 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-03c0be37-2d95-40a1-81e9-92a9af8609bc tempest-SnapshotDependencyTests-858447260 None] Lock "cinder-quobyte-766518cd-40f1-4e5e-a590-cca5ef04ea08" released by "delete_volume" :: held 1.226s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:15:30 devstack sudo[91112]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:30 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-5d7575c0-ffa8-401c-87f1-662d0ad0f4e6 tempest-VolumeDependencyTests-1769369869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2bc2e54d-6a3a-4640-ace4-bfddd5a56056.info" returned: 0 in 0.517s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:30 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-5d7575c0-ffa8-401c-87f1-662d0ad0f4e6 tempest-VolumeDependencyTests-1769369869 None] Acquiring lock "cinder-quobyte-6d1517b4-9e46-4ff0-85b3-a37774ce20ef" by "_copy_volume_from_snapshot" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:15:30 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-5d7575c0-ffa8-401c-87f1-662d0ad0f4e6 tempest-VolumeDependencyTests-1769369869 None] Lock "cinder-quobyte-6d1517b4-9e46-4ff0-85b3-a37774ce20ef" acquired by "_copy_volume_from_snapshot" :: waited 0.010s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:15:30 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-5d7575c0-ffa8-401c-87f1-662d0ad0f4e6 tempest-VolumeDependencyTests-1769369869 None] snapshot: 5926b5ec-03bc-4290-9f30-858cb171c027, volume: 6d1517b4-9e46-4ff0-85b3-a37774ce20ef, {{(pid=82756) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 16 15:15:30 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-5d7575c0-ffa8-401c-87f1-662d0ad0f4e6 tempest-VolumeDependencyTests-1769369869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:15:30 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-5d7575c0-ffa8-401c-87f1-662d0ad0f4e6 tempest-VolumeDependencyTests-1769369869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:15:30 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-5d7575c0-ffa8-401c-87f1-662d0ad0f4e6 tempest-VolumeDependencyTests-1769369869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:15:30 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-5d7575c0-ffa8-401c-87f1-662d0ad0f4e6 tempest-VolumeDependencyTests-1769369869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:15:30 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-5d7575c0-ffa8-401c-87f1-662d0ad0f4e6 tempest-VolumeDependencyTests-1769369869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:15:30 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[67691e58-0850-4f70-961d-f7df897e6fe9]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:15:30 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-5d7575c0-ffa8-401c-87f1-662d0ad0f4e6 tempest-VolumeDependencyTests-1769369869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2bc2e54d-6a3a-4640-ace4-bfddd5a56056.5926b5ec-03bc-4290-9f30-858cb171c027 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:30 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-03c0be37-2d95-40a1-81e9-92a9af8609bc tempest-SnapshotDependencyTests-858447260 None] Created reservations ['3433a99d-4b2e-4ac0-9445-d9cb55c17d65', '294b0a3d-4ee5-48d3-940b-b4f87806bb44', 'a2477c1d-05ba-4eb5-8686-52fde20d86b8', '254658a5-6017-4e35-a2ac-98e46c6cd50a'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:15:30 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-03c0be37-2d95-40a1-81e9-92a9af8609bc tempest-SnapshotDependencyTests-858447260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:15:30 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-03c0be37-2d95-40a1-81e9-92a9af8609bc tempest-SnapshotDependencyTests-858447260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:15:30 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-03c0be37-2d95-40a1-81e9-92a9af8609bc tempest-SnapshotDependencyTests-858447260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:15:30 devstack sudo[91117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2bc2e54d-6a3a-4640-ace4-bfddd5a56056.5926b5ec-03bc-4290-9f30-858cb171c027 Apr 16 15:15:30 devstack sudo[91117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:30 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-03c0be37-2d95-40a1-81e9-92a9af8609bc tempest-SnapshotDependencyTests-858447260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:15:30 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-03c0be37-2d95-40a1-81e9-92a9af8609bc tempest-SnapshotDependencyTests-858447260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:15:30 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-03c0be37-2d95-40a1-81e9-92a9af8609bc tempest-SnapshotDependencyTests-858447260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:30 devstack sudo[91119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:15:30 devstack sudo[91119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:30 devstack sudo[91117]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:30 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-5d7575c0-ffa8-401c-87f1-662d0ad0f4e6 tempest-VolumeDependencyTests-1769369869 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2bc2e54d-6a3a-4640-ace4-bfddd5a56056.5926b5ec-03bc-4290-9f30-858cb171c027" returned: 0 in 0.516s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:30 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-5d7575c0-ffa8-401c-87f1-662d0ad0f4e6 tempest-VolumeDependencyTests-1769369869 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2bc2e54d-6a3a-4640-ace4-bfddd5a56056(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82756) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 15:15:30 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-5d7575c0-ffa8-401c-87f1-662d0ad0f4e6 tempest-VolumeDependencyTests-1769369869 None] will copy from snapshot at /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2bc2e54d-6a3a-4640-ace4-bfddd5a56056 {{(pid=82756) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 16 15:15:30 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-5d7575c0-ffa8-401c-87f1-662d0ad0f4e6 tempest-VolumeDependencyTests-1769369869 None] Creating direct copy from snapshot {{(pid=82756) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 16 15:15:30 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[50e07caf-16ce-498a-b230-d912065418f5]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:15:30 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-5d7575c0-ffa8-401c-87f1-662d0ad0f4e6 tempest-VolumeDependencyTests-1769369869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2bc2e54d-6a3a-4640-ace4-bfddd5a56056 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:31 devstack sudo[91119]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:31 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-03c0be37-2d95-40a1-81e9-92a9af8609bc tempest-SnapshotDependencyTests-858447260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.471s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:31 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-03c0be37-2d95-40a1-81e9-92a9af8609bc tempest-SnapshotDependencyTests-858447260 None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:15:31 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-03c0be37-2d95-40a1-81e9-92a9af8609bc tempest-SnapshotDependencyTests-858447260 None] Deleted volume successfully. Apr 16 15:15:31 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-03c0be37-2d95-40a1-81e9-92a9af8609bc tempest-SnapshotDependencyTests-858447260 None] Lock "cinder-766518cd-40f1-4e5e-a590-cca5ef04ea08-delete_volume" released by "delete_volume" :: held 1.901s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:15:31 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d421b40-a2cd-4ed7-871f-a3bcd28b8a83 tempest-CinderUnicodeTest-1113442512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82756) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 15:15:31 devstack sudo[91125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2bc2e54d-6a3a-4640-ace4-bfddd5a56056 Apr 16 15:15:31 devstack sudo[91125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:31 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-1d421b40-a2cd-4ed7-871f-a3bcd28b8a83 tempest-CinderUnicodeTest-1113442512 None] Flow 'volume_create_manager' (7a3952c8-17f8-42f6-9a67-6c2a287ba81f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:15:31 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-1d421b40-a2cd-4ed7-871f-a3bcd28b8a83 tempest-CinderUnicodeTest-1113442512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (698cc356-4353-454c-8a35-748064d381da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:15:31 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-1d421b40-a2cd-4ed7-871f-a3bcd28b8a83 tempest-CinderUnicodeTest-1113442512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (698cc356-4353-454c-8a35-748064d381da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:15:31Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c64c84d-3e7a-44ae-b871-2fa4dc1b6e46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b8d06c169284a228672b4d0094ca454',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:15:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:15:31Z,use_quota=True,user_id='38c5aa22424244c3a49007cca11a16d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:15:31 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-1d421b40-a2cd-4ed7-871f-a3bcd28b8a83 tempest-CinderUnicodeTest-1113442512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d17f0199-b9a4-4f28-b781-a997f6fd1f09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:15:31 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-1d421b40-a2cd-4ed7-871f-a3bcd28b8a83 tempest-CinderUnicodeTest-1113442512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d17f0199-b9a4-4f28-b781-a997f6fd1f09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:15:31 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-1d421b40-a2cd-4ed7-871f-a3bcd28b8a83 tempest-CinderUnicodeTest-1113442512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1182b82e-c61f-45cb-9f09-654042b60541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:15:31 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-1d421b40-a2cd-4ed7-871f-a3bcd28b8a83 tempest-CinderUnicodeTest-1113442512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1182b82e-c61f-45cb-9f09-654042b60541) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c64c84d-3e7a-44ae-b871-2fa4dc1b6e46', 'volume_name': 'volume-8c64c84d-3e7a-44ae-b871-2fa4dc1b6e46', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:15:31 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-1d421b40-a2cd-4ed7-871f-a3bcd28b8a83 tempest-CinderUnicodeTest-1113442512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ebf07d2-f12e-4fe5-8853-63c254f808bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:15:31 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-1d421b40-a2cd-4ed7-871f-a3bcd28b8a83 tempest-CinderUnicodeTest-1113442512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ebf07d2-f12e-4fe5-8853-63c254f808bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:15:31 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-1d421b40-a2cd-4ed7-871f-a3bcd28b8a83 tempest-CinderUnicodeTest-1113442512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daf6b4d3-9413-4c99-b916-5063cd53ccbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:15:31 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-1d421b40-a2cd-4ed7-871f-a3bcd28b8a83 tempest-CinderUnicodeTest-1113442512 None] Volume 8c64c84d-3e7a-44ae-b871-2fa4dc1b6e46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c64c84d-3e7a-44ae-b871-2fa4dc1b6e46', 'volume_size': 1} Apr 16 15:15:31 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-1d421b40-a2cd-4ed7-871f-a3bcd28b8a83 tempest-CinderUnicodeTest-1113442512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:15:31 devstack sudo[91125]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:31 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-5d7575c0-ffa8-401c-87f1-662d0ad0f4e6 tempest-VolumeDependencyTests-1769369869 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2bc2e54d-6a3a-4640-ace4-bfddd5a56056" returned: 0 in 0.488s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:31 devstack cinder-volume[82756]: DEBUG cinder.utils [None req-5d7575c0-ffa8-401c-87f1-662d0ad0f4e6 tempest-VolumeDependencyTests-1769369869 None] Path /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6d1517b4-9e46-4ff0-85b3-a37774ce20ef not found in is_blk_device check {{(pid=82756) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 16 15:15:31 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-5d7575c0-ffa8-401c-87f1-662d0ad0f4e6 tempest-VolumeDependencyTests-1769369869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2bc2e54d-6a3a-4640-ace4-bfddd5a56056 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6d1517b4-9e46-4ff0-85b3-a37774ce20ef {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:31 devstack sudo[91130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2bc2e54d-6a3a-4640-ace4-bfddd5a56056 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6d1517b4-9e46-4ff0-85b3-a37774ce20ef Apr 16 15:15:31 devstack sudo[91130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:33 devstack sudo[91130]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:33 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-5d7575c0-ffa8-401c-87f1-662d0ad0f4e6 tempest-VolumeDependencyTests-1769369869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2bc2e54d-6a3a-4640-ace4-bfddd5a56056 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6d1517b4-9e46-4ff0-85b3-a37774ce20ef" returned: 0 in 2.341s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:33 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[9163602b-aae1-4cab-a2a1-3469b35b54de]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:15:33 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-5d7575c0-ffa8-401c-87f1-662d0ad0f4e6 tempest-VolumeDependencyTests-1769369869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2bc2e54d-6a3a-4640-ace4-bfddd5a56056 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:33 devstack sudo[91144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2bc2e54d-6a3a-4640-ace4-bfddd5a56056 Apr 16 15:15:33 devstack sudo[91144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:34 devstack sudo[91144]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:34 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-5d7575c0-ffa8-401c-87f1-662d0ad0f4e6 tempest-VolumeDependencyTests-1769369869 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2bc2e54d-6a3a-4640-ace4-bfddd5a56056" returned: 0 in 0.709s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:34 devstack cinder-volume[82756]: DEBUG cinder.image.image_utils [None req-5d7575c0-ffa8-401c-87f1-662d0ad0f4e6 tempest-VolumeDependencyTests-1769369869 None] Image conversion details: src /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2bc2e54d-6a3a-4640-ace4-bfddd5a56056, size 1024.00 MB, duration 2.34 sec, destination /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6d1517b4-9e46-4ff0-85b3-a37774ce20ef {{(pid=82756) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 15:15:34 devstack cinder-volume[82756]: INFO cinder.image.image_utils [None req-5d7575c0-ffa8-401c-87f1-662d0ad0f4e6 tempest-VolumeDependencyTests-1769369869 None] Converted 1024.00 MB image at 437.10 MB/s Apr 16 15:15:34 devstack cinder-volume[82756]: WARNING cinder.volume.drivers.remotefs [None req-5d7575c0-ffa8-401c-87f1-662d0ad0f4e6 tempest-VolumeDependencyTests-1769369869 None] /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6d1517b4-9e46-4ff0-85b3-a37774ce20ef is being set with open permissions: ugo+rw Apr 16 15:15:34 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-5d7575c0-ffa8-401c-87f1-662d0ad0f4e6 tempest-VolumeDependencyTests-1769369869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6d1517b4-9e46-4ff0-85b3-a37774ce20ef {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:34 devstack sudo[91149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6d1517b4-9e46-4ff0-85b3-a37774ce20ef Apr 16 15:15:34 devstack sudo[91149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:35 devstack sudo[91149]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:35 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-5d7575c0-ffa8-401c-87f1-662d0ad0f4e6 tempest-VolumeDependencyTests-1769369869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6d1517b4-9e46-4ff0-85b3-a37774ce20ef" returned: 0 in 0.517s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:35 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-5d7575c0-ffa8-401c-87f1-662d0ad0f4e6 tempest-VolumeDependencyTests-1769369869 None] Lock "cinder-quobyte-6d1517b4-9e46-4ff0-85b3-a37774ce20ef" released by "_copy_volume_from_snapshot" :: held 4.624s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:15:35 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-5d7575c0-ffa8-401c-87f1-662d0ad0f4e6 tempest-VolumeDependencyTests-1769369869 None] Acquiring lock "cinder-quobyte-5926b5ec-03bc-4290-9f30-858cb171c027" by "_delete_snapshot" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:15:35 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-5d7575c0-ffa8-401c-87f1-662d0ad0f4e6 tempest-VolumeDependencyTests-1769369869 None] Lock "cinder-quobyte-5926b5ec-03bc-4290-9f30-858cb171c027" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:15:35 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-5d7575c0-ffa8-401c-87f1-662d0ad0f4e6 tempest-VolumeDependencyTests-1769369869 None] Deleting offline snapshot 5926b5ec-03bc-4290-9f30-858cb171c027 of volume 2bc2e54d-6a3a-4640-ace4-bfddd5a56056 {{(pid=82756) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 15:15:35 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-5d7575c0-ffa8-401c-87f1-662d0ad0f4e6 tempest-VolumeDependencyTests-1769369869 None] snapshot_file for this snap is: volume-2bc2e54d-6a3a-4640-ace4-bfddd5a56056.5926b5ec-03bc-4290-9f30-858cb171c027 {{(pid=82756) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 15:15:35 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[217809ea-76b8-4b27-bc5b-82dd1e657c3e]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:15:35 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-5d7575c0-ffa8-401c-87f1-662d0ad0f4e6 tempest-VolumeDependencyTests-1769369869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2bc2e54d-6a3a-4640-ace4-bfddd5a56056.5926b5ec-03bc-4290-9f30-858cb171c027 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:35 devstack sudo[91153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2bc2e54d-6a3a-4640-ace4-bfddd5a56056.5926b5ec-03bc-4290-9f30-858cb171c027 Apr 16 15:15:35 devstack sudo[91153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:35 devstack sudo[91153]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:35 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-5d7575c0-ffa8-401c-87f1-662d0ad0f4e6 tempest-VolumeDependencyTests-1769369869 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2bc2e54d-6a3a-4640-ace4-bfddd5a56056.5926b5ec-03bc-4290-9f30-858cb171c027" returned: 0 in 0.515s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:35 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-5d7575c0-ffa8-401c-87f1-662d0ad0f4e6 tempest-VolumeDependencyTests-1769369869 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2bc2e54d-6a3a-4640-ace4-bfddd5a56056(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82756) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 15:15:35 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a419c8f-d964-4733-8c22-10b3177d6df3]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:15:35 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-5d7575c0-ffa8-401c-87f1-662d0ad0f4e6 tempest-VolumeDependencyTests-1769369869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2bc2e54d-6a3a-4640-ace4-bfddd5a56056 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:35 devstack sudo[91158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2bc2e54d-6a3a-4640-ace4-bfddd5a56056 Apr 16 15:15:35 devstack sudo[91158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:36 devstack sudo[91158]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:36 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-5d7575c0-ffa8-401c-87f1-662d0ad0f4e6 tempest-VolumeDependencyTests-1769369869 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2bc2e54d-6a3a-4640-ace4-bfddd5a56056" returned: 0 in 0.501s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:36 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-5d7575c0-ffa8-401c-87f1-662d0ad0f4e6 tempest-VolumeDependencyTests-1769369869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2bc2e54d-6a3a-4640-ace4-bfddd5a56056.5926b5ec-03bc-4290-9f30-858cb171c027 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:36 devstack sudo[91164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2bc2e54d-6a3a-4640-ace4-bfddd5a56056.5926b5ec-03bc-4290-9f30-858cb171c027 Apr 16 15:15:36 devstack sudo[91164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:36 devstack sudo[91164]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:36 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-5d7575c0-ffa8-401c-87f1-662d0ad0f4e6 tempest-VolumeDependencyTests-1769369869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2bc2e54d-6a3a-4640-ace4-bfddd5a56056.5926b5ec-03bc-4290-9f30-858cb171c027" returned: 0 in 0.525s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:36 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-5d7575c0-ffa8-401c-87f1-662d0ad0f4e6 tempest-VolumeDependencyTests-1769369869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2bc2e54d-6a3a-4640-ace4-bfddd5a56056.5926b5ec-03bc-4290-9f30-858cb171c027 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:36 devstack sudo[91169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2bc2e54d-6a3a-4640-ace4-bfddd5a56056.5926b5ec-03bc-4290-9f30-858cb171c027 Apr 16 15:15:36 devstack sudo[91169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:37 devstack sudo[91169]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:37 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-5d7575c0-ffa8-401c-87f1-662d0ad0f4e6 tempest-VolumeDependencyTests-1769369869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2bc2e54d-6a3a-4640-ace4-bfddd5a56056.5926b5ec-03bc-4290-9f30-858cb171c027" returned: 0 in 0.498s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:37 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-5d7575c0-ffa8-401c-87f1-662d0ad0f4e6 tempest-VolumeDependencyTests-1769369869 None] Lock "cinder-quobyte-5926b5ec-03bc-4290-9f30-858cb171c027" released by "_delete_snapshot" :: held 2.088s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:15:37 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-5d7575c0-ffa8-401c-87f1-662d0ad0f4e6 tempest-VolumeDependencyTests-1769369869 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.907s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:15:37 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-376635d2-4fce-43eb-8527-996c27ed8d75 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 17.687s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:15:37 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-376635d2-4fce-43eb-8527-996c27ed8d75 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:15:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-995061802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d4781f3-797b-4622-a698-89536138b0cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19556a2b539946c1ab8a738718adb68d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:15:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:15:19Z,use_quota=True,user_id='a7c6856e1be54beea670dbbd9950ee83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)}" {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 15:15:37 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-376635d2-4fce-43eb-8527-996c27ed8d75 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Creating volume 5d4781f3-797b-4622-a698-89536138b0cd {{(pid=82756) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 15:15:37 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-376635d2-4fce-43eb-8527-996c27ed8d75 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:15:37 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-376635d2-4fce-43eb-8527-996c27ed8d75 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:15:37 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-376635d2-4fce-43eb-8527-996c27ed8d75 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:15:37 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-376635d2-4fce-43eb-8527-996c27ed8d75 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:15:37 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-376635d2-4fce-43eb-8527-996c27ed8d75 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:15:37 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-376635d2-4fce-43eb-8527-996c27ed8d75 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Selected osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 as target Quobyte volume. {{(pid=82756) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 15:15:37 devstack cinder-volume[82756]: INFO cinder.volume.drivers.remotefs [None req-376635d2-4fce-43eb-8527-996c27ed8d75 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] casted to osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 Apr 16 15:15:37 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-376635d2-4fce-43eb-8527-996c27ed8d75 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-5d4781f3-797b-4622-a698-89536138b0cd 1073741824 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:37 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-5d7575c0-ffa8-401c-87f1-662d0ad0f4e6 tempest-VolumeDependencyTests-1769369869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ece6e95a-9745-4cac-921f-019f94be6d5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d1517b4-9e46-4ff0-85b3-a37774ce20ef', 'volume_size': 1, 'source_volid': '2bc2e54d-6a3a-4640-ace4-bfddd5a56056', 'source_volstatus': 'available'}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:15:37 devstack sudo[91173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-5d4781f3-797b-4622-a698-89536138b0cd 1073741824 Apr 16 15:15:37 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-5d7575c0-ffa8-401c-87f1-662d0ad0f4e6 tempest-VolumeDependencyTests-1769369869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37ac3fdd-22c0-498f-bccf-e93ea4d14909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:15:37 devstack sudo[91173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:37 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-5d7575c0-ffa8-401c-87f1-662d0ad0f4e6 tempest-VolumeDependencyTests-1769369869 None] Volume volume-6d1517b4-9e46-4ff0-85b3-a37774ce20ef (6d1517b4-9e46-4ff0-85b3-a37774ce20ef): created successfully Apr 16 15:15:37 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-5d7575c0-ffa8-401c-87f1-662d0ad0f4e6 tempest-VolumeDependencyTests-1769369869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37ac3fdd-22c0-498f-bccf-e93ea4d14909) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:15:37 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-5d7575c0-ffa8-401c-87f1-662d0ad0f4e6 tempest-VolumeDependencyTests-1769369869 None] Flow 'volume_create_manager' (a532806d-dce8-4db9-8017-3e88486b9d44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:15:37 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-5d7575c0-ffa8-401c-87f1-662d0ad0f4e6 tempest-VolumeDependencyTests-1769369869 None] Created volume successfully. Apr 16 15:15:37 devstack sudo[91173]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:37 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-376635d2-4fce-43eb-8527-996c27ed8d75 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-5d4781f3-797b-4622-a698-89536138b0cd 1073741824" returned: 0 in 0.548s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:37 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-376635d2-4fce-43eb-8527-996c27ed8d75 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-5d4781f3-797b-4622-a698-89536138b0cd {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:37 devstack sudo[91178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-5d4781f3-797b-4622-a698-89536138b0cd Apr 16 15:15:37 devstack sudo[91178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:38 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-ec60ed1b-efd8-42b5-9e83-78b250eff1c6 tempest-VolumeDependencyTests-1769369869 None] Acquiring lock "cinder-2bc2e54d-6a3a-4640-ace4-bfddd5a56056-delete_volume" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:15:38 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-ec60ed1b-efd8-42b5-9e83-78b250eff1c6 tempest-VolumeDependencyTests-1769369869 None] Lock "cinder-2bc2e54d-6a3a-4640-ace4-bfddd5a56056-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:15:38 devstack sudo[91178]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:38 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-ec60ed1b-efd8-42b5-9e83-78b250eff1c6 tempest-VolumeDependencyTests-1769369869 None] Acquiring lock "cinder-quobyte-2bc2e54d-6a3a-4640-ace4-bfddd5a56056" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:15:38 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-376635d2-4fce-43eb-8527-996c27ed8d75 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-5d4781f3-797b-4622-a698-89536138b0cd" returned: 0 in 0.497s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:38 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-376635d2-4fce-43eb-8527-996c27ed8d75 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] <== create_volume: return (1085ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'} {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 15:15:38 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-376635d2-4fce-43eb-8527-996c27ed8d75 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.087s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:15:38 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-1d421b40-a2cd-4ed7-871f-a3bcd28b8a83 tempest-CinderUnicodeTest-1113442512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.169s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:15:38 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-1d421b40-a2cd-4ed7-871f-a3bcd28b8a83 tempest-CinderUnicodeTest-1113442512 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:15:31Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c64c84d-3e7a-44ae-b871-2fa4dc1b6e46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b8d06c169284a228672b4d0094ca454',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:15:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:15:31Z,use_quota=True,user_id='38c5aa22424244c3a49007cca11a16d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)}" {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 15:15:38 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-1d421b40-a2cd-4ed7-871f-a3bcd28b8a83 tempest-CinderUnicodeTest-1113442512 None] Creating volume 8c64c84d-3e7a-44ae-b871-2fa4dc1b6e46 {{(pid=82756) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 15:15:38 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-1d421b40-a2cd-4ed7-871f-a3bcd28b8a83 tempest-CinderUnicodeTest-1113442512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:15:38 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-1d421b40-a2cd-4ed7-871f-a3bcd28b8a83 tempest-CinderUnicodeTest-1113442512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:15:38 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-1d421b40-a2cd-4ed7-871f-a3bcd28b8a83 tempest-CinderUnicodeTest-1113442512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:15:38 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-1d421b40-a2cd-4ed7-871f-a3bcd28b8a83 tempest-CinderUnicodeTest-1113442512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:15:38 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-1d421b40-a2cd-4ed7-871f-a3bcd28b8a83 tempest-CinderUnicodeTest-1113442512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:15:38 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-1d421b40-a2cd-4ed7-871f-a3bcd28b8a83 tempest-CinderUnicodeTest-1113442512 None] Selected osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 as target Quobyte volume. {{(pid=82756) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 15:15:38 devstack cinder-volume[82756]: INFO cinder.volume.drivers.remotefs [None req-1d421b40-a2cd-4ed7-871f-a3bcd28b8a83 tempest-CinderUnicodeTest-1113442512 None] casted to osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 Apr 16 15:15:38 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-1d421b40-a2cd-4ed7-871f-a3bcd28b8a83 tempest-CinderUnicodeTest-1113442512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-8c64c84d-3e7a-44ae-b871-2fa4dc1b6e46 1073741824 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:38 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-ec60ed1b-efd8-42b5-9e83-78b250eff1c6 tempest-VolumeDependencyTests-1769369869 None] Lock "cinder-quobyte-2bc2e54d-6a3a-4640-ace4-bfddd5a56056" acquired by "delete_volume" :: waited 0.038s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:15:38 devstack sudo[91181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-8c64c84d-3e7a-44ae-b871-2fa4dc1b6e46 1073741824 Apr 16 15:15:38 devstack sudo[91181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:38 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-376635d2-4fce-43eb-8527-996c27ed8d75 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76cbafad-41cb-4028-a770-e732334644b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d4781f3-797b-4622-a698-89536138b0cd', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:15:38 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-376635d2-4fce-43eb-8527-996c27ed8d75 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ba5014d-6fc4-4da1-832d-30c45d544044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:15:38 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[54c1f952-7ec1-4568-ac99-cf4873e3dd07]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:15:38 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-ec60ed1b-efd8-42b5-9e83-78b250eff1c6 tempest-VolumeDependencyTests-1769369869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2bc2e54d-6a3a-4640-ace4-bfddd5a56056 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:38 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-376635d2-4fce-43eb-8527-996c27ed8d75 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Volume volume-5d4781f3-797b-4622-a698-89536138b0cd (5d4781f3-797b-4622-a698-89536138b0cd): created successfully Apr 16 15:15:38 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-376635d2-4fce-43eb-8527-996c27ed8d75 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ba5014d-6fc4-4da1-832d-30c45d544044) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:15:38 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-376635d2-4fce-43eb-8527-996c27ed8d75 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Flow 'volume_create_manager' (22f3db9b-51e5-4cf2-9e6d-efcb552c3e79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:15:38 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-376635d2-4fce-43eb-8527-996c27ed8d75 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Created volume successfully. Apr 16 15:15:38 devstack sudo[91183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2bc2e54d-6a3a-4640-ace4-bfddd5a56056 Apr 16 15:15:38 devstack sudo[91183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:38 devstack sudo[91181]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:38 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-1d421b40-a2cd-4ed7-871f-a3bcd28b8a83 tempest-CinderUnicodeTest-1113442512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-8c64c84d-3e7a-44ae-b871-2fa4dc1b6e46 1073741824" returned: 0 in 0.487s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:38 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-1d421b40-a2cd-4ed7-871f-a3bcd28b8a83 tempest-CinderUnicodeTest-1113442512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-8c64c84d-3e7a-44ae-b871-2fa4dc1b6e46 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:38 devstack sudo[91191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-8c64c84d-3e7a-44ae-b871-2fa4dc1b6e46 Apr 16 15:15:38 devstack sudo[91191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:38 devstack sudo[91183]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:38 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-a22142be-88aa-4cc0-90ba-bbd51a922f5c tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Acquiring lock "cinder-5d4781f3-797b-4622-a698-89536138b0cd-delete_volume" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:15:38 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-ec60ed1b-efd8-42b5-9e83-78b250eff1c6 tempest-VolumeDependencyTests-1769369869 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2bc2e54d-6a3a-4640-ace4-bfddd5a56056" returned: 0 in 0.539s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:38 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-ec60ed1b-efd8-42b5-9e83-78b250eff1c6 tempest-VolumeDependencyTests-1769369869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2bc2e54d-6a3a-4640-ace4-bfddd5a56056 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:38 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-a22142be-88aa-4cc0-90ba-bbd51a922f5c tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Lock "cinder-5d4781f3-797b-4622-a698-89536138b0cd-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:15:38 devstack sudo[91193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2bc2e54d-6a3a-4640-ace4-bfddd5a56056 Apr 16 15:15:38 devstack sudo[91193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:38 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-a22142be-88aa-4cc0-90ba-bbd51a922f5c tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Acquiring lock "cinder-quobyte-5d4781f3-797b-4622-a698-89536138b0cd" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:15:38 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-a22142be-88aa-4cc0-90ba-bbd51a922f5c tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Lock "cinder-quobyte-5d4781f3-797b-4622-a698-89536138b0cd" acquired by "delete_volume" :: waited 0.009s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:15:38 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[e474cc0b-ebae-4399-b884-82665b71772e]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:15:38 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-a22142be-88aa-4cc0-90ba-bbd51a922f5c tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-5d4781f3-797b-4622-a698-89536138b0cd {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:39 devstack sudo[91195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-5d4781f3-797b-4622-a698-89536138b0cd Apr 16 15:15:39 devstack sudo[91195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:39 devstack sudo[91191]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:39 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-1d421b40-a2cd-4ed7-871f-a3bcd28b8a83 tempest-CinderUnicodeTest-1113442512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-8c64c84d-3e7a-44ae-b871-2fa4dc1b6e46" returned: 0 in 0.454s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:39 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-1d421b40-a2cd-4ed7-871f-a3bcd28b8a83 tempest-CinderUnicodeTest-1113442512 None] <== create_volume: return (965ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'} {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 15:15:39 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-1d421b40-a2cd-4ed7-871f-a3bcd28b8a83 tempest-CinderUnicodeTest-1113442512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.971s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:15:39 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-1d421b40-a2cd-4ed7-871f-a3bcd28b8a83 tempest-CinderUnicodeTest-1113442512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daf6b4d3-9413-4c99-b916-5063cd53ccbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c64c84d-3e7a-44ae-b871-2fa4dc1b6e46', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:15:39 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-1d421b40-a2cd-4ed7-871f-a3bcd28b8a83 tempest-CinderUnicodeTest-1113442512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a88febeb-b37e-4642-b353-22083aebc188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:15:39 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-1d421b40-a2cd-4ed7-871f-a3bcd28b8a83 tempest-CinderUnicodeTest-1113442512 None] Volume volume-8c64c84d-3e7a-44ae-b871-2fa4dc1b6e46 (8c64c84d-3e7a-44ae-b871-2fa4dc1b6e46): created successfully Apr 16 15:15:39 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-1d421b40-a2cd-4ed7-871f-a3bcd28b8a83 tempest-CinderUnicodeTest-1113442512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a88febeb-b37e-4642-b353-22083aebc188) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:15:39 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-1d421b40-a2cd-4ed7-871f-a3bcd28b8a83 tempest-CinderUnicodeTest-1113442512 None] Flow 'volume_create_manager' (7a3952c8-17f8-42f6-9a67-6c2a287ba81f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:15:39 devstack sudo[91193]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:39 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-ec60ed1b-efd8-42b5-9e83-78b250eff1c6 tempest-VolumeDependencyTests-1769369869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2bc2e54d-6a3a-4640-ace4-bfddd5a56056" returned: 0 in 0.404s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:39 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-1d421b40-a2cd-4ed7-871f-a3bcd28b8a83 tempest-CinderUnicodeTest-1113442512 None] Created volume successfully. Apr 16 15:15:39 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-ec60ed1b-efd8-42b5-9e83-78b250eff1c6 tempest-VolumeDependencyTests-1769369869 None] Lock "cinder-quobyte-2bc2e54d-6a3a-4640-ace4-bfddd5a56056" released by "delete_volume" :: held 1.002s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:15:39 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-ec60ed1b-efd8-42b5-9e83-78b250eff1c6 tempest-VolumeDependencyTests-1769369869 None] Created reservations ['6c00a10f-954c-466e-9112-3298e4ea4678', '72f9a55b-1748-407a-a0de-df30a8b4a386', 'c049a540-adaa-41df-bc25-48dd9b133803', 'f36d9933-0170-4a8a-b2f6-7212bcf66732'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:15:39 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-ec60ed1b-efd8-42b5-9e83-78b250eff1c6 tempest-VolumeDependencyTests-1769369869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:15:39 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-ec60ed1b-efd8-42b5-9e83-78b250eff1c6 tempest-VolumeDependencyTests-1769369869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:15:39 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-ec60ed1b-efd8-42b5-9e83-78b250eff1c6 tempest-VolumeDependencyTests-1769369869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:15:39 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-ec60ed1b-efd8-42b5-9e83-78b250eff1c6 tempest-VolumeDependencyTests-1769369869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:15:39 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-ec60ed1b-efd8-42b5-9e83-78b250eff1c6 tempest-VolumeDependencyTests-1769369869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:15:39 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-ec60ed1b-efd8-42b5-9e83-78b250eff1c6 tempest-VolumeDependencyTests-1769369869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:39 devstack sudo[91202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:15:39 devstack sudo[91202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:39 devstack sudo[91195]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:39 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-a22142be-88aa-4cc0-90ba-bbd51a922f5c tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-5d4781f3-797b-4622-a698-89536138b0cd" returned: 0 in 0.473s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:39 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-a22142be-88aa-4cc0-90ba-bbd51a922f5c tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-5d4781f3-797b-4622-a698-89536138b0cd {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:39 devstack sudo[91204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-5d4781f3-797b-4622-a698-89536138b0cd Apr 16 15:15:39 devstack sudo[91204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:39 devstack cinder-volume[82756]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c9aaed0-8d54-4d34-a06e-12c3495fbf26 tempest-CinderUnicodeTest-1113442512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82756) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 15:15:39 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-7c9aaed0-8d54-4d34-a06e-12c3495fbf26 tempest-CinderUnicodeTest-1113442512 None] Flow 'volume_create_manager' (42612036-c0e6-45c8-aaea-e0f3bc46d695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:15:39 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-7c9aaed0-8d54-4d34-a06e-12c3495fbf26 tempest-CinderUnicodeTest-1113442512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e9c1e6c-1a0a-499c-809c-c7fc85855a88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:15:39 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-7c9aaed0-8d54-4d34-a06e-12c3495fbf26 tempest-CinderUnicodeTest-1113442512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e9c1e6c-1a0a-499c-809c-c7fc85855a88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:15:40Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-869934632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f5c3050-563d-4098-b020-9ed68057e6b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b8d06c169284a228672b4d0094ca454',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:15:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:15:40Z,use_quota=True,user_id='38c5aa22424244c3a49007cca11a16d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:15:39 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-7c9aaed0-8d54-4d34-a06e-12c3495fbf26 tempest-CinderUnicodeTest-1113442512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6092774c-ede5-49af-80ee-a97bafbba8e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:15:39 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-7c9aaed0-8d54-4d34-a06e-12c3495fbf26 tempest-CinderUnicodeTest-1113442512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6092774c-ede5-49af-80ee-a97bafbba8e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:15:39 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-7c9aaed0-8d54-4d34-a06e-12c3495fbf26 tempest-CinderUnicodeTest-1113442512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5dbbd00f-e501-4828-bc0d-22b75e2569d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:15:39 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-7c9aaed0-8d54-4d34-a06e-12c3495fbf26 tempest-CinderUnicodeTest-1113442512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5dbbd00f-e501-4828-bc0d-22b75e2569d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f5c3050-563d-4098-b020-9ed68057e6b4', 'volume_name': 'volume-6f5c3050-563d-4098-b020-9ed68057e6b4', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:15:39 devstack sudo[91202]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:39 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-7c9aaed0-8d54-4d34-a06e-12c3495fbf26 tempest-CinderUnicodeTest-1113442512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25eaad34-a02e-4a35-b18c-35d054cc3577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:15:39 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-7c9aaed0-8d54-4d34-a06e-12c3495fbf26 tempest-CinderUnicodeTest-1113442512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25eaad34-a02e-4a35-b18c-35d054cc3577) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:15:39 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-7c9aaed0-8d54-4d34-a06e-12c3495fbf26 tempest-CinderUnicodeTest-1113442512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e60c3a50-6688-4f15-91ed-68c053c4f1d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:15:39 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-7c9aaed0-8d54-4d34-a06e-12c3495fbf26 tempest-CinderUnicodeTest-1113442512 None] Volume 6f5c3050-563d-4098-b020-9ed68057e6b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f5c3050-563d-4098-b020-9ed68057e6b4', 'volume_size': 1} Apr 16 15:15:39 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-7c9aaed0-8d54-4d34-a06e-12c3495fbf26 tempest-CinderUnicodeTest-1113442512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:15:39 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-7c9aaed0-8d54-4d34-a06e-12c3495fbf26 tempest-CinderUnicodeTest-1113442512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:15:39 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-7c9aaed0-8d54-4d34-a06e-12c3495fbf26 tempest-CinderUnicodeTest-1113442512 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T13:15:40Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-869934632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f5c3050-563d-4098-b020-9ed68057e6b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b8d06c169284a228672b4d0094ca454',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T13:15:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T13:15:40Z,use_quota=True,user_id='38c5aa22424244c3a49007cca11a16d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e658371-62db-4661-87e0-f35667353c28),volume_type_id=1e658371-62db-4661-87e0-f35667353c28)}" {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 15:15:39 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-7c9aaed0-8d54-4d34-a06e-12c3495fbf26 tempest-CinderUnicodeTest-1113442512 None] Creating volume 6f5c3050-563d-4098-b020-9ed68057e6b4 {{(pid=82756) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 15:15:39 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-7c9aaed0-8d54-4d34-a06e-12c3495fbf26 tempest-CinderUnicodeTest-1113442512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:15:39 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-7c9aaed0-8d54-4d34-a06e-12c3495fbf26 tempest-CinderUnicodeTest-1113442512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:15:39 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-7c9aaed0-8d54-4d34-a06e-12c3495fbf26 tempest-CinderUnicodeTest-1113442512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:15:39 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-7c9aaed0-8d54-4d34-a06e-12c3495fbf26 tempest-CinderUnicodeTest-1113442512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:15:39 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-7c9aaed0-8d54-4d34-a06e-12c3495fbf26 tempest-CinderUnicodeTest-1113442512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:15:39 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-7c9aaed0-8d54-4d34-a06e-12c3495fbf26 tempest-CinderUnicodeTest-1113442512 None] Selected osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 as target Quobyte volume. {{(pid=82756) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 15:15:39 devstack cinder-volume[82756]: INFO cinder.volume.drivers.remotefs [None req-7c9aaed0-8d54-4d34-a06e-12c3495fbf26 tempest-CinderUnicodeTest-1113442512 None] casted to osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781 Apr 16 15:15:39 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-7c9aaed0-8d54-4d34-a06e-12c3495fbf26 tempest-CinderUnicodeTest-1113442512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6f5c3050-563d-4098-b020-9ed68057e6b4 1073741824 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:39 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-ec60ed1b-efd8-42b5-9e83-78b250eff1c6 tempest-VolumeDependencyTests-1769369869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.484s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:39 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-ec60ed1b-efd8-42b5-9e83-78b250eff1c6 tempest-VolumeDependencyTests-1769369869 None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:15:39 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-ec60ed1b-efd8-42b5-9e83-78b250eff1c6 tempest-VolumeDependencyTests-1769369869 None] Deleted volume successfully. Apr 16 15:15:39 devstack sudo[91208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6f5c3050-563d-4098-b020-9ed68057e6b4 1073741824 Apr 16 15:15:39 devstack sudo[91208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:39 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-ec60ed1b-efd8-42b5-9e83-78b250eff1c6 tempest-VolumeDependencyTests-1769369869 None] Lock "cinder-2bc2e54d-6a3a-4640-ace4-bfddd5a56056-delete_volume" released by "delete_volume" :: held 1.666s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:15:39 devstack sudo[91204]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:39 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-a22142be-88aa-4cc0-90ba-bbd51a922f5c tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-5d4781f3-797b-4622-a698-89536138b0cd" returned: 0 in 0.503s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:39 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-a22142be-88aa-4cc0-90ba-bbd51a922f5c tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Lock "cinder-quobyte-5d4781f3-797b-4622-a698-89536138b0cd" released by "delete_volume" :: held 0.996s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:15:39 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-a22142be-88aa-4cc0-90ba-bbd51a922f5c tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Created reservations ['de298ad6-5b09-44d9-9c44-3446df9ab4dd', '0c817e36-5b58-480e-a2f5-43a6e7c368ae', '7c41b8ea-2e7b-4c78-90e4-614d7d02417e', '7d1085ca-2292-4e85-a33d-fb97fe42585a'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:15:40 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-a22142be-88aa-4cc0-90ba-bbd51a922f5c tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:15:40 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-a22142be-88aa-4cc0-90ba-bbd51a922f5c tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:15:40 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-a22142be-88aa-4cc0-90ba-bbd51a922f5c tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:15:40 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-a22142be-88aa-4cc0-90ba-bbd51a922f5c tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:15:40 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-a22142be-88aa-4cc0-90ba-bbd51a922f5c tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:15:40 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-a22142be-88aa-4cc0-90ba-bbd51a922f5c tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:40 devstack sudo[91210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:15:40 devstack sudo[91210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:40 devstack sudo[91208]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:40 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-cee2ff1d-a2e4-4628-ab3e-97a97e2c1c41 tempest-VolumeDependencyTests-1769369869 None] Acquiring lock "cinder-6d1517b4-9e46-4ff0-85b3-a37774ce20ef-delete_volume" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:15:40 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-7c9aaed0-8d54-4d34-a06e-12c3495fbf26 tempest-CinderUnicodeTest-1113442512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6f5c3050-563d-4098-b020-9ed68057e6b4 1073741824" returned: 0 in 0.539s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:40 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-cee2ff1d-a2e4-4628-ab3e-97a97e2c1c41 tempest-VolumeDependencyTests-1769369869 None] Lock "cinder-6d1517b4-9e46-4ff0-85b3-a37774ce20ef-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:15:40 devstack sudo[91210]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:40 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-a22142be-88aa-4cc0-90ba-bbd51a922f5c tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.441s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:40 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-a22142be-88aa-4cc0-90ba-bbd51a922f5c tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:15:40 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-a22142be-88aa-4cc0-90ba-bbd51a922f5c tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Deleted volume successfully. Apr 16 15:15:40 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-7c9aaed0-8d54-4d34-a06e-12c3495fbf26 tempest-CinderUnicodeTest-1113442512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6f5c3050-563d-4098-b020-9ed68057e6b4 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:40 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-cee2ff1d-a2e4-4628-ab3e-97a97e2c1c41 tempest-VolumeDependencyTests-1769369869 None] Acquiring lock "cinder-quobyte-6d1517b4-9e46-4ff0-85b3-a37774ce20ef" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:15:40 devstack sudo[91216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6f5c3050-563d-4098-b020-9ed68057e6b4 Apr 16 15:15:40 devstack sudo[91216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:40 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-a22142be-88aa-4cc0-90ba-bbd51a922f5c tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Lock "cinder-5d4781f3-797b-4622-a698-89536138b0cd-delete_volume" released by "delete_volume" :: held 1.593s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:15:40 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-cee2ff1d-a2e4-4628-ab3e-97a97e2c1c41 tempest-VolumeDependencyTests-1769369869 None] Lock "cinder-quobyte-6d1517b4-9e46-4ff0-85b3-a37774ce20ef" acquired by "delete_volume" :: waited 0.015s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:15:40 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[e08c0463-997f-4710-9c31-f3f5ed2da0f3]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:15:40 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-cee2ff1d-a2e4-4628-ab3e-97a97e2c1c41 tempest-VolumeDependencyTests-1769369869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6d1517b4-9e46-4ff0-85b3-a37774ce20ef {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:40 devstack sudo[91218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6d1517b4-9e46-4ff0-85b3-a37774ce20ef Apr 16 15:15:40 devstack sudo[91218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:40 devstack sudo[91216]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:40 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-7c9aaed0-8d54-4d34-a06e-12c3495fbf26 tempest-CinderUnicodeTest-1113442512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6f5c3050-563d-4098-b020-9ed68057e6b4" returned: 0 in 0.403s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:40 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-7c9aaed0-8d54-4d34-a06e-12c3495fbf26 tempest-CinderUnicodeTest-1113442512 None] <== create_volume: return (1019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'} {{(pid=82756) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 15:15:40 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-7c9aaed0-8d54-4d34-a06e-12c3495fbf26 tempest-CinderUnicodeTest-1113442512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.022s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:15:40 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-7c9aaed0-8d54-4d34-a06e-12c3495fbf26 tempest-CinderUnicodeTest-1113442512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e60c3a50-6688-4f15-91ed-68c053c4f1d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f5c3050-563d-4098-b020-9ed68057e6b4', 'volume_size': 1}' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:15:40 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-7c9aaed0-8d54-4d34-a06e-12c3495fbf26 tempest-CinderUnicodeTest-1113442512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd0c0306-7c56-4915-a8b5-eb6f88df7604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 15:15:40 devstack cinder-volume[82756]: INFO cinder.volume.flows.manager.create_volume [None req-7c9aaed0-8d54-4d34-a06e-12c3495fbf26 tempest-CinderUnicodeTest-1113442512 None] Volume volume-6f5c3050-563d-4098-b020-9ed68057e6b4 (6f5c3050-563d-4098-b020-9ed68057e6b4): created successfully Apr 16 15:15:40 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-7c9aaed0-8d54-4d34-a06e-12c3495fbf26 tempest-CinderUnicodeTest-1113442512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd0c0306-7c56-4915-a8b5-eb6f88df7604) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82756) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 15:15:40 devstack cinder-volume[82756]: DEBUG cinder.volume.manager [None req-7c9aaed0-8d54-4d34-a06e-12c3495fbf26 tempest-CinderUnicodeTest-1113442512 None] Flow 'volume_create_manager' (42612036-c0e6-45c8-aaea-e0f3bc46d695) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82756) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 15:15:40 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-7c9aaed0-8d54-4d34-a06e-12c3495fbf26 tempest-CinderUnicodeTest-1113442512 None] Created volume successfully. Apr 16 15:15:41 devstack sudo[91218]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:41 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-cee2ff1d-a2e4-4628-ab3e-97a97e2c1c41 tempest-VolumeDependencyTests-1769369869 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6d1517b4-9e46-4ff0-85b3-a37774ce20ef" returned: 0 in 0.499s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:41 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-cee2ff1d-a2e4-4628-ab3e-97a97e2c1c41 tempest-VolumeDependencyTests-1769369869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6d1517b4-9e46-4ff0-85b3-a37774ce20ef {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:41 devstack sudo[91224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6d1517b4-9e46-4ff0-85b3-a37774ce20ef Apr 16 15:15:41 devstack sudo[91224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:41 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-eca02533-e34f-46a5-b0b9-490d1555a541 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Acquiring lock "cinder-f01eeb6a-6ab1-4651-ae94-243ee9f99d70-delete_volume" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:15:41 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-eca02533-e34f-46a5-b0b9-490d1555a541 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Lock "cinder-f01eeb6a-6ab1-4651-ae94-243ee9f99d70-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:15:41 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-eca02533-e34f-46a5-b0b9-490d1555a541 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Acquiring lock "cinder-quobyte-f01eeb6a-6ab1-4651-ae94-243ee9f99d70" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:15:41 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-eca02533-e34f-46a5-b0b9-490d1555a541 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Lock "cinder-quobyte-f01eeb6a-6ab1-4651-ae94-243ee9f99d70" acquired by "delete_volume" :: waited 0.011s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:15:41 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9797a29-b252-4197-b2b1-72c52d95521d]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:15:41 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-eca02533-e34f-46a5-b0b9-490d1555a541 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-f01eeb6a-6ab1-4651-ae94-243ee9f99d70 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:41 devstack sudo[91226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-f01eeb6a-6ab1-4651-ae94-243ee9f99d70 Apr 16 15:15:41 devstack sudo[91226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:41 devstack sudo[91224]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:41 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-cee2ff1d-a2e4-4628-ab3e-97a97e2c1c41 tempest-VolumeDependencyTests-1769369869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6d1517b4-9e46-4ff0-85b3-a37774ce20ef" returned: 0 in 0.399s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:41 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-cee2ff1d-a2e4-4628-ab3e-97a97e2c1c41 tempest-VolumeDependencyTests-1769369869 None] Lock "cinder-quobyte-6d1517b4-9e46-4ff0-85b3-a37774ce20ef" released by "delete_volume" :: held 0.920s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:15:41 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-cee2ff1d-a2e4-4628-ab3e-97a97e2c1c41 tempest-VolumeDependencyTests-1769369869 None] Created reservations ['d3bb2649-7c55-48a7-af71-af4176867389', '428ce881-3ff2-42d4-bc35-391a586edb05', 'b92422c8-41d4-4f3b-899c-ab77f926f1b9', '6dd6559e-44e3-413c-8ec3-2c4e7c61c2a1'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:15:41 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-cee2ff1d-a2e4-4628-ab3e-97a97e2c1c41 tempest-VolumeDependencyTests-1769369869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:15:41 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-cee2ff1d-a2e4-4628-ab3e-97a97e2c1c41 tempest-VolumeDependencyTests-1769369869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:15:41 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-cee2ff1d-a2e4-4628-ab3e-97a97e2c1c41 tempest-VolumeDependencyTests-1769369869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:15:41 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-cee2ff1d-a2e4-4628-ab3e-97a97e2c1c41 tempest-VolumeDependencyTests-1769369869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:15:41 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-cee2ff1d-a2e4-4628-ab3e-97a97e2c1c41 tempest-VolumeDependencyTests-1769369869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:15:41 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-cee2ff1d-a2e4-4628-ab3e-97a97e2c1c41 tempest-VolumeDependencyTests-1769369869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:41 devstack sudo[91232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:15:41 devstack sudo[91232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:41 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-5b73beb2-2ce1-48bb-b3a2-fc897b542bd2 tempest-VolumeDependencyTests-1769369869 None] Acquiring lock "cinder-2ea7e4be-e8ab-4465-b41a-0938018d568c-delete_volume" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:15:41 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-5b73beb2-2ce1-48bb-b3a2-fc897b542bd2 tempest-VolumeDependencyTests-1769369869 None] Lock "cinder-2ea7e4be-e8ab-4465-b41a-0938018d568c-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:15:41 devstack sudo[91226]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:41 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-eca02533-e34f-46a5-b0b9-490d1555a541 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-f01eeb6a-6ab1-4651-ae94-243ee9f99d70" returned: 0 in 0.494s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:41 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-eca02533-e34f-46a5-b0b9-490d1555a541 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-f01eeb6a-6ab1-4651-ae94-243ee9f99d70 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:41 devstack sudo[91234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-f01eeb6a-6ab1-4651-ae94-243ee9f99d70 Apr 16 15:15:41 devstack sudo[91234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:41 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-5b73beb2-2ce1-48bb-b3a2-fc897b542bd2 tempest-VolumeDependencyTests-1769369869 None] Acquiring lock "cinder-quobyte-2ea7e4be-e8ab-4465-b41a-0938018d568c" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:15:41 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-5b73beb2-2ce1-48bb-b3a2-fc897b542bd2 tempest-VolumeDependencyTests-1769369869 None] Lock "cinder-quobyte-2ea7e4be-e8ab-4465-b41a-0938018d568c" acquired by "delete_volume" :: waited 0.016s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:15:41 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cbc33b8-3f91-4992-8501-97131b3616cd]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:15:41 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-5b73beb2-2ce1-48bb-b3a2-fc897b542bd2 tempest-VolumeDependencyTests-1769369869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2ea7e4be-e8ab-4465-b41a-0938018d568c {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:41 devstack sudo[91236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2ea7e4be-e8ab-4465-b41a-0938018d568c Apr 16 15:15:41 devstack sudo[91236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:42 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-02db43c9-0ec1-4ba3-996a-14b9b89e2ca8 tempest-CinderUnicodeTest-1113442512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:15:42 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-02db43c9-0ec1-4ba3-996a-14b9b89e2ca8 tempest-CinderUnicodeTest-1113442512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:15:42 devstack sudo[91232]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:42 devstack sudo[91234]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:42 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-02db43c9-0ec1-4ba3-996a-14b9b89e2ca8 tempest-CinderUnicodeTest-1113442512 None] Creating offline snapshot d37e7f03-6134-41ba-ac13-df8de253b472 of volume 6f5c3050-563d-4098-b020-9ed68057e6b4 {{(pid=82756) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 16 15:15:42 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-cee2ff1d-a2e4-4628-ab3e-97a97e2c1c41 tempest-VolumeDependencyTests-1769369869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.551s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:42 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-eca02533-e34f-46a5-b0b9-490d1555a541 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-f01eeb6a-6ab1-4651-ae94-243ee9f99d70" returned: 0 in 0.463s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:42 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-cee2ff1d-a2e4-4628-ab3e-97a97e2c1c41 tempest-VolumeDependencyTests-1769369869 None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:15:42 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[01777afd-04a1-4632-bda7-2d844722965d]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:15:42 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-02db43c9-0ec1-4ba3-996a-14b9b89e2ca8 tempest-CinderUnicodeTest-1113442512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6f5c3050-563d-4098-b020-9ed68057e6b4 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:42 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-cee2ff1d-a2e4-4628-ab3e-97a97e2c1c41 tempest-VolumeDependencyTests-1769369869 None] Deleted volume successfully. Apr 16 15:15:42 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-eca02533-e34f-46a5-b0b9-490d1555a541 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Lock "cinder-quobyte-f01eeb6a-6ab1-4651-ae94-243ee9f99d70" released by "delete_volume" :: held 1.003s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:15:42 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-cee2ff1d-a2e4-4628-ab3e-97a97e2c1c41 tempest-VolumeDependencyTests-1769369869 None] Lock "cinder-6d1517b4-9e46-4ff0-85b3-a37774ce20ef-delete_volume" released by "delete_volume" :: held 1.689s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:15:42 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-eca02533-e34f-46a5-b0b9-490d1555a541 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Created reservations ['31712b0b-4491-450b-a377-2fab73a85c65', '771b3826-b6ba-433c-9adb-18c2cea580aa', '5f1ca31d-0fe6-45b2-aa83-98f5265e9ff9', 'd9d11770-cee5-4c8f-99d6-b5df9094aa5e'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:15:42 devstack sudo[91242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6f5c3050-563d-4098-b020-9ed68057e6b4 Apr 16 15:15:42 devstack sudo[91242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:42 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-eca02533-e34f-46a5-b0b9-490d1555a541 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:15:42 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-eca02533-e34f-46a5-b0b9-490d1555a541 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:15:42 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-eca02533-e34f-46a5-b0b9-490d1555a541 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:15:42 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-eca02533-e34f-46a5-b0b9-490d1555a541 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:15:42 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-eca02533-e34f-46a5-b0b9-490d1555a541 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:15:42 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-eca02533-e34f-46a5-b0b9-490d1555a541 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:42 devstack sudo[91236]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:42 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-5b73beb2-2ce1-48bb-b3a2-fc897b542bd2 tempest-VolumeDependencyTests-1769369869 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2ea7e4be-e8ab-4465-b41a-0938018d568c" returned: 0 in 0.540s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:42 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-5b73beb2-2ce1-48bb-b3a2-fc897b542bd2 tempest-VolumeDependencyTests-1769369869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2ea7e4be-e8ab-4465-b41a-0938018d568c {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:42 devstack sudo[91245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:15:42 devstack sudo[91245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:42 devstack sudo[91246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2ea7e4be-e8ab-4465-b41a-0938018d568c Apr 16 15:15:42 devstack sudo[91246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:42 devstack sudo[91245]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:42 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-eca02533-e34f-46a5-b0b9-490d1555a541 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.416s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:42 devstack sudo[91246]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:42 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-eca02533-e34f-46a5-b0b9-490d1555a541 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:15:42 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-5b73beb2-2ce1-48bb-b3a2-fc897b542bd2 tempest-VolumeDependencyTests-1769369869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-2ea7e4be-e8ab-4465-b41a-0938018d568c" returned: 0 in 0.404s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:42 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-eca02533-e34f-46a5-b0b9-490d1555a541 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Deleted volume successfully. Apr 16 15:15:42 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-5b73beb2-2ce1-48bb-b3a2-fc897b542bd2 tempest-VolumeDependencyTests-1769369869 None] Lock "cinder-quobyte-2ea7e4be-e8ab-4465-b41a-0938018d568c" released by "delete_volume" :: held 0.974s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:15:42 devstack sudo[91242]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:42 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-02db43c9-0ec1-4ba3-996a-14b9b89e2ca8 tempest-CinderUnicodeTest-1113442512 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6f5c3050-563d-4098-b020-9ed68057e6b4" returned: 0 in 0.561s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:42 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-02db43c9-0ec1-4ba3-996a-14b9b89e2ca8 tempest-CinderUnicodeTest-1113442512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6f5c3050-563d-4098-b020-9ed68057e6b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6f5c3050-563d-4098-b020-9ed68057e6b4.d37e7f03-6134-41ba-ac13-df8de253b472 1G {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:42 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-eca02533-e34f-46a5-b0b9-490d1555a541 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Lock "cinder-f01eeb6a-6ab1-4651-ae94-243ee9f99d70-delete_volume" released by "delete_volume" :: held 1.595s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:15:42 devstack sudo[91254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6f5c3050-563d-4098-b020-9ed68057e6b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6f5c3050-563d-4098-b020-9ed68057e6b4.d37e7f03-6134-41ba-ac13-df8de253b472 1G Apr 16 15:15:42 devstack sudo[91254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:42 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-5b73beb2-2ce1-48bb-b3a2-fc897b542bd2 tempest-VolumeDependencyTests-1769369869 None] Created reservations ['624433ff-3c03-4651-843f-fd3584aebfa6', '2ec8a779-5297-4e7d-98ba-02b31b598807', '59fc6d54-164c-4fba-b291-818b515f380f', '2cf11c6e-ab2b-4e90-9dda-a3b440409396'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:15:42 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-5b73beb2-2ce1-48bb-b3a2-fc897b542bd2 tempest-VolumeDependencyTests-1769369869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:15:42 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-5b73beb2-2ce1-48bb-b3a2-fc897b542bd2 tempest-VolumeDependencyTests-1769369869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:15:42 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-5b73beb2-2ce1-48bb-b3a2-fc897b542bd2 tempest-VolumeDependencyTests-1769369869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:15:42 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-5b73beb2-2ce1-48bb-b3a2-fc897b542bd2 tempest-VolumeDependencyTests-1769369869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:15:42 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-5b73beb2-2ce1-48bb-b3a2-fc897b542bd2 tempest-VolumeDependencyTests-1769369869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:15:42 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-5b73beb2-2ce1-48bb-b3a2-fc897b542bd2 tempest-VolumeDependencyTests-1769369869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:42 devstack sudo[91256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:15:42 devstack sudo[91256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:43 devstack sudo[91256]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:43 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-5b73beb2-2ce1-48bb-b3a2-fc897b542bd2 tempest-VolumeDependencyTests-1769369869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.413s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:43 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-5b73beb2-2ce1-48bb-b3a2-fc897b542bd2 tempest-VolumeDependencyTests-1769369869 None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:15:43 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-5b73beb2-2ce1-48bb-b3a2-fc897b542bd2 tempest-VolumeDependencyTests-1769369869 None] Deleted volume successfully. Apr 16 15:15:43 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-5b73beb2-2ce1-48bb-b3a2-fc897b542bd2 tempest-VolumeDependencyTests-1769369869 None] Lock "cinder-2ea7e4be-e8ab-4465-b41a-0938018d568c-delete_volume" released by "delete_volume" :: held 1.558s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:15:43 devstack sudo[91254]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:43 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-02db43c9-0ec1-4ba3-996a-14b9b89e2ca8 tempest-CinderUnicodeTest-1113442512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6f5c3050-563d-4098-b020-9ed68057e6b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6f5c3050-563d-4098-b020-9ed68057e6b4.d37e7f03-6134-41ba-ac13-df8de253b472 1G" returned: 0 in 0.542s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:43 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-02db43c9-0ec1-4ba3-996a-14b9b89e2ca8 tempest-CinderUnicodeTest-1113442512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f5c3050-563d-4098-b020-9ed68057e6b4 -F qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6f5c3050-563d-4098-b020-9ed68057e6b4.d37e7f03-6134-41ba-ac13-df8de253b472 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:43 devstack sudo[91262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f5c3050-563d-4098-b020-9ed68057e6b4 -F qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6f5c3050-563d-4098-b020-9ed68057e6b4.d37e7f03-6134-41ba-ac13-df8de253b472 Apr 16 15:15:43 devstack sudo[91262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:43 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-ca13abe6-b824-4068-99ce-a95fac6f932d tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Acquiring lock "cinder-ed93ac07-982f-4c55-a31e-8bbdb7eb2ad2-delete_volume" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:15:43 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-ca13abe6-b824-4068-99ce-a95fac6f932d tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Lock "cinder-ed93ac07-982f-4c55-a31e-8bbdb7eb2ad2-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:15:43 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-ca13abe6-b824-4068-99ce-a95fac6f932d tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Acquiring lock "cinder-quobyte-ed93ac07-982f-4c55-a31e-8bbdb7eb2ad2" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:15:43 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-ca13abe6-b824-4068-99ce-a95fac6f932d tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Lock "cinder-quobyte-ed93ac07-982f-4c55-a31e-8bbdb7eb2ad2" acquired by "delete_volume" :: waited 0.008s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:15:43 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c29c976-58e9-4d18-acf8-4a840bb2427b]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:15:43 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-ca13abe6-b824-4068-99ce-a95fac6f932d tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-ed93ac07-982f-4c55-a31e-8bbdb7eb2ad2 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:43 devstack sudo[91264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-ed93ac07-982f-4c55-a31e-8bbdb7eb2ad2 Apr 16 15:15:43 devstack sudo[91264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:43 devstack sudo[91262]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:43 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-02db43c9-0ec1-4ba3-996a-14b9b89e2ca8 tempest-CinderUnicodeTest-1113442512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f5c3050-563d-4098-b020-9ed68057e6b4 -F qcow2 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6f5c3050-563d-4098-b020-9ed68057e6b4.d37e7f03-6134-41ba-ac13-df8de253b472" returned: 0 in 0.439s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:43 devstack cinder-volume[82756]: WARNING cinder.volume.drivers.remotefs [None req-02db43c9-0ec1-4ba3-996a-14b9b89e2ca8 tempest-CinderUnicodeTest-1113442512 None] /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6f5c3050-563d-4098-b020-9ed68057e6b4.d37e7f03-6134-41ba-ac13-df8de253b472 is being set with open permissions: ugo+rw Apr 16 15:15:43 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-02db43c9-0ec1-4ba3-996a-14b9b89e2ca8 tempest-CinderUnicodeTest-1113442512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6f5c3050-563d-4098-b020-9ed68057e6b4.d37e7f03-6134-41ba-ac13-df8de253b472 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:43 devstack sudo[91270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6f5c3050-563d-4098-b020-9ed68057e6b4.d37e7f03-6134-41ba-ac13-df8de253b472 Apr 16 15:15:43 devstack sudo[91270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:43 devstack sudo[91264]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:43 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-ca13abe6-b824-4068-99ce-a95fac6f932d tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-ed93ac07-982f-4c55-a31e-8bbdb7eb2ad2" returned: 0 in 0.495s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:43 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-ca13abe6-b824-4068-99ce-a95fac6f932d tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-ed93ac07-982f-4c55-a31e-8bbdb7eb2ad2 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:43 devstack sudo[91275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-ed93ac07-982f-4c55-a31e-8bbdb7eb2ad2 Apr 16 15:15:43 devstack sudo[91275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:44 devstack sudo[91270]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:44 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-02db43c9-0ec1-4ba3-996a-14b9b89e2ca8 tempest-CinderUnicodeTest-1113442512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6f5c3050-563d-4098-b020-9ed68057e6b4.d37e7f03-6134-41ba-ac13-df8de253b472" returned: 0 in 0.509s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:44 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-02db43c9-0ec1-4ba3-996a-14b9b89e2ca8 tempest-CinderUnicodeTest-1113442512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6f5c3050-563d-4098-b020-9ed68057e6b4.info {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:44 devstack sudo[91279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6f5c3050-563d-4098-b020-9ed68057e6b4.info Apr 16 15:15:44 devstack sudo[91279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:44 devstack sudo[91275]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:44 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-ca13abe6-b824-4068-99ce-a95fac6f932d tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-ed93ac07-982f-4c55-a31e-8bbdb7eb2ad2" returned: 0 in 0.459s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:44 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-ca13abe6-b824-4068-99ce-a95fac6f932d tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Lock "cinder-quobyte-ed93ac07-982f-4c55-a31e-8bbdb7eb2ad2" released by "delete_volume" :: held 0.979s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:15:44 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-ca13abe6-b824-4068-99ce-a95fac6f932d tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Created reservations ['759eeca8-58c2-466c-b896-55cf2fc19600', '66469ff9-35d1-4b96-b957-3af9e49903a3', '3539011f-a371-4b7f-822f-3b8c633a62e4', '455c9abf-1cd9-40db-8f43-4754aed001b8'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:15:44 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-ca13abe6-b824-4068-99ce-a95fac6f932d tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:15:44 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-ca13abe6-b824-4068-99ce-a95fac6f932d tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:15:44 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-ca13abe6-b824-4068-99ce-a95fac6f932d tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:15:44 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-ca13abe6-b824-4068-99ce-a95fac6f932d tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:15:44 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-ca13abe6-b824-4068-99ce-a95fac6f932d tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:15:44 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-ca13abe6-b824-4068-99ce-a95fac6f932d tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:44 devstack sudo[91281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:15:44 devstack sudo[91281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:44 devstack sudo[91279]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:44 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-02db43c9-0ec1-4ba3-996a-14b9b89e2ca8 tempest-CinderUnicodeTest-1113442512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6f5c3050-563d-4098-b020-9ed68057e6b4.info" returned: 0 in 0.519s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:44 devstack cinder-volume[82756]: WARNING cinder.volume.drivers.remotefs [None req-02db43c9-0ec1-4ba3-996a-14b9b89e2ca8 tempest-CinderUnicodeTest-1113442512 None] /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6f5c3050-563d-4098-b020-9ed68057e6b4.info is being set with open permissions: ugo+rw Apr 16 15:15:44 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-02db43c9-0ec1-4ba3-996a-14b9b89e2ca8 tempest-CinderUnicodeTest-1113442512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6f5c3050-563d-4098-b020-9ed68057e6b4.info {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:44 devstack sudo[91284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6f5c3050-563d-4098-b020-9ed68057e6b4.info Apr 16 15:15:44 devstack sudo[91284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:44 devstack sudo[91281]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:44 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-ca13abe6-b824-4068-99ce-a95fac6f932d tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.540s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:44 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-ca13abe6-b824-4068-99ce-a95fac6f932d tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:15:44 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-ca13abe6-b824-4068-99ce-a95fac6f932d tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Deleted volume successfully. Apr 16 15:15:44 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-ca13abe6-b824-4068-99ce-a95fac6f932d tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Lock "cinder-ed93ac07-982f-4c55-a31e-8bbdb7eb2ad2-delete_volume" released by "delete_volume" :: held 1.656s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:15:45 devstack sudo[91284]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:45 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-02db43c9-0ec1-4ba3-996a-14b9b89e2ca8 tempest-CinderUnicodeTest-1113442512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6f5c3050-563d-4098-b020-9ed68057e6b4.info" returned: 0 in 0.422s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:45 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-02db43c9-0ec1-4ba3-996a-14b9b89e2ca8 tempest-CinderUnicodeTest-1113442512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.064s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:15:45 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-02db43c9-0ec1-4ba3-996a-14b9b89e2ca8 tempest-CinderUnicodeTest-1113442512 None] Create snapshot completed successfully Apr 16 15:15:45 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-ebd670f5-5eb4-4bf8-a468-a2dd1d3d3a27 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Acquiring lock "cinder-10e2771d-2a1a-483e-a0b8-14b1e66548d4-delete_volume" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:15:45 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-ebd670f5-5eb4-4bf8-a468-a2dd1d3d3a27 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Lock "cinder-10e2771d-2a1a-483e-a0b8-14b1e66548d4-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:15:45 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-ebd670f5-5eb4-4bf8-a468-a2dd1d3d3a27 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Acquiring lock "cinder-quobyte-10e2771d-2a1a-483e-a0b8-14b1e66548d4" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:15:45 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-ebd670f5-5eb4-4bf8-a468-a2dd1d3d3a27 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Lock "cinder-quobyte-10e2771d-2a1a-483e-a0b8-14b1e66548d4" acquired by "delete_volume" :: waited 0.010s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:15:45 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cc79590-f341-4cc1-8532-0448c688dc16]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:15:45 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-ebd670f5-5eb4-4bf8-a468-a2dd1d3d3a27 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-10e2771d-2a1a-483e-a0b8-14b1e66548d4 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:45 devstack sudo[91288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-10e2771d-2a1a-483e-a0b8-14b1e66548d4 Apr 16 15:15:45 devstack sudo[91288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:45 devstack sudo[91288]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:45 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-ebd670f5-5eb4-4bf8-a468-a2dd1d3d3a27 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-10e2771d-2a1a-483e-a0b8-14b1e66548d4" returned: 0 in 0.458s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:45 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-ebd670f5-5eb4-4bf8-a468-a2dd1d3d3a27 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-10e2771d-2a1a-483e-a0b8-14b1e66548d4 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:45 devstack sudo[91293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-10e2771d-2a1a-483e-a0b8-14b1e66548d4 Apr 16 15:15:45 devstack sudo[91293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:46 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-206ac08d-b4ac-4b91-b2e3-b1a907f0243d tempest-CinderUnicodeTest-1113442512 None] Acquiring lock "cinder-d37e7f03-6134-41ba-ac13-df8de253b472-delete_snapshot" by "delete_snapshot" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:15:46 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-206ac08d-b4ac-4b91-b2e3-b1a907f0243d tempest-CinderUnicodeTest-1113442512 None] Lock "cinder-d37e7f03-6134-41ba-ac13-df8de253b472-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:15:46 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-206ac08d-b4ac-4b91-b2e3-b1a907f0243d tempest-CinderUnicodeTest-1113442512 None] Acquiring lock "cinder-quobyte-6f5c3050-563d-4098-b020-9ed68057e6b4" by "delete_snapshot" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:15:46 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-206ac08d-b4ac-4b91-b2e3-b1a907f0243d tempest-CinderUnicodeTest-1113442512 None] Lock "cinder-quobyte-6f5c3050-563d-4098-b020-9ed68057e6b4" acquired by "delete_snapshot" :: waited 0.006s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:15:46 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-206ac08d-b4ac-4b91-b2e3-b1a907f0243d tempest-CinderUnicodeTest-1113442512 None] Acquiring lock "cinder-quobyte-d37e7f03-6134-41ba-ac13-df8de253b472" by "_delete_snapshot" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:15:46 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-206ac08d-b4ac-4b91-b2e3-b1a907f0243d tempest-CinderUnicodeTest-1113442512 None] Lock "cinder-quobyte-d37e7f03-6134-41ba-ac13-df8de253b472" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:15:46 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-206ac08d-b4ac-4b91-b2e3-b1a907f0243d tempest-CinderUnicodeTest-1113442512 None] Deleting offline snapshot d37e7f03-6134-41ba-ac13-df8de253b472 of volume 6f5c3050-563d-4098-b020-9ed68057e6b4 {{(pid=82756) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 15:15:46 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-206ac08d-b4ac-4b91-b2e3-b1a907f0243d tempest-CinderUnicodeTest-1113442512 None] snapshot_file for this snap is: volume-6f5c3050-563d-4098-b020-9ed68057e6b4.d37e7f03-6134-41ba-ac13-df8de253b472 {{(pid=82756) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 15:15:46 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a3681cd-a1bc-4397-adfb-8b95ee4c2a51]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:15:46 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-206ac08d-b4ac-4b91-b2e3-b1a907f0243d tempest-CinderUnicodeTest-1113442512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6f5c3050-563d-4098-b020-9ed68057e6b4.d37e7f03-6134-41ba-ac13-df8de253b472 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:46 devstack sudo[91295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6f5c3050-563d-4098-b020-9ed68057e6b4.d37e7f03-6134-41ba-ac13-df8de253b472 Apr 16 15:15:46 devstack sudo[91295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:46 devstack sudo[91293]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:46 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-ebd670f5-5eb4-4bf8-a468-a2dd1d3d3a27 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-10e2771d-2a1a-483e-a0b8-14b1e66548d4" returned: 0 in 0.431s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:46 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-ebd670f5-5eb4-4bf8-a468-a2dd1d3d3a27 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Lock "cinder-quobyte-10e2771d-2a1a-483e-a0b8-14b1e66548d4" released by "delete_volume" :: held 0.912s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:15:46 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-ebd670f5-5eb4-4bf8-a468-a2dd1d3d3a27 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Created reservations ['13fdeb81-2dd5-480f-962e-c08a4e9ad5f6', 'e08a6e30-f8ce-46e1-8c12-fac4ccb13e65', 'acb19ee6-4d4e-4769-aceb-98b98acf93bb', 'a56a87d3-bef6-4b73-952b-b00b7cffb5a8'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:15:46 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-ebd670f5-5eb4-4bf8-a468-a2dd1d3d3a27 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:15:46 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-ebd670f5-5eb4-4bf8-a468-a2dd1d3d3a27 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:15:46 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-ebd670f5-5eb4-4bf8-a468-a2dd1d3d3a27 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:15:46 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-ebd670f5-5eb4-4bf8-a468-a2dd1d3d3a27 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:15:46 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-ebd670f5-5eb4-4bf8-a468-a2dd1d3d3a27 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:15:46 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-ebd670f5-5eb4-4bf8-a468-a2dd1d3d3a27 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:46 devstack sudo[91298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:15:46 devstack sudo[91298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:46 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-7de849d6-c2b7-4019-9ca2-e8c0809ef17f tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Acquiring lock "cinder-f176a45c-6076-49f6-a0bf-b28f4f8d276a-delete_volume" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:15:46 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-7de849d6-c2b7-4019-9ca2-e8c0809ef17f tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Lock "cinder-f176a45c-6076-49f6-a0bf-b28f4f8d276a-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:15:46 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-7de849d6-c2b7-4019-9ca2-e8c0809ef17f tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Acquiring lock "cinder-quobyte-f176a45c-6076-49f6-a0bf-b28f4f8d276a" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:15:46 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-7de849d6-c2b7-4019-9ca2-e8c0809ef17f tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Lock "cinder-quobyte-f176a45c-6076-49f6-a0bf-b28f4f8d276a" acquired by "delete_volume" :: waited 0.008s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:15:46 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[edd9e7d9-8164-4ecd-bf11-212eccab975e]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:15:46 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-7de849d6-c2b7-4019-9ca2-e8c0809ef17f tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-f176a45c-6076-49f6-a0bf-b28f4f8d276a {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:46 devstack sudo[91300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-f176a45c-6076-49f6-a0bf-b28f4f8d276a Apr 16 15:15:46 devstack sudo[91300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:46 devstack sudo[91295]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:46 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-206ac08d-b4ac-4b91-b2e3-b1a907f0243d tempest-CinderUnicodeTest-1113442512 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6f5c3050-563d-4098-b020-9ed68057e6b4.d37e7f03-6134-41ba-ac13-df8de253b472" returned: 0 in 0.527s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:46 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.remotefs [None req-206ac08d-b4ac-4b91-b2e3-b1a907f0243d tempest-CinderUnicodeTest-1113442512 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6f5c3050-563d-4098-b020-9ed68057e6b4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82756) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 15:15:46 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[81b6e38b-1784-4a81-99d1-c152a8510349]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:15:46 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-206ac08d-b4ac-4b91-b2e3-b1a907f0243d tempest-CinderUnicodeTest-1113442512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6f5c3050-563d-4098-b020-9ed68057e6b4 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:46 devstack sudo[91305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6f5c3050-563d-4098-b020-9ed68057e6b4 Apr 16 15:15:46 devstack sudo[91305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:46 devstack sudo[91298]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:46 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-ebd670f5-5eb4-4bf8-a468-a2dd1d3d3a27 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.492s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:46 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-ebd670f5-5eb4-4bf8-a468-a2dd1d3d3a27 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:15:46 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-ebd670f5-5eb4-4bf8-a468-a2dd1d3d3a27 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Deleted volume successfully. Apr 16 15:15:46 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-ebd670f5-5eb4-4bf8-a468-a2dd1d3d3a27 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Lock "cinder-10e2771d-2a1a-483e-a0b8-14b1e66548d4-delete_volume" released by "delete_volume" :: held 1.521s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:15:47 devstack sudo[91300]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:47 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-7de849d6-c2b7-4019-9ca2-e8c0809ef17f tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-f176a45c-6076-49f6-a0bf-b28f4f8d276a" returned: 0 in 0.490s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:47 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-7de849d6-c2b7-4019-9ca2-e8c0809ef17f tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-f176a45c-6076-49f6-a0bf-b28f4f8d276a {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:47 devstack sudo[91311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-f176a45c-6076-49f6-a0bf-b28f4f8d276a Apr 16 15:15:47 devstack sudo[91311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:47 devstack sudo[91305]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:47 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-206ac08d-b4ac-4b91-b2e3-b1a907f0243d tempest-CinderUnicodeTest-1113442512 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6f5c3050-563d-4098-b020-9ed68057e6b4" returned: 0 in 0.484s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:47 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-206ac08d-b4ac-4b91-b2e3-b1a907f0243d tempest-CinderUnicodeTest-1113442512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6f5c3050-563d-4098-b020-9ed68057e6b4.d37e7f03-6134-41ba-ac13-df8de253b472 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:47 devstack sudo[91316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6f5c3050-563d-4098-b020-9ed68057e6b4.d37e7f03-6134-41ba-ac13-df8de253b472 Apr 16 15:15:47 devstack sudo[91316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:47 devstack sudo[91311]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:47 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-7de849d6-c2b7-4019-9ca2-e8c0809ef17f tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-f176a45c-6076-49f6-a0bf-b28f4f8d276a" returned: 0 in 0.430s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:47 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-7de849d6-c2b7-4019-9ca2-e8c0809ef17f tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Lock "cinder-quobyte-f176a45c-6076-49f6-a0bf-b28f4f8d276a" released by "delete_volume" :: held 0.941s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:15:47 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-7de849d6-c2b7-4019-9ca2-e8c0809ef17f tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Created reservations ['d73d19e2-abf2-4644-bd73-301dab34352e', 'cb18f1e5-6887-45e4-857e-35368480402d', '6944adbf-16ce-4fcb-aa8b-174448fd3226', '4402215b-6d17-4e9f-8cb6-db0c78186e77'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:15:47 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-7de849d6-c2b7-4019-9ca2-e8c0809ef17f tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:15:47 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-7de849d6-c2b7-4019-9ca2-e8c0809ef17f tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:15:47 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-7de849d6-c2b7-4019-9ca2-e8c0809ef17f tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:15:47 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-7de849d6-c2b7-4019-9ca2-e8c0809ef17f tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:15:47 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-7de849d6-c2b7-4019-9ca2-e8c0809ef17f tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:15:47 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-7de849d6-c2b7-4019-9ca2-e8c0809ef17f tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:47 devstack sudo[91319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:15:47 devstack sudo[91319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:47 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-94e46d0e-2581-4021-9fa0-c9046eafbd50 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Acquiring lock "cinder-4388773e-4726-4acc-8942-6470dec07d29-delete_volume" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:15:47 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-94e46d0e-2581-4021-9fa0-c9046eafbd50 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Lock "cinder-4388773e-4726-4acc-8942-6470dec07d29-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:15:47 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-94e46d0e-2581-4021-9fa0-c9046eafbd50 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Acquiring lock "cinder-quobyte-4388773e-4726-4acc-8942-6470dec07d29" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:15:47 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-94e46d0e-2581-4021-9fa0-c9046eafbd50 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Lock "cinder-quobyte-4388773e-4726-4acc-8942-6470dec07d29" acquired by "delete_volume" :: waited 0.010s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:15:47 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d0dd1d8-1996-43c8-8e80-d81eb910ced4]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:15:47 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-94e46d0e-2581-4021-9fa0-c9046eafbd50 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-4388773e-4726-4acc-8942-6470dec07d29 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:47 devstack sudo[91316]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:47 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-206ac08d-b4ac-4b91-b2e3-b1a907f0243d tempest-CinderUnicodeTest-1113442512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6f5c3050-563d-4098-b020-9ed68057e6b4.d37e7f03-6134-41ba-ac13-df8de253b472" returned: 0 in 0.494s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:47 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-206ac08d-b4ac-4b91-b2e3-b1a907f0243d tempest-CinderUnicodeTest-1113442512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6f5c3050-563d-4098-b020-9ed68057e6b4.d37e7f03-6134-41ba-ac13-df8de253b472 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:47 devstack sudo[91325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6f5c3050-563d-4098-b020-9ed68057e6b4.d37e7f03-6134-41ba-ac13-df8de253b472 Apr 16 15:15:47 devstack sudo[91325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:47 devstack sudo[91324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-4388773e-4726-4acc-8942-6470dec07d29 Apr 16 15:15:47 devstack sudo[91324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:48 devstack sudo[91319]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:48 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-7de849d6-c2b7-4019-9ca2-e8c0809ef17f tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.496s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:48 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-7de849d6-c2b7-4019-9ca2-e8c0809ef17f tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:15:48 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-7de849d6-c2b7-4019-9ca2-e8c0809ef17f tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Deleted volume successfully. Apr 16 15:15:48 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-7de849d6-c2b7-4019-9ca2-e8c0809ef17f tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Lock "cinder-f176a45c-6076-49f6-a0bf-b28f4f8d276a-delete_volume" released by "delete_volume" :: held 1.616s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:15:48 devstack sudo[91324]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:48 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-94e46d0e-2581-4021-9fa0-c9046eafbd50 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-4388773e-4726-4acc-8942-6470dec07d29" returned: 0 in 0.455s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:48 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-94e46d0e-2581-4021-9fa0-c9046eafbd50 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-4388773e-4726-4acc-8942-6470dec07d29 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:48 devstack sudo[91333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-4388773e-4726-4acc-8942-6470dec07d29 Apr 16 15:15:48 devstack sudo[91333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:48 devstack sudo[91325]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:48 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-206ac08d-b4ac-4b91-b2e3-b1a907f0243d tempest-CinderUnicodeTest-1113442512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6f5c3050-563d-4098-b020-9ed68057e6b4.d37e7f03-6134-41ba-ac13-df8de253b472" returned: 0 in 0.486s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:48 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-206ac08d-b4ac-4b91-b2e3-b1a907f0243d tempest-CinderUnicodeTest-1113442512 None] Lock "cinder-quobyte-d37e7f03-6134-41ba-ac13-df8de253b472" released by "_delete_snapshot" :: held 2.054s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:15:48 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-206ac08d-b4ac-4b91-b2e3-b1a907f0243d tempest-CinderUnicodeTest-1113442512 None] Lock "cinder-quobyte-6f5c3050-563d-4098-b020-9ed68057e6b4" released by "delete_snapshot" :: held 2.065s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:15:48 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-206ac08d-b4ac-4b91-b2e3-b1a907f0243d tempest-CinderUnicodeTest-1113442512 None] Created reservations ['3f45460d-be04-4049-baa3-6afe3d8a054e', 'fdde843c-6052-4fa4-a0d4-dd5a583c64db', 'c7d3c750-c059-4973-9a96-d1a557f4236c', 'b111cc01-4a97-4b36-9a06-03e128846012'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:15:48 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-206ac08d-b4ac-4b91-b2e3-b1a907f0243d tempest-CinderUnicodeTest-1113442512 None] Delete snapshot completed successfully. Apr 16 15:15:48 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-206ac08d-b4ac-4b91-b2e3-b1a907f0243d tempest-CinderUnicodeTest-1113442512 None] Lock "cinder-d37e7f03-6134-41ba-ac13-df8de253b472-delete_snapshot" released by "delete_snapshot" :: held 2.162s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:15:48 devstack sudo[91333]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:48 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-94e46d0e-2581-4021-9fa0-c9046eafbd50 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-4388773e-4726-4acc-8942-6470dec07d29" returned: 0 in 0.433s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:48 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-94e46d0e-2581-4021-9fa0-c9046eafbd50 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Lock "cinder-quobyte-4388773e-4726-4acc-8942-6470dec07d29" released by "delete_volume" :: held 0.909s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:15:48 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-94e46d0e-2581-4021-9fa0-c9046eafbd50 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Created reservations ['2667d330-0860-4e50-8e39-b6cb490c7b7c', '1bcd4569-b5f3-449c-87bd-17fe0a3b37ae', '3671b62f-817b-48c3-a1bf-64cf308f8785', '319a3501-63c8-4f79-a7cc-1807bb830e62'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:15:48 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-94e46d0e-2581-4021-9fa0-c9046eafbd50 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:15:48 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-94e46d0e-2581-4021-9fa0-c9046eafbd50 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:15:48 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-94e46d0e-2581-4021-9fa0-c9046eafbd50 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:15:48 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-94e46d0e-2581-4021-9fa0-c9046eafbd50 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:15:48 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-94e46d0e-2581-4021-9fa0-c9046eafbd50 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:15:48 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-94e46d0e-2581-4021-9fa0-c9046eafbd50 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:48 devstack sudo[91336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:15:48 devstack sudo[91336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:49 devstack sudo[91336]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:49 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-94e46d0e-2581-4021-9fa0-c9046eafbd50 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.492s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:49 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-94e46d0e-2581-4021-9fa0-c9046eafbd50 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:15:49 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-94e46d0e-2581-4021-9fa0-c9046eafbd50 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Deleted volume successfully. Apr 16 15:15:49 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-94e46d0e-2581-4021-9fa0-c9046eafbd50 tempest-CreateVolumesFromSourceVolumeTest-1514380345 None] Lock "cinder-4388773e-4726-4acc-8942-6470dec07d29-delete_volume" released by "delete_volume" :: held 1.538s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:15:49 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-2dc1c079-eeb7-4e93-90d2-a190378d6de0 tempest-CinderUnicodeTest-1113442512 None] Acquiring lock "cinder-6f5c3050-563d-4098-b020-9ed68057e6b4-delete_volume" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:15:49 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-2dc1c079-eeb7-4e93-90d2-a190378d6de0 tempest-CinderUnicodeTest-1113442512 None] Lock "cinder-6f5c3050-563d-4098-b020-9ed68057e6b4-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:15:49 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-2dc1c079-eeb7-4e93-90d2-a190378d6de0 tempest-CinderUnicodeTest-1113442512 None] Acquiring lock "cinder-quobyte-6f5c3050-563d-4098-b020-9ed68057e6b4" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:15:49 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-2dc1c079-eeb7-4e93-90d2-a190378d6de0 tempest-CinderUnicodeTest-1113442512 None] Lock "cinder-quobyte-6f5c3050-563d-4098-b020-9ed68057e6b4" acquired by "delete_volume" :: waited 0.008s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:15:49 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfe9bfe8-a757-4b48-ba2d-4861b1dace93]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:15:49 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-2dc1c079-eeb7-4e93-90d2-a190378d6de0 tempest-CinderUnicodeTest-1113442512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6f5c3050-563d-4098-b020-9ed68057e6b4 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:49 devstack sudo[91339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6f5c3050-563d-4098-b020-9ed68057e6b4 Apr 16 15:15:49 devstack sudo[91339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:50 devstack sudo[91339]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:50 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-2dc1c079-eeb7-4e93-90d2-a190378d6de0 tempest-CinderUnicodeTest-1113442512 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6f5c3050-563d-4098-b020-9ed68057e6b4" returned: 0 in 0.571s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:50 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-2dc1c079-eeb7-4e93-90d2-a190378d6de0 tempest-CinderUnicodeTest-1113442512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6f5c3050-563d-4098-b020-9ed68057e6b4 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:50 devstack sudo[91344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6f5c3050-563d-4098-b020-9ed68057e6b4 Apr 16 15:15:50 devstack sudo[91344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:50 devstack sudo[91344]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:50 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-2dc1c079-eeb7-4e93-90d2-a190378d6de0 tempest-CinderUnicodeTest-1113442512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-6f5c3050-563d-4098-b020-9ed68057e6b4" returned: 0 in 0.401s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:50 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-2dc1c079-eeb7-4e93-90d2-a190378d6de0 tempest-CinderUnicodeTest-1113442512 None] Lock "cinder-quobyte-6f5c3050-563d-4098-b020-9ed68057e6b4" released by "delete_volume" :: held 1.014s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:15:50 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-2dc1c079-eeb7-4e93-90d2-a190378d6de0 tempest-CinderUnicodeTest-1113442512 None] Created reservations ['1c5dd40b-3e16-4230-b44e-8ce5f30c7d4f', '4d5c84b4-530d-4b6b-971c-78ccdc82e807', '1a573232-aecc-4d84-b5c7-2acf85afbd12', '26f08780-479a-4673-8a4f-a26004786e2d'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:15:50 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-2dc1c079-eeb7-4e93-90d2-a190378d6de0 tempest-CinderUnicodeTest-1113442512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:15:50 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-2dc1c079-eeb7-4e93-90d2-a190378d6de0 tempest-CinderUnicodeTest-1113442512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:15:50 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-2dc1c079-eeb7-4e93-90d2-a190378d6de0 tempest-CinderUnicodeTest-1113442512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:15:50 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-2dc1c079-eeb7-4e93-90d2-a190378d6de0 tempest-CinderUnicodeTest-1113442512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:15:50 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-2dc1c079-eeb7-4e93-90d2-a190378d6de0 tempest-CinderUnicodeTest-1113442512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:15:50 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-2dc1c079-eeb7-4e93-90d2-a190378d6de0 tempest-CinderUnicodeTest-1113442512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:50 devstack sudo[91347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:15:50 devstack sudo[91347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:50 devstack sudo[91347]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:50 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-2dc1c079-eeb7-4e93-90d2-a190378d6de0 tempest-CinderUnicodeTest-1113442512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.403s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:50 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-2dc1c079-eeb7-4e93-90d2-a190378d6de0 tempest-CinderUnicodeTest-1113442512 None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:15:50 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-2dc1c079-eeb7-4e93-90d2-a190378d6de0 tempest-CinderUnicodeTest-1113442512 None] Deleted volume successfully. Apr 16 15:15:50 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-2dc1c079-eeb7-4e93-90d2-a190378d6de0 tempest-CinderUnicodeTest-1113442512 None] Lock "cinder-6f5c3050-563d-4098-b020-9ed68057e6b4-delete_volume" released by "delete_volume" :: held 1.567s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:15:51 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-a853fb37-efb0-4b16-bf56-a5b126d37a0a tempest-CinderUnicodeTest-1113442512 None] Acquiring lock "cinder-8c64c84d-3e7a-44ae-b871-2fa4dc1b6e46-delete_volume" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:15:51 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-a853fb37-efb0-4b16-bf56-a5b126d37a0a tempest-CinderUnicodeTest-1113442512 None] Lock "cinder-8c64c84d-3e7a-44ae-b871-2fa4dc1b6e46-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:15:51 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-a853fb37-efb0-4b16-bf56-a5b126d37a0a tempest-CinderUnicodeTest-1113442512 None] Acquiring lock "cinder-quobyte-8c64c84d-3e7a-44ae-b871-2fa4dc1b6e46" by "delete_volume" {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 15:15:51 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-a853fb37-efb0-4b16-bf56-a5b126d37a0a tempest-CinderUnicodeTest-1113442512 None] Lock "cinder-quobyte-8c64c84d-3e7a-44ae-b871-2fa4dc1b6e46" acquired by "delete_volume" :: waited 0.011s {{(pid=82756) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 15:15:51 devstack cinder-volume[82756]: DEBUG oslo.privsep.daemon [-] privsep: reply[93baf538-40ba-42b0-81c8-c48a163ba10f]: (4, 'qcow2') {{(pid=83662) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 15:15:51 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-a853fb37-efb0-4b16-bf56-a5b126d37a0a tempest-CinderUnicodeTest-1113442512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-8c64c84d-3e7a-44ae-b871-2fa4dc1b6e46 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:51 devstack sudo[91350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-8c64c84d-3e7a-44ae-b871-2fa4dc1b6e46 Apr 16 15:15:51 devstack sudo[91350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:51 devstack cinder-volume[82756]: DEBUG oslo_service.periodic_task [None req-9570f02d-5ef9-412b-993f-520a9e5bfa81 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82756) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 16 15:15:51 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-9570f02d-5ef9-412b-993f-520a9e5bfa81 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:15:51 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-9570f02d-5ef9-412b-993f-520a9e5bfa81 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:15:51 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-9570f02d-5ef9-412b-993f-520a9e5bfa81 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:15:51 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-9570f02d-5ef9-412b-993f-520a9e5bfa81 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:15:51 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-9570f02d-5ef9-412b-993f-520a9e5bfa81 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:15:51 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-9570f02d-5ef9-412b-993f-520a9e5bfa81 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:51 devstack sudo[91352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:15:51 devstack sudo[91352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:52 devstack sudo[91350]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:52 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-a853fb37-efb0-4b16-bf56-a5b126d37a0a tempest-CinderUnicodeTest-1113442512 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-8c64c84d-3e7a-44ae-b871-2fa4dc1b6e46" returned: 0 in 0.457s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:52 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-a853fb37-efb0-4b16-bf56-a5b126d37a0a tempest-CinderUnicodeTest-1113442512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-8c64c84d-3e7a-44ae-b871-2fa4dc1b6e46 {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:52 devstack sudo[91357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-8c64c84d-3e7a-44ae-b871-2fa4dc1b6e46 Apr 16 15:15:52 devstack sudo[91357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:52 devstack sudo[91352]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:52 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-9570f02d-5ef9-412b-993f-520a9e5bfa81 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.416s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:52 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-9570f02d-5ef9-412b-993f-520a9e5bfa81 None None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:15:52 devstack sudo[91357]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:52 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-a853fb37-efb0-4b16-bf56-a5b126d37a0a tempest-CinderUnicodeTest-1113442512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e/volume-8c64c84d-3e7a-44ae-b871-2fa4dc1b6e46" returned: 0 in 0.455s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:52 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-a853fb37-efb0-4b16-bf56-a5b126d37a0a tempest-CinderUnicodeTest-1113442512 None] Lock "cinder-quobyte-8c64c84d-3e7a-44ae-b871-2fa4dc1b6e46" released by "delete_volume" :: held 0.935s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:15:52 devstack cinder-volume[82756]: DEBUG cinder.quota [None req-a853fb37-efb0-4b16-bf56-a5b126d37a0a tempest-CinderUnicodeTest-1113442512 None] Created reservations ['efb476bb-c40a-4150-9175-666bbf8eb02a', 'c251c7ef-975d-41fa-a14e-0689b9b10cbb', '2060bcff-7f47-4e1a-8156-379c3bc8709a', '90bc9a34-26f2-4288-be3d-9ee595288203'] {{(pid=82756) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 15:15:52 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-a853fb37-efb0-4b16-bf56-a5b126d37a0a tempest-CinderUnicodeTest-1113442512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 15:15:52 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-a853fb37-efb0-4b16-bf56-a5b126d37a0a tempest-CinderUnicodeTest-1113442512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 15:15:52 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-a853fb37-efb0-4b16-bf56-a5b126d37a0a tempest-CinderUnicodeTest-1113442512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781': None} {{(pid=82756) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 15:15:52 devstack cinder-volume[82756]: DEBUG cinder.volume.drivers.quobyte [None req-a853fb37-efb0-4b16-bf56-a5b126d37a0a tempest-CinderUnicodeTest-1113442512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-22da348f-b6f4-435e-ab53-bf025001f781'] {{(pid=82756) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 15:15:52 devstack cinder-volume[82756]: DEBUG oslo_concurrency.lockutils [None req-a853fb37-efb0-4b16-bf56-a5b126d37a0a tempest-CinderUnicodeTest-1113442512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82756) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 15:15:52 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-a853fb37-efb0-4b16-bf56-a5b126d37a0a tempest-CinderUnicodeTest-1113442512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 15:15:52 devstack sudo[91361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e Apr 16 15:15:52 devstack sudo[91361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 15:15:53 devstack sudo[91361]: pam_unix(sudo:session): session closed for user root Apr 16 15:15:53 devstack cinder-volume[82756]: DEBUG oslo_concurrency.processutils [None req-a853fb37-efb0-4b16-bf56-a5b126d37a0a tempest-CinderUnicodeTest-1113442512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/05b834f6876bb5378befdc39d795102e" returned: 0 in 0.444s {{(pid=82756) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 15:15:53 devstack cinder-volume[82756]: DEBUG cinder.manager [None req-a853fb37-efb0-4b16-bf56-a5b126d37a0a tempest-CinderUnicodeTest-1113442512 None] Notifying Schedulers of capabilities ... {{(pid=82756) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 15:15:53 devstack cinder-volume[82756]: INFO cinder.volume.manager [None req-a853fb37-efb0-4b16-bf56-a5b126d37a0a tempest-CinderUnicodeTest-1113442512 None] Deleted volume successfully. Apr 16 15:15:53 devstack cinder-volume[82756]: DEBUG cinder.coordination [None req-a853fb37-efb0-4b16-bf56-a5b126d37a0a tempest-CinderUnicodeTest-1113442512 None] Lock "cinder-8c64c84d-3e7a-44ae-b871-2fa4dc1b6e46-delete_volume" released by "delete_volume" :: held 1.508s {{(pid=82756) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 15:16:02 devstack cinder-volume[82756]: DEBUG dbcounter [-] [82756] Writing DB stats cinder:UPDATE=218,cinder:SELECT=149,cinder:INSERT=64,cinder:DELETE=15 {{(pid=82756) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 15:16:03 devstack cinder-volume[82756]: DEBUG dbcounter [-] [82756] Writing DB stats cinder:SELECT=158,cinder:UPDATE=231,cinder:INSERT=49,cinder:DELETE=21 {{(pid=82756) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}